Monday, January 19, 2015

Logstash Examples with Data Generators

Logstash is a pretty cool application that generically takes some input, does something with the data, and spew it out somewhere else.



It's commonly used in conjunction with Elasticsearch, a Lucene based search service, and Kibana, a dashboard UI for Elasticsearch.  You can easily consider this as a "Splunk without super awesome ad hoc query capabilities" but the software itself is FREE so there's that.

The documentation for Logstash is pretty straightfoward, but I thought it would be nice to have some hard examples to work off of that involved the whole ELK stack:


Right now it just has two examples: file and log4j.

File:
  • Write to a file
  • Logstash monitors the specific file and does some grokking before passing it to Elasticsearch
  • Load the provided kibana dashboard.
log4j:
  • Spew log4j stuff out with SocketAppender
  • Set up Logstash to monitor a port for log4j messages and grok before passing it to Elasticsearch
  • load the provided Kibana dashboard
So yeah I hope this serves as a quick and easy way for people to observe the awesomeness that is Logstash.  Feel free to add your own examples to this guy as well.

21 comments:

priyatamil said...

Usually I do not read post on blogs, but I would like to say that this write-up very forced me to try and do it! Your writing style has been surprised me. Great work admin..Keep update more blog..

Android Training in Chennai

Rick Campbell said...

Also I would like to draw your attention to virtual data room software . Many entrepreneurs are following your blog so I think that this topic will be interesting for them.

Akshaysri said...

Usually I do not read post on blogs, but I would like to say that this write-up very forced me to try and do it! Your writing style has been surprised me. Great work admin.Keep update more blog.
PTE Coaching in Chennai

Unknown said...

really cool post, highly informative and professionally written and I am glad to be a visitor of this perfect blog, thank you for this rare info!
splunk training in hyderabad
servicenow training in hyderabad

sivaranjani said...

Great site for these post and i am seeing the most of contents have useful for my Carrier.Thanks to such a useful information
Web Design Company in Chennai

Anonymous said...

this is very nice post and thanks for sharing this wonderful information to us.i really would like to appreciate to your attention for us.

Base SAS Training in chennai

Unknown said...

Content is very clear and easily explained it is very interesting as well. I hope you post again soon.

Selenium Training in Chennai

Unknown said...

Thanks for the informative article. This is one of the best resources I have found in quite some time. Nicely written and great info. I really cannot thank you enough for sharing.

Restaurant in OMR

sai said...

Thank you for benefiting from time to focus on this kind of, I feel firmly about it and also really like comprehending far more with this particular subject matter. In case doable, when you get know-how, is it possible to thoughts modernizing your site together with far more details? It’s extremely useful to me 
python course in pune
python course in chennai
python course in Bangalore

simbu said...

I believe there are many more pleasurable opportunities ahead for individuals that looked at your site.
Java training in Chennai | Java training institute in Chennai | Java course in Chennai

Java training in Bangalore | Java training institute in Bangalore | Java course in Bangalore

Java online training | Java Certification Online course-Gangboard

Java training in Pune

Unknown said...

Great thoughts you got there, believe I may possibly try just some of it throughout my daily life.

Data Science course in Chennai | Best Data Science course in Chennai
Data science course in bangalore | Best Data Science course in Bangalore
Data science course in pune | Data Science Course institute in Pune
Data science online course | Online Data Science certification course-Gangboard
Data Science Interview questions and answers
Data Science Tutorial

nikhil reddy said...


I found a ton of data here to make this in reality best for all novice here. Much obliged to you for this data.

Artificial Intelligence Training In Hyderabad

Artificial Intelligence Course In Hyderabad

lionelmessi said...

Hi, thanks for sharing wonderful stuff...

AI Training In Hyderabad

nisha said...

Thank you For Sharing this Blog. The Blog is really Impressive Fetch the Information easily from this Content.

Data Science Training Course In Chennai | Data Science Training Course In Anna Nagar | Data Science Training Course In OMR | Data Science Training Course In Porur | Data Science Training Course In Tambaram | Data Science Training Course In Velachery

aarthi said...

useful blog.Keep blogging with us.Java training in Chennai

Java training in Bangalore

Java training in Hyderabad

Java Training in Coimbatore

Java Online Training

devi said...

I just got to this amazing site not long ago. I was actually captured with the piece of resources you have got here. Big thumbs up for making such wonderful blog page!
Thank you for your valuable content , Easy to understand and follow.
Data Science Training In Chennai

Data Science Online Training In Chennai

Data Science Training In Bangalore

Data Science Training In Hyderabad

Data Science Training In Coimbatore

Data Science Training

Data Science Online Training

Anonymous said...

ExcelR provides data scientist course in pune . It is a great platform for those who want to learn and become a data scientist. Students are tutored by professionals who have a degree in a particular topic. It is a great opportunity to learn and grow.

data scientist course in pune


lakshmik7410 said...

Thanks for sharing a very useful article. Keep us posted!
data science training in chennai

ccna training in chennai

iot training in chennai

cyber security training in chennai

ethical hacking training in chennai

Anonymous said...

Thanks for the informative article Business Analytics Course

Pavithra Devi said...

This post is so interactive and informative.keep update more information...
Salesforce Training in Tambaram
Salesforce Training in Chennai

manasha said...

Great post. keep sharing such a worthy information.
Blue Prism Training in Chennai
Blue Prism Online Training