Our engineering team released streamparse today at PyData Silicon Valley 2014. It was demonstrated at our talk, “Real-time streams & logs with Apache Kafka and Storm”. We discussed Apache Storm, Apache Kafka, and the Python libraries we use to interact with those tools, such as the samsa Kafka driver, which we maintain. These tools comprise the core of our data processing backend, which processes thousands of data tuples per second and billions per month for low-latency time series analysis.
Read the announcement blog post. Also, check out our new Parse.ly Code & Tech page, where we have links to all our open source projects, conference presentations, and other information about our engineering team’s projects.
And, if you’re interested in streamparse, please join us in working on it!
Or, get in touch via Twitter:
- Mike Sukmanowsky (Product Lead, @msukmanowsky)
- Keith Bourgoin (Backend Lead, @kbourgoin)
- Andrew Montalenti (CTO, @amontalenti)
We are actively looking for collaborators!