Parse.ly Tech Archives

Parse.ly Tech

How metadata supercharges analytics in Parse.ly

Parse.ly tracks a number of directly-measured metrics from websites, such as views, visitors, time, and shares. In addition to this, Parse.ly tracks "page metadata" using one of several content management system (CMS) integrations. In fact,…

Andrew MontalentiDecember 12, 2016

Parse.ly Tech

Picking a cloud database for analytics: the SQL options

If you're a developer, analyst, or data scientist, you have probably been hearing a lot about "analytics" these days. Some the most popular open source big data projects, like -- Spark, Cassandra, and Elasticsearch --…

Andrew MontalentiOctober 14, 2016

Parse.ly Tech

Postmortem of Parse.ly’s Real-Time Outage (2016-06-09)

On Thursday, June 9, 2016, Parse.ly experienced a real-time data outage that lasted approximately 3 hours. No customer data was lost, but this did result in a delayed delivery of data from that 3-hour window.…

Andrew MontalentiJune 13, 2016

Parse.ly Tech

PyKafka: Fast, Pythonic Kafka, at Last!

Why Parse.ly uses Kafka For the last three years, Parse.ly has been one of the biggest production users of Apache Kafka as a core piece of infrastructure in our log-oriented architecture. We currently process over…

Andrew MontalentiJune 9, 2016

Parse.ly Tech

Announcing PyKafka: Python Support for Kafka 0.8.x

Today, Parse.ly is happy to announce the 1.0 release of PyKafka, a new Python driver for Kafka. Kafka is "publish-subscribe messaging rethought as a distributed commit log", and Parse.ly makes heavy use of it. PyKafka…

Emmett ButlerJune 8, 2015

Parse.ly Tech Uncategorized

This Team Used Apache Cassandra… You Won’t Believe What Happened Next

You know that old saying, "If it seems too good to be true, it probably is?" We technologists should probably apply that saying to database vendor claims pretty regularly. In the summer of 2014, the…

Andrew MontalentiMay 6, 2015

Parse.ly Tech

Grokking Python Event Loops and Concurrency with Apache Cassandra

Python offers a number of different concurrency models, including multi-threading, process pools, and cooperative multitasking around an async event loop. These various concurrency models were demonstrated in a fun live coding session by David Beazley…

Andrew MontalentiApril 22, 2015

Parse.ly Tech

Kafkapocalypse: a postmortem on our service outage

On Thur, Mar 26 2015 and Fri, Mar 27 2015, Parse.ly experienced several outages of its data processing backend. The result was several hours of no new data appearing in our analytics dashboards, both for…

Andrew MontalentiMarch 31, 2015

Parse.ly Tech

Lucene: The Good Parts

Before MongoDB, before Cassandra, before "NoSQL", there was Lucene. Did you know that Doug Cutting wrote the first versions of Lucene in 1999? To put things in context, this was around the time Google was…

Andrew MontalentiMarch 12, 2015

Parse.ly Tech

Mage: The Magical Time Series Backend Behind Parse.ly Analytics

Building a time series engine is hard. Beyond the typical database management problems of data distribution, fault tolerance, and read/write scaling, you have the additional reporting challenge -- how do you make it simple to…

Andrew MontalentiFebruary 5, 2015

Parse.ly Tech

Loving a Log-Oriented Architecture

Jay Kreps created Apache Kafka to address his data integration needs at LinkedIn. He also wrote a widely-circulated essay about "The Log" that shows the motivation behind the system he created. A few months later,…

Andrew MontalentiDecember 23, 2014

Parse.ly Tech

Apache Storm: The Big Reference

Apache Storm is a free and open source project that is heavily used here at Parse.ly, as well as at other major real-time data processing projects such as Twitter, Pinterest, Spotify, and Wikipedia. In the…

Andrew MontalentiJuly 9, 2014

Parse.ly Tech

How metadata supercharges analytics in Parse.ly

Picking a cloud database for analytics: the SQL options

Postmortem of Parse.ly’s Real-Time Outage (2016-06-09)

PyKafka: Fast, Pythonic Kafka, at Last!

Announcing PyKafka: Python Support for Kafka 0.8.x

This Team Used Apache Cassandra… You Won’t Believe What Happened Next

Grokking Python Event Loops and Concurrency with Apache Cassandra

Kafkapocalypse: a postmortem on our service outage

Lucene: The Good Parts

Mage: The Magical Time Series Backend Behind Parse.ly Analytics

Loving a Log-Oriented Architecture

Apache Storm: The Big Reference

Get the latest content analytics insights in your inbox

Resources

Platform

Company