Twitter Engineering

Building the world’s first real-time distributed public platform connecting people to their interests, events and each other

Twitter University
Building a culture of learning for @TwitterEng and the world at large through videos, code samples, and more.
Open Source
Twitter engineers use, contribute to and release a lot of open source software. We share what we learn with the greater community via the @TwitterOSS office.
Research
Twitter encourages publication through scientific bodies and industry standards groups. We also have a strong open source culture to share our research widely.

From the Twitter Engineering Blog

  • Flying faster with Twitter Heron Tuesday, June 02, 2015

    We process billions of events on Twitter every day. As you might guess, analyzing these events in real time presents a massive challenge. Our main system for such analysis has been Storm, a distributed stream computation system we’ve open-sourced. But as the scale and diversity of Twitter data has increased, our requirements have evolved.

  • Graduating Apache Parquet Thursday, May 21, 2015

    ASF, the Apache Software Foundation, recently announced the graduation of Apache Parquet, a columnar storage format for the Apache Hadoop ecosystem. At Twitter, we’re excited to be a founding member of the project.

  • Building a new trends experience Friday, April 24, 2015

    We recently launched a new trends experience on mobile and web. Certain users will now see additional context with their trends: a short description and at times an accompanying image. While building this new product experience, we also switched the entire trends backend system to a brand new platform. This is the largest engineering undertaking of the trends system since 2008.

  • Another look at MySQL at Twitter and incubating Mysos Thursday, April 16, 2015

    While we’re at the Percona Live MySQL Conference, we’d like to discuss updates on how Twitter uses MySQL, as well as share our plans to open source Mysos, a new MySQL on Apache Mesos framework.