Posts from Engineering on topicopensource

At Twitter, Netty (@netty_project) is used in core places requiring networking functionality.

For example:Read more…

For the second time, we had the opportunity to participate in the Google Summer of Code (GSoC) and we want to share news on the resulting open source activities. Unlike many GSoC participating organizations that focus on a single ecosystem, we have a variety of projects that span multiple programming languages and communities.

We worked on three projects with three amazing students over the summer.Read more…

Columnar storage is a popular technique to optimize analytical workloads in parallel RDBMs. The performance and compression benefits for storing and processing large amounts of data are well documented in academic literature as well as several commercial analytical databases.Read more…

As Twitter has moved from a monolithic to a distributed architecture, our scalability has increased dramatically.Read more…

Today we are open sourcing Summingbird on GitHub under the ALv2.Read more…

We are thrilled to see the Bootstrap community announce the 3.0 release:Read more…

In March we announced the Parquet project, the result of a collaboration between Twitter and Cloudera intended to create an open-source columnar storage format library for Apache Hadoop.Read more…

The Apache Software Foundation (ASF) has announced the graduation of Apache Mesos, the open source cluster manager that is used and heavily supported by Twitter, from its incubator.Read more…

Today marks the start of the Hadoop Summit, and we are thrilled to be a part of it. A few of our engineers will be participating in talks about our Hadoop usage at the summit:Read more…

Last summer, we open-sourced Zipkin, a distributed tracing system that helps us gather timing and dependency data for the many services involved in managing requests to Twitter. As we continually improve Zipkin, today we’re adding a Firefox extension to Zipkin that makes it easy to see trace visualizations in your browser as you navigate your website.Read more…