The Twitter Blog Network

News, notes and stories on our products, initiatives and company doings.

Posts from all blogs on topicopensource

Netty 4 at Twitter: Reduced GC Overhead

Topics:

At Twitter, Netty (@netty_project) is used in core places requiring networking functionality.

For example:Read more…

Summer of Code 2013 Results

Topics:

For the second time, we had the opportunity to participate in the Google Summer of Code (GSoC) and we want to share news on the resulting open source activities. Unlike many GSoC participating organizations that focus on a single ecosystem, we have a variety of projects that span multiple programming languages and communities.

We worked on three projects with three amazing students over the summer.Read more…

Dremel made simple with Parquet

Topics:

Columnar storage is a popular technique to optimize analytical workloads in parallel RDBMs. The performance and compression benefits for storing and processing large amounts of data are well documented in academic literature as well as several commercial analytical databases.Read more…

Observability at Twitter

Topics:

As Twitter has moved from a monolithic to a distributed architecture, our scalability has increased dramatically.Read more…

Streaming MapReduce with Summingbird

Topics:

Today we are open sourcing Summingbird on GitHub under the ALv2.Read more…

Bootstrap 3.0

Topics:

We are thrilled to see the Bootstrap community announce the 3.0 release:Read more…

Announcing Parquet 1.0: Columnar Storage for Hadoop

Topics:

In March we announced the Parquet project, the result of a collaboration between Twitter and Cloudera intended to create an open-source columnar storage format library for Apache Hadoop.Read more…

Mesos Graduates from Apache Incubation

Topics:

The Apache Software Foundation (ASF) has announced the graduation of Apache Mesos, the open source cluster manager that is used and heavily supported by Twitter, from its incubator.Read more…

hRaven and the @HadoopSummit

Topics:

Today marks the start of the Hadoop Summit, and we are thrilled to be a part of it. A few of our engineers will be participating in talks about our Hadoop usage at the summit:Read more…

Zippy Traces with Zipkin in your Browser

Topics:

Last summer, we open-sourced Zipkin, a distributed tracing system that helps us gather timing and dependency data for the many services involved in managing requests to Twitter. As we continually improve Zipkin, today we’re adding a Firefox extension to Zipkin that makes it easy to see trace visualizations in your browser as you navigate your website.Read more…

Pages