The Twitter Engineering Blog

Information from Twitter's engineering team about our technology, tools and events.

Twitter #DataGrants selections

Learn more about the six institutions we’ve selected to receive Twitter #DataGrants.Read more…

Scalding 0.9: Get it while it’s hot!

Tags:

It’s been just over two years since we open sourced Scalding and today we are very excited to release the 0.9 version. Scalding at Twitter powers everything from internal and external facing dashboards, to custom relevance and ad targeting algorithms, including many graph algorithms such as PageRank, approximate user cosine similarity and many more.

There have been a wide breadth of new features added to Scalding since the last release:Read more…

Manhattan, our real-time, multi-tenant distributed database for Twitter scale

Twitter has unique and intensive storage requirements. We built a database, called Manhattan, that meets those requirements and allows self-service access for our engineers.Read more…

Greater privacy for your Twitter emails with TLS

Tags:

Protecting users’ privacy is a never-ending process, and we are committed to keeping our users’ information safe. Since mid-January, we have been protecting your emails from Twitter using TLS in the form of StartTLS. StartTLS encrypts emails as they transit between sender and receiver and is designed to prevent snooping.Read more…

__attribute__ directives in Objective-C

Tags:

In this post, we’ll examine what __attribute__ directives are and how they can be used in development. The goal is to establish a value to using __attribute__ directives in any codebase and to provide a starting point with some directives that anyone can start using right away.Read more…

How To: Objective C Initializer Patterns

Tags:
Initializer patterns are an important part of good Objective-C, but these best practices are often overlooked. By being more rigorous and conforming to some best practices, we can save ourselves a lot of trouble. In this article, we’ll cover initialization topics in-depth, with examples to demonstrate how things can go wrong.Read more…

Netty at Twitter with Finagle

Tags:

Finagle is our fault tolerant, protocol-agnostic RPC framework built atop Netty. Twitter’s core services are built on Finagle, from backends serving user profile information, Tweets, and timelines to front end API endpoints handling HTTP requests.Read more…

Introducing Twitter Data Grants

Today we’re introducing a pilot project we’re calling Twitter Data Grants, through which we’ll give a handful of research institutions access to our public and historical data.Read more…

Mesos 0.15 and Authentication Support

With the latest Mesos 0.15.0 release, we are pleased to report that we’ve added initial authentication support for frameworks (see MESOS-418) connecting to Mesos. In a nutshell, this feature allows only authenticated frameworks to register with Mesos and launch tasks. Authentication is important as it prevents rogue frameworks from causing problems that may impact the usage of resources within a Mesos cluster.Read more…

CocoaSPDY: SPDY for iOS / OS X

Tags:

For over a year now, Twitter has supported the SPDY protocol and today it accounts for a significant percentage of our web traffic. SPDY aims to improve upon a number of HTTP’s shortcomings and one client segment in particular that has a lot of potential to benefit is mobile devices. Cellular networks still suffer from high latency, so reducing client-server roundtrips can have a pronounced impact on a user’s experience.Read more…

Pages