The Twitter Engineering Blog

Information from Twitter's engineering team about our technology, tools and events.

Posts from Engineering: announcements

Open Sourcing Twitter Heron

We’re open sourcing Heron, our real-time stream processing engine which has been powering all of Twitter’s real-time analytics for over two years.

Read more...

Diffy: Testing services without writing tests

Diffy is an open-source tool that automatically detects potential bugs in HTTP-based services.

Read more...

Flying faster with Twitter Heron

A new real-time analytics platform at Twitter scale.

Read more...

Building a new trends experience

Learn how we revamped trends and rewrote the entire trends backend system.

Read more...

Handling five billion sessions a day – in real time

An inside look at the Answers architecture that provides app developers with reliable, real-time and actionable insights into their mobile apps.

Read more...

All about Apache Aurora

As @ApacheAurora announces their 0.7.0 release, we share the story of Aurora at Twitter and in the open source community.

Read more...

Building a complete Tweet index

Today, we are pleased to announce that Twitter now indexes every public Tweet since 2006.

Since that first simple Tweet over eight years ago, hundreds of billions of Tweets have captured everyday human experiences and major historical events. Our search engine excelled at surfacing breaking news and events in real time, and our search index infrastructure reflected this strong emphasis on recency. But our long-standing goal has been to let people search through every Tweet ever published.

Read more...

Investing in MIT’s new Laboratory for Social Machines

Today, @MIT announced the creation of the Laboratory for Social Machines, funded by a

Read more...

Bringing more design principles to security

To date, much of the web and mobile security focus has been on security bugs such as cross-site-scripting and SQL injection. Due to the number of those issues and the fact that the number of bugs in general increases in proportion to the number of lines of code, it’s clear that if we hope to address software security problems as a community, we also need to invest in designing software securely to eliminate entire classes of bugs.

Read more...

Fighting spam with BotMaker

To fight spam on Twitter, we built BotMaker — a system we designed and implemented from the ground up. BotMaker provides a solid foundation for our principled defense against unsolicited content on Twitter.

Read more...

Pages