PinnedA P-O-X On Both Your Houses: Reverse Engineering a 20 year RF protocolIn 2001 Hasbro began a viral marketing campaign for their new game. They wanted to find a kid that saw themselves as “the coolest”.Jun 20, 20226Jun 20, 20226
Second Order Parallelism in Spark-based Data PipelinesBy leveraging secondary parallelism mechanisms other than Spark, data pipelines can become more performant, and efficient.May 24, 20211May 24, 20211
Published inThe Airbnb Tech BlogOn Spark, Hive, and Small Files: An In-Depth Look at Spark Partitioning StrategiesOne of the most common ways to store results from a Spark job is by writing the results to a Hive table stored on HDFS. While in theory…Mar 3, 20203Mar 3, 20203
Published inThe Airbnb Tech BlogScaling a Mature Data Pipeline — Managing OverheadThere is often a hidden performance cost tied to the complexity of data pipelines — Overhead. In this post we will examine the concept of…Sep 24, 20192Sep 24, 20192
Please Destroy My Face: Reverse Engineering Scorched Earth’s MTN File FormatHumble BeginningsFeb 2, 20191Feb 2, 20191
