PinnedA P-O-X On Both Your Houses: Reverse Engineering a 20 year RF protocolIn 2001 Hasbro began a viral marketing campaign for their new game. They wanted to find a kid that saw themselves as “the coolest”.Jun 20, 2022A response icon6Jun 20, 2022A response icon6
Second Order Parallelism in Spark-based Data PipelinesBy leveraging secondary parallelism mechanisms other than Spark, data pipelines can become more performant, and efficient.May 24, 2021A response icon1May 24, 2021A response icon1
Published inThe Airbnb Tech BlogOn Spark, Hive, and Small Files: An In-Depth Look at Spark Partitioning StrategiesOne of the most common ways to store results from a Spark job is by writing the results to a Hive table stored on HDFS. While in theory…Mar 3, 2020A response icon3Mar 3, 2020A response icon3
Published inThe Airbnb Tech BlogScaling a Mature Data Pipeline — Managing OverheadThere is often a hidden performance cost tied to the complexity of data pipelines — Overhead. In this post we will examine the concept of…Sep 24, 2019A response icon2Sep 24, 2019A response icon2
Please Destroy My Face: Reverse Engineering Scorched Earth’s MTN File FormatHumble BeginningsFeb 2, 2019A response icon1Feb 2, 2019A response icon1
