Bloomberg’s Compute Architecture group is tasked with scaling data storage and compute services across clusters of machines, enabling developers to easily build distributed applications. By scaling data storage and compute services across clusters of machines, large volumes of data can be handled more efficiently, by truly distributed systems. The ongoing aim is to continually improve upon a foundation of computing that allows the deployment of tools to support smarter business and financial decisions by the company’s customers.
Our team leverages a wide variety of tools and technologies, including Apache Solr/Lucene, Apache Hadoop, Apache Kafka and many more. As we deploy these tools to address many of our unique use cases, we’ve found ways to improve them and have contributed those improvements to the community so that everyone can benefit as their own workloads change and grow.