Optimizing Analytics Data Processing on eBay’s New Open-Source-Based Platform
See how eBay adopted a five-level tuning strategy for an in-house analytics tool to exceed a legacy vendor’s performance.
Rongguan Fu is a software development manager who specializes in core and behavior foundation data management and data operations.
A database object used in a plurality of database operations is determined. A live range of the database object is computed. The computing of the live range includes determining occurrences of the database operations to the database object. Based at least in part on the live range of the database object, a memory is determined to be optimally assigned to store the database object based on at least one characteristic of the memory. A first time to allocate the database object to the memory is determined. A second time to deallocate the database object from the memory is determined. An output file comprising a first instruction to store the database object in the memory at the first time and a second instruction to deallocate the database object from the memory at the second time is written.