Presentation
Geomancy: Automated Data Placement Optimization
Author
Event Type
ACM Student Research Competition
Poster
TP
EX
TimeTuesday, November 13th8:30am - 5pm
LocationC2/3/4 Ballroom
DescriptionExascale cloud storage and High-Performance Computing Systems (HPC) deliver unprecedented storage capacity and levels of computing power, though the full potential of these systems remain untapped because of inefficient data placement. Changes in data access patterns can cause a system's performance to suffer. To mitigate performance losses, system designers implement strategies to preemptively place popular data on higher performance nodes. However, these strategies fail to address a diverse userbase whose users individually demand the highest performance, and they must be carefully constructed by an expert of the system.
We propose Geomancy, a tool that reorganizes data to increase I/O throughput. In systems where heuristic-based improvements may become resource intensive, Geomancy determines new placement policies by training a deep neural network with past workload and system traces. With real workload traces, Geomancy calculated an example placement policy that demonstrated a 49% increase in average throughput compared to the default data layout.
We propose Geomancy, a tool that reorganizes data to increase I/O throughput. In systems where heuristic-based improvements may become resource intensive, Geomancy determines new placement policies by training a deep neural network with past workload and system traces. With real workload traces, Geomancy calculated an example placement policy that demonstrated a 49% increase in average throughput compared to the default data layout.
Archive