Affiliation:
1. University of Michigan, Ann Arbor, MI, USA
2. Federal University of Bahia, Bahia, Brazil
Abstract
As user demand scales for intelligent personal assistants (IPAs) such as Apple's Siri, Google's Google Now, and Microsoft's Cortana, we are approaching the computational limits of current datacenter architectures. It is an open question how future server architectures should evolve to enable this emerging class of applications, and the lack of an open-source IPA workload is an obstacle in addressing this question. In this paper, we present the design of Sirius, an open end-to-end IPA web-service application that accepts queries in the form of voice and images, and responds with natural language. We then use this workload to investigate the implications of four points in the design space of future accelerator-based server architectures spanning traditional CPUs, GPUs, manycore throughput co-processors, and FPGAs.
To investigate future server designs for Sirius, we decompose Sirius into a suite of 7 benchmarks (Sirius Suite) comprising the computationally intensive bottlenecks of Sirius. We port Sirius Suite to a spectrum of accelerator platforms and use the performance and power trade-offs across these platforms to perform a total cost of ownership (TCO) analysis of various server design points. In our study, we find that accelerators are critical for the future scalability of IPA services. Our results show that GPU- and FPGA-accelerated servers improve the query latency on average by 10x and 16x. For a given throughput, GPU- and FPGA-accelerated servers can reduce the TCO of datacenters by 2.6x and 1.4x, respectively.
Publisher
Association for Computing Machinery (ACM)
Subject
Computer Graphics and Computer-Aided Design,Software
Reference71 articles.
1. Apple's Siri. https://www.apple.com/ios/siri/. Apple's Siri. https://www.apple.com/ios/siri/.
2. Google's Google Now. http://www.google.com/landing/now/. Google's Google Now. http://www.google.com/landing/now/.
3. Microsoft's Cortana. http://www.windowsphone.com/en-us/features-8--1. Microsoft's Cortana. http://www.windowsphone.com/en-us/features-8--1.
4. Smartphone OS Market Share Q1 2014. http://www.idc.com/prodserv/smartphone-os-market-share.jsp. Smartphone OS Market Share Q1 2014. http://www.idc.com/prodserv/smartphone-os-market-share.jsp.
5. Google's Android Wear. www.android.com/wear/. Google's Android Wear. www.android.com/wear/.
Cited by
26 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献