Publications

Jonatan Langlet, Ran Ben Basat, Gabriele Oliaro, Michael Mitzenmacher, Minlan Yu, Gianni Antichi (2023). Direct Telemetry Access. In SIGCOMM ‘23.

PDF Cite Code DOI

Gabriele Oliaro (2023). ExpertFlow: Enabling Low-Latency Asynchronous Inference for Mixture of Expert Models. Master Thesis.

PDF Cite Code

Gabriele Oliaro, Xupeng Miao, Zhihao Zhang, Xinhao Cheng, Zeyu Wang, Rae Ying Yee Wong, Alan Zhu, Lijie Yang, Xiaoxiang Shi, Chunan Shi, Zhuoming Chen, Daiyaan Arfeen, Reyna Abhyankar, Zhihao Jia (2023). SpecInfer: Accelerating Generative LLM Serving with Speculative Inference and Token Tree Verification. In ArXiv.

PDF Cite Code DOI

Jonatan Langlet, Ran Ben Basat, Sivaram Ramanathan, Gabriele Oliaro, Michael Mitzenmacher, Minlan Yu, Gianni Antichi (2021). Zero-CPU Collection with Direct Telemetry Access. In HotNets ‘21.

PDF Cite DOI