Architectural Support for Accelerating Machine Learning Inference