Amazon SageMaker AI Launches Real-Time Inference Endpoints Compatible with OpenAI API
Amazon SageMaker AI introduces new features supporting real-time inference endpoints compatible with OpenAI APIs. Users can call models via OpenAI SDK, LangChain, etc., by simply modifying the endpoint URL, without custom coding or rewriting. The new /openai/v1 path handles chat completion requests and returns responses, including streaming output, compatible with standard SageMaker AI APIs and SDKs.....