Keyboard shortcuts

Press ← or → to navigate between chapters

Press ? to show this help

Press Esc to hide this help

모델별 인스턴스 처리량 한도

다음 표는 모델과 모델 제공 백엔드(Model backend)별 기본 처리량 한도입니다. 각 셀의 첫 값은 분당 토큰 수(TPM), 둘째 값은 분당 요청 수(RPM)입니다. 사용자별 한도와 인스턴스 등급의 한도를 구분합니다.

표를 적용하는 기준

  • 인스턴스의 실제 모델 용량은 해당 환경에서 활성화한 백엔드의 인스턴스 한도를 합산합니다.
  • 한 지역에 제한된 인스턴스는 어느 등급에서든 실제 한도가 더 낮을 수 있습니다.
  • 사용자별 한도는 별도의 기본값과 재정의 정책으로 관리합니다. 인스턴스 용량의 합산과 같은 방식으로 사용자 열을 단순 합산하지 않습니다.
  • 사용자 기본 한도가 인스턴스 등급의 한도보다 크더라도 실제 요청에는 인스턴스 전체 상한도 적용됩니다.
  • 실제 적용 값과 현재 등급은 Resource Management → AIP rate limits에서 확인합니다.

환경과 모델 상태

USG는 미국 정부 환경입니다. USG 행은 해당 모델과 백엔드가 지원하는 영향 수준(Impact level)에 적용하며, 상용 환경과 구분하여 읽습니다. IL2, IL4, IL5별로 한도가 다르면 별도 행으로 표시합니다.

Experimental은 해당 제공 경로에서 실험 단계인 모델입니다. 모델과 실험 기능의 활성화 등 사용 전제 조건을 충족해야 합니다. Preview 역시 모델 이름에 포함된 제공 상태 표시이며, 이름과 제공 백엔드를 함께 확인합니다.

처리량 한도를 적용하기 전에 모델 활성화와 지역 및 환경 제약을 확인합니다.

기본 한도

모델제공 백엔드사용자별SmallMediumLargeXLarge
Claude Haiku 4.5Anthropic1,000,000 TPM
100 RPM		300,000 TPM
60 RPM		1,500,000 TPM
750 RPM		2,000,000 TPM
875 RPM		2,500,000 TPM
1,000 RPM
Claude Haiku 4.5Amazon Bedrock1,000,000 TPM
100 RPM		200,000 TPM
40 RPM		1,100,000 TPM
300 RPM		2,600,000 TPM
600 RPM		5,100,000 TPM
1,100 RPM
Claude Haiku 4.5Azure1,000,000 TPM
100 RPM		250,000 TPM
50 RPM		5,000,000 TPM
5,000 RPM		7,500,000 TPM
7,500 RPM		10,000,000 TPM
10,000 RPM
Claude Haiku 4.5Google Vertex1,000,000 TPM
100 RPM		250,000 TPM
50 RPM		4,000,000 TPM
2,000 RPM		6,000,000 TPM
3,000 RPM		8,000,000 TPM
4,000 RPM
Claude Haiku 4.5Google Vertex (USG)1,000,000 TPM
100 RPM		100,000 TPM
50 RPM		4,000,000 TPM
2,000 RPM		6,000,000 TPM
3,000 RPM		8,000,000 TPM
4,000 RPM
Claude Haiku 5.5 (Experimental)Anthropic1,000,000 TPM
100 RPM		300,000 TPM
60 RPM		1,500,000 TPM
750 RPM		2,000,000 TPM
875 RPM		2,500,000 TPM
1,000 RPM
Claude Haiku 5.5 (Experimental)Amazon Bedrock1,000,000 TPM
100 RPM		200,000 TPM
40 RPM		1,100,000 TPM
300 RPM		2,600,000 TPM
600 RPM		5,100,000 TPM
1,100 RPM
Claude Haiku 5.5 (Experimental)Azure1,000,000 TPM
100 RPM		250,000 TPM
50 RPM		5,000,000 TPM
5,000 RPM		7,500,000 TPM
7,500 RPM		10,000,000 TPM
10,000 RPM
Claude Haiku 5.5 (Experimental)Google Vertex1,000,000 TPM
100 RPM		250,000 TPM
50 RPM		4,000,000 TPM
2,000 RPM		6,000,000 TPM
3,000 RPM		8,000,000 TPM
4,000 RPM
Claude Haiku 5.5 (Experimental)Google Vertex (USG)1,000,000 TPM
100 RPM		100,000 TPM
50 RPM		4,000,000 TPM
2,000 RPM		6,000,000 TPM
3,000 RPM		8,000,000 TPM
4,000 RPM
Claude Opus 4.1Amazon Bedrock400,000 TPM
5 RPM		70,000 TPM
14 RPM		500,000 TPM
100 RPM		1,000,000 TPM
150 RPM		2,000,000 TPM
200 RPM
Claude Opus 4.5Anthropic1,000,000 TPM
100 RPM		80,000 TPM
16 RPM		1,500,000 TPM
700 RPM		2,000,000 TPM
800 RPM		2,500,000 TPM
900 RPM
Claude Opus 4.5Amazon Bedrock1,000,000 TPM
100 RPM		50,000 TPM
10 RPM		1,000,000 TPM
100 RPM		2,000,000 TPM
200 RPM		4,000,000 TPM
400 RPM
Claude Opus 4.5Azure1,000,000 TPM
100 RPM		60,000 TPM
12 RPM		1,500,000 TPM
600 RPM		2,500,000 TPM
700 RPM		3,500,000 TPM
800 RPM
Claude Opus 4.5Google Vertex1,000,000 TPM
100 RPM		60,000 TPM
12 RPM		1,000,000 TPM
100 RPM		1,500,000 TPM
150 RPM		2,000,000 TPM
200 RPM
Claude Opus 4.5Google Vertex (USG)1,000,000 TPM
100 RPM		100,000 TPM
25 RPM		1,000,000 TPM
100 RPM		1,500,000 TPM
150 RPM		2,000,000 TPM
200 RPM
Claude Opus 4.6Anthropic1,500,000 TPM
150 RPM		80,000 TPM
16 RPM		1,000,000 TPM
200 RPM		1,500,000 TPM
300 RPM		2,000,000 TPM
400 RPM
Claude Opus 4.6Amazon Bedrock1,500,000 TPM
150 RPM		50,000 TPM
10 RPM		3,000,000 TPM
300 RPM		4,000,000 TPM
400 RPM		6,000,000 TPM
600 RPM
Claude Opus 4.6Azure1,500,000 TPM
150 RPM		60,000 TPM
12 RPM		1,500,000 TPM
600 RPM		2,500,000 TPM
700 RPM		3,500,000 TPM
800 RPM
Claude Opus 4.6Google Vertex1,500,000 TPM
150 RPM		60,000 TPM
12 RPM		5,000,000 TPM
2,000 RPM		8,000,000 TPM
3,000 RPM		10,000,000 TPM
4,000 RPM
Claude Opus 4.6Google Vertex (USG)1,500,000 TPM
150 RPM		200,000 TPM
25 RPM		5,000,000 TPM
2,000 RPM		8,000,000 TPM
3,000 RPM		10,000,000 TPM
4,000 RPM
Claude Opus 4.7Anthropic1,500,000 TPM
150 RPM		80,000 TPM
16 RPM		1,000,000 TPM
200 RPM		1,500,000 TPM
300 RPM		2,000,000 TPM
400 RPM
Claude Opus 4.7Amazon Bedrock1,500,000 TPM
150 RPM		50,000 TPM
10 RPM		3,000,000 TPM
300 RPM		4,000,000 TPM
400 RPM		6,000,000 TPM
600 RPM
Claude Opus 4.7Azure1,500,000 TPM
150 RPM		60,000 TPM
12 RPM		1,000,000 TPM
100 RPM		2,000,000 TPM
200 RPM		3,000,000 TPM
300 RPM
Claude Opus 4.7Google Vertex1,500,000 TPM
150 RPM		60,000 TPM
12 RPM		5,000,000 TPM
2,000 RPM		8,000,000 TPM
3,000 RPM		10,000,000 TPM
4,000 RPM
Claude Opus 4.7Google Vertex (USG)1,500,000 TPM
150 RPM		200,000 TPM
25 RPM		5,000,000 TPM
2,000 RPM		8,000,000 TPM
3,000 RPM		10,000,000 TPM
4,000 RPM
Claude Opus 4.8Anthropic1,500,000 TPM
150 RPM		80,000 TPM
16 RPM		1,000,000 TPM
200 RPM		1,500,000 TPM
300 RPM		2,000,000 TPM
400 RPM
Claude Opus 4.8Amazon Bedrock1,500,000 TPM
150 RPM		50,000 TPM
10 RPM		3,000,000 TPM
300 RPM		4,000,000 TPM
400 RPM		6,000,000 TPM
600 RPM
Claude Opus 4.8Amazon Bedrock (USG)1,500,000 TPM
150 RPM		100,000 TPM
25 RPM		2,500,000 TPM
1,250 RPM		5,000,000 TPM
2,500 RPM		7,500,000 TPM
3,750 RPM
Claude Opus 4.8Azure1,500,000 TPM
150 RPM		60,000 TPM
12 RPM		1,000,000 TPM
100 RPM		2,000,000 TPM
200 RPM		3,000,000 TPM
300 RPM
Claude Opus 4.8Google Vertex1,500,000 TPM
150 RPM		60,000 TPM
12 RPM		5,000,000 TPM
2,000 RPM		8,000,000 TPM
3,000 RPM		10,000,000 TPM
4,000 RPM
Claude Opus 4.8Google Vertex (USG)1,500,000 TPM
150 RPM		200,000 TPM
25 RPM		5,000,000 TPM
2,000 RPM		8,000,000 TPM
3,000 RPM		10,000,000 TPM
4,000 RPM
Claude Opus 5Anthropic1,500,000 TPM
150 RPM		300,000 TPM
60 RPM		1,000,000 TPM
200 RPM		1,500,000 TPM
300 RPM		2,000,000 TPM
400 RPM
Claude Opus 5Amazon Bedrock1,500,000 TPM
150 RPM		200,000 TPM
40 RPM		3,000,000 TPM
300 RPM		4,000,000 TPM
400 RPM		6,000,000 TPM
600 RPM
Claude Opus 5Azure1,500,000 TPM
150 RPM		250,000 TPM
50 RPM		1,000,000 TPM
100 RPM		2,000,000 TPM
200 RPM		3,000,000 TPM
300 RPM
Claude Opus 5Google Vertex1,500,000 TPM
150 RPM		250,000 TPM
50 RPM		5,000,000 TPM
2,000 RPM		8,000,000 TPM
3,000 RPM		10,000,000 TPM
4,000 RPM
Claude Opus 5Google Vertex (USG)1,500,000 TPM
150 RPM		200,000 TPM
25 RPM		5,000,000 TPM
2,000 RPM		8,000,000 TPM
3,000 RPM		10,000,000 TPM
4,000 RPM
Claude Opus 5Amazon Bedrock (USG)1,500,000 TPM
150 RPM		100,000 TPM
25 RPM		2,500,000 TPM
1,250 RPM		5,000,000 TPM
2,500 RPM		7,500,000 TPM
3,750 RPM
Claude Opus 5.5Amazon Bedrock1,500,000 TPM
150 RPM		200,000 TPM
40 RPM		3,000,000 TPM
300 RPM		4,000,000 TPM
400 RPM		6,000,000 TPM
600 RPM
Claude Opus 5.5Anthropic1,500,000 TPM
150 RPM		300,000 TPM
60 RPM		1,000,000 TPM
200 RPM		1,500,000 TPM
300 RPM		2,000,000 TPM
400 RPM
Claude Opus 5.5Azure1,500,000 TPM
150 RPM		250,000 TPM
50 RPM		1,000,000 TPM
100 RPM		2,000,000 TPM
200 RPM		3,000,000 TPM
300 RPM
Claude Opus 5.5Google Vertex1,500,000 TPM
150 RPM		250,000 TPM
50 RPM		5,000,000 TPM
2,000 RPM		8,000,000 TPM
3,000 RPM		10,000,000 TPM
4,000 RPM
Claude Opus 5.5Google Vertex (USG)1,500,000 TPM
150 RPM		200,000 TPM
25 RPM		5,000,000 TPM
2,000 RPM		8,000,000 TPM
3,000 RPM		10,000,000 TPM
4,000 RPM
Claude Opus 5.5Amazon Bedrock (USG)1,500,000 TPM
150 RPM		100,000 TPM
25 RPM		2,500,000 TPM
1,250 RPM		5,000,000 TPM
2,500 RPM		7,500,000 TPM
3,750 RPM
Claude Sonnet 4Google Vertex (USG)400,000 TPM
25 RPM		100,000 TPM
25 RPM		250,000 TPM
50 RPM		375,000 TPM
75 RPM		500,000 TPM
100 RPM
Claude Sonnet 4.5Anthropic1,000,000 TPM
100 RPM		80,000 TPM
16 RPM		1,500,000 TPM
700 RPM		2,000,000 TPM
800 RPM		2,500,000 TPM
900 RPM
Claude Sonnet 4.5Amazon Bedrock1,000,000 TPM
100 RPM		50,000 TPM
10 RPM		1,100,000 TPM
300 RPM		4,100,000 TPM
600 RPM		8,100,000 TPM
1,100 RPM
Claude Sonnet 4.5Amazon Bedrock (USG)1,000,000 TPM
100 RPM		100,000 TPM
25 RPM		5,000,000 TPM
2,500 RPM		7,500,000 TPM
3,750 RPM		10,000,000 TPM
5,000 RPM
Claude Sonnet 4.5Azure1,000,000 TPM
100 RPM		60,000 TPM
12 RPM		1,500,000 TPM
600 RPM		2,500,000 TPM
700 RPM		3,500,000 TPM
800 RPM
Claude Sonnet 4.5Google Vertex1,000,000 TPM
100 RPM		60,000 TPM
12 RPM		1,000,000 TPM
500 RPM		1,500,000 TPM
750 RPM		2,000,000 TPM
1,000 RPM
Claude Sonnet 4.5Google Vertex (USG)1,000,000 TPM
100 RPM		100,000 TPM
25 RPM		500,000 TPM
500 RPM		750,000 TPM
750 RPM		1,000,000 TPM
1,000 RPM
Claude Sonnet 4.6Anthropic1,000,000 TPM
100 RPM		80,000 TPM
16 RPM		1,500,000 TPM
700 RPM		2,000,000 TPM
800 RPM		2,500,000 TPM
900 RPM
Claude Sonnet 4.6Amazon Bedrock1,000,000 TPM
100 RPM		50,000 TPM
10 RPM		3,000,000 TPM
750 RPM		6,000,000 TPM
1,500 RPM		9,000,000 TPM
2,250 RPM
Claude Sonnet 4.6Azure1,000,000 TPM
100 RPM		60,000 TPM
12 RPM		1,500,000 TPM
600 RPM		2,500,000 TPM
700 RPM		3,500,000 TPM
800 RPM
Claude Sonnet 4.6Google Vertex1,000,000 TPM
100 RPM		60,000 TPM
12 RPM		4,000,000 TPM
2,000 RPM		6,000,000 TPM
3,000 RPM		8,000,000 TPM
4,000 RPM
Claude Sonnet 4.6Google Vertex (USG)1,000,000 TPM
100 RPM		100,000 TPM
25 RPM		4,000,000 TPM
2,000 RPM		6,000,000 TPM
3,000 RPM		8,000,000 TPM
4,000 RPM
Claude Sonnet 5Anthropic1,000,000 TPM
100 RPM		300,000 TPM
60 RPM		1,500,000 TPM
700 RPM		2,000,000 TPM
800 RPM		2,500,000 TPM
900 RPM
Claude Sonnet 5Amazon Bedrock1,000,000 TPM
100 RPM		200,000 TPM
40 RPM		3,000,000 TPM
750 RPM		6,000,000 TPM
1,500 RPM		9,000,000 TPM
2,250 RPM
Claude Sonnet 5Amazon Bedrock (USG)1,000,000 TPM
100 RPM		100,000 TPM
25 RPM		1,000,000 TPM
500 RPM		2,000,000 TPM
1,000 RPM		3,000,000 TPM
1,500 RPM
Claude Sonnet 5Azure1,000,000 TPM
100 RPM		250,000 TPM
50 RPM		2,500,000 TPM
1,250 RPM		5,000,000 TPM
2,500 RPM		7,500,000 TPM
3,750 RPM
Claude Sonnet 5Google Vertex1,000,000 TPM
100 RPM		250,000 TPM
50 RPM		4,000,000 TPM
2,000 RPM		6,000,000 TPM
3,000 RPM		8,000,000 TPM
4,000 RPM
Claude Sonnet 5Google Vertex (USG)1,000,000 TPM
100 RPM		200,000 TPM
25 RPM		4,000,000 TPM
2,000 RPM		6,000,000 TPM
3,000 RPM		8,000,000 TPM
4,000 RPM
Claude Sonnet 5.5 (Experimental)Anthropic1,000,000 TPM
100 RPM		300,000 TPM
60 RPM		1,500,000 TPM
700 RPM		2,000,000 TPM
800 RPM		2,500,000 TPM
900 RPM
Claude Sonnet 5.5 (Experimental)Amazon Bedrock1,000,000 TPM
100 RPM		200,000 TPM
40 RPM		3,000,000 TPM
750 RPM		6,000,000 TPM
1,500 RPM		9,000,000 TPM
2,250 RPM
Claude Sonnet 5.5 (Experimental)Amazon Bedrock (USG)1,000,000 TPM
100 RPM		100,000 TPM
25 RPM		2,500,000 TPM
1,250 RPM		5,000,000 TPM
2,500 RPM		7,500,000 TPM
3,750 RPM
Claude Sonnet 5.5 (Experimental)Azure1,000,000 TPM
100 RPM		250,000 TPM
50 RPM		2,500,000 TPM
1,250 RPM		5,000,000 TPM
2,500 RPM		7,500,000 TPM
3,750 RPM
Claude Sonnet 5.5 (Experimental)Google Vertex1,000,000 TPM
100 RPM		250,000 TPM
50 RPM		4,000,000 TPM
2,000 RPM		6,000,000 TPM
3,000 RPM		8,000,000 TPM
4,000 RPM
Claude Sonnet 5.5 (Experimental)Google Vertex (USG)1,000,000 TPM
100 RPM		200,000 TPM
25 RPM		4,000,000 TPM
2,000 RPM		6,000,000 TPM
3,000 RPM		8,000,000 TPM
4,000 RPM
Gemini 3 Flash (Preview)Google Vertex2,000,000 TPM
400 RPM		250,000 TPM
50 RPM		6,500,000 TPM
1,400 RPM		9,500,000 TPM
2,300 RPM		12,500,000 TPM
3,500 RPM
Gemini 3 Flash (Preview)Google Vertex (USG)2,000,000 TPM
400 RPM		100,000 TPM
25 RPM		1,000,000 TPM
300 RPM		1,500,000 TPM
600 RPM		2,000,000 TPM
1,000 RPM
Gemini 3.1 Flash-LiteGoogle Vertex2,000,000 TPM
400 RPM		250,000 TPM
50 RPM		6,500,000 TPM
1,400 RPM		9,500,000 TPM
2,300 RPM		12,500,000 TPM
3,500 RPM
Gemini 3.1 Flash-LiteGoogle Vertex (USG)2,000,000 TPM
400 RPM		100,000 TPM
100 RPM		6,000,000 TPM
900 RPM		9,000,000 TPM
1,800 RPM		12,000,000 TPM
3,000 RPM
Gemini 3.1 Pro (Preview)Google Vertex2,000,000 TPM
400 RPM		1,000,000 TPM
200 RPM		7,000,000 TPM
1,500 RPM		10,000,000 TPM
2,250 RPM		15,000,000 TPM
3,750 RPM
Gemini 3.1 Pro (Preview)Google Vertex (USG)2,000,000 TPM
400 RPM		1,000,000 TPM
600 RPM		7,000,000 TPM
1,500 RPM		10,000,000 TPM
2,250 RPM		15,000,000 TPM
3,750 RPM
Gemini 3.5 FlashGoogle Vertex2,000,000 TPM
400 RPM		250,000 TPM
50 RPM		6,500,000 TPM
1,400 RPM		9,500,000 TPM
2,300 RPM		12,500,000 TPM
3,500 RPM
Gemini 3.5 FlashGoogle Vertex (USG)2,000,000 TPM
400 RPM		1,000,000 TPM
200 RPM		12,000,000 TPM
1,800 RPM		18,000,000 TPM
3,600 RPM		24,000,000 TPM
6,000 RPM
Gemini 3.5 Flash-LiteGoogle Vertex2,000,000 TPM
400 RPM		1,000,000 TPM
200 RPM		12,000,000 TPM
6,000 RPM		18,000,000 TPM
9,000 RPM		30,000,000 TPM
15,000 RPM
Gemini 3.5 Flash-LiteGoogle Vertex (USG)2,000,000 TPM
400 RPM		1,000,000 TPM
600 RPM		12,000,000 TPM
6,000 RPM		18,000,000 TPM
9,000 RPM		30,000,000 TPM
15,000 RPM
Gemini 3.6 FlashGoogle Vertex2,000,000 TPM
400 RPM		250,000 TPM
50 RPM		12,000,000 TPM
3,000 RPM		18,000,000 TPM
4,500 RPM		24,000,000 TPM
7,500 RPM
Gemini 3.6 FlashGoogle Vertex (USG IL2 / IL4)2,000,000 TPM
400 RPM		1,000,000 TPM
200 RPM		12,000,000 TPM
3,000 RPM		18,000,000 TPM
4,500 RPM		24,000,000 TPM
7,500 RPM
Gemini 3.6 FlashGoogle Vertex (USG IL5)2,000,000 TPM
400 RPM		1,000,000 TPM
600 RPM		7,000,000 TPM
3,000 RPM		10,000,000 TPM
4,500 RPM		15,000,000 TPM
7,500 RPM
Gemini 3.7 FlashGoogle Vertex2,000,000 TPM
400 RPM		1,000,000 TPM
200 RPM		12,000,000 TPM
6,000 RPM		18,000,000 TPM
9,000 RPM		30,000,000 TPM
15,000 RPM
Gemini 3.7 FlashGoogle Vertex (USG)2,000,000 TPM
400 RPM		1,000,000 TPM
200 RPM		12,000,000 TPM
6,000 RPM		18,000,000 TPM
9,000 RPM		30,000,000 TPM
15,000 RPM
Llama 3.1 8b InstructAmazon Bedrock50,000 TPM
100 RPM		150,000 TPM
30 RPM		300,000 TPM
450 RPM		450,000 TPM
675 RPM		600,000 TPM
900 RPM
Llama 3.1 8b InstructPalantir 호스팅50,000 TPM
100 RPM		100,000 TPM
20 RPM		300,000 TPM
450 RPM		450,000 TPM
675 RPM		600,000 TPM
900 RPM
Llama 3.3 70b InstructAmazon Bedrock50,000 TPM
100 RPM		150,000 TPM
30 RPM		300,000 TPM
450 RPM		450,000 TPM
675 RPM		600,000 TPM
900 RPM
Llama 3.3 70b InstructPalantir 호스팅50,000 TPM
100 RPM		100,000 TPM
20 RPM		300,000 TPM
450 RPM		450,000 TPM
675 RPM		600,000 TPM
900 RPM
Llama 4 Maverick 17b 128E InstructAmazon Bedrock100,000 TPM
100 RPM		250,000 TPM
50 RPM		1,000,000 TPM
500 RPM		2,000,000 TPM
1,000 RPM		4,000,000 TPM
2,000 RPM
Llama 4 Scout 17b 16E InstructAmazon Bedrock100,000 TPM
100 RPM		150,000 TPM
30 RPM		1,000,000 TPM
500 RPM		2,000,000 TPM
1,000 RPM		4,000,000 TPM
2,000 RPM
Llama 4 Scout 17b 16E InstructPalantir 호스팅100,000 TPM
100 RPM		100,000 TPM
20 RPM		300,000 TPM
450 RPM		450,000 TPM
675 RPM		600,000 TPM
900 RPM
Llama 3.2 NV EmbedQA 1B v2Palantir 호스팅50,000 TPM
100 RPM		60,000 TPM
150 RPM		300,000 TPM
450 RPM		450,000 TPM
675 RPM		600,000 TPM
900 RPM
Llama 3.3 Nemotron Super 49b v1.5Palantir 호스팅50,000 TPM
100 RPM		100,000 TPM
25 RPM		300,000 TPM
450 RPM		450,000 TPM
675 RPM		600,000 TPM
900 RPM
NVIDIA Nemotron 3 Nano 30BAmazon Bedrock50,000 TPM
100 RPM		1,000,000 TPM
200 RPM		5,000,000 TPM
500 RPM		10,000,000 TPM
1,000 RPM		20,000,000 TPM
2,000 RPM
NVIDIA Nemotron 3 Super 120BAmazon Bedrock1,000,000 TPM
100 RPM		1,000,000 TPM
200 RPM		5,000,000 TPM
500 RPM		10,000,000 TPM
1,000 RPM		20,000,000 TPM
2,000 RPM
GPT-4.1Azure400,000 TPM
1,000 RPM		100,000 TPM
20 RPM		2,000,000 TPM
1,500 RPM		3,500,000 TPM
2,500 RPM		5,500,000 TPM
4,500 RPM
GPT-4.1Azure (USG)400,000 TPM
1,000 RPM		100,000 TPM
25 RPM		2,000,000 TPM
2,000 RPM		4,000,000 TPM
4,000 RPM		6,000,000 TPM
6,000 RPM
GPT-4.1OpenAI400,000 TPM
1,000 RPM		150,000 TPM
30 RPM		2,000,000 TPM
1,500 RPM		3,500,000 TPM
2,500 RPM		5,500,000 TPM
4,500 RPM
GPT-4.1 miniAzure1,000,000 TPM
1,000 RPM		100,000 TPM
20 RPM		15,000,000 TPM
7,500 RPM		35,000,000 TPM
12,500 RPM		55,000,000 TPM
17,500 RPM
GPT-4.1 miniAzure (USG)1,000,000 TPM
1,000 RPM		100,000 TPM
100 RPM		2,000,000 TPM
2,000 RPM		3,000,000 TPM
3,000 RPM		4,000,000 TPM
4,000 RPM
GPT-4.1 miniOpenAI1,000,000 TPM
1,000 RPM		150,000 TPM
30 RPM		3,000,000 TPM
2,000 RPM		4,000,000 TPM
3,000 RPM		6,000,000 TPM
5,000 RPM
GPT-4.1 nanoAzure1,000,000 TPM
1,000 RPM		100,000 TPM
20 RPM		15,000,000 TPM
7,500 RPM		35,000,000 TPM
12,500 RPM		55,000,000 TPM
17,500 RPM
GPT-4oAzure400,000 TPM
800 RPM		100,000 TPM
20 RPM		1,000,000 TPM
1,000 RPM		1,500,000 TPM
2,000 RPM		3,000,000 TPM
4,000 RPM
GPT-4oAzure (USG)400,000 TPM
800 RPM		100,000 TPM
25 RPM		1,000,000 TPM
1,000 RPM		1,500,000 TPM
2,000 RPM		3,000,000 TPM
4,000 RPM
GPT-4oOpenAI400,000 TPM
800 RPM		150,000 TPM
30 RPM		1,000,000 TPM
1,000 RPM		1,500,000 TPM
2,000 RPM		3,000,000 TPM
4,000 RPM
GPT-5Azure1,000,000 TPM
1,000 RPM		100,000 TPM
20 RPM		3,500,000 TPM
1,500 RPM		5,500,000 TPM
3,000 RPM		10,500,000 TPM
5,500 RPM
GPT-5 CodexAzure1,000,000 TPM
1,000 RPM		100,000 TPM
25 RPM		2,000,000 TPM
1,000 RPM		3,000,000 TPM
2,000 RPM		5,000,000 TPM
4,000 RPM
GPT-5 miniAzure1,000,000 TPM
1,000 RPM		100,000 TPM
20 RPM		10,500,000 TPM
5,500 RPM		20,500,000 TPM
10,500 RPM		30,500,000 TPM
15,500 RPM
GPT-5 nanoAzure1,000,000 TPM
1,000 RPM		100,000 TPM
20 RPM		11,000,000 TPM
6,000 RPM		31,000,000 TPM
16,000 RPM		51,000,000 TPM
26,000 RPM
GPT-5.1Azure1,000,000 TPM
2,000 RPM		100,000 TPM
20 RPM		2,000,000 TPM
500 RPM		4,000,000 TPM
1,000 RPM		6,000,000 TPM
2,000 RPM
GPT-5.1Azure (USG)1,000,000 TPM
2,000 RPM		100,000 TPM
25 RPM		3,000,000 TPM
3,000 RPM		5,250,000 TPM
5,250 RPM		7,500,000 TPM
7,500 RPM
GPT-5.1OpenAI1,000,000 TPM
2,000 RPM		150,000 TPM
30 RPM		1,500,000 TPM
1,000 RPM		3,000,000 TPM
2,000 RPM		5,000,000 TPM
4,000 RPM
GPT-5.1 CodexAzure1,000,000 TPM
1,000 RPM		100,000 TPM
25 RPM		2,000,000 TPM
1,000 RPM		3,000,000 TPM
2,000 RPM		4,000,000 TPM
4,000 RPM
GPT-5.1 Codex miniAzure1,000,000 TPM
500 RPM		100,000 TPM
100 RPM		2,000,000 TPM
1,000 RPM		3,000,000 TPM
2,000 RPM		5,000,000 TPM
4,000 RPM
GPT-5.2Azure500,000 TPM
1,000 RPM		100,000 TPM
20 RPM		2,000,000 TPM
500 RPM		4,000,000 TPM
1,000 RPM		6,000,000 TPM
2,000 RPM
GPT-5.2OpenAI500,000 TPM
1,000 RPM		150,000 TPM
30 RPM		3,000,000 TPM
1,500 RPM		6,000,000 TPM
3,000 RPM		10,000,000 TPM
5,000 RPM
GPT-5.2 ProOpenAI400,000 TPM
1,000 RPM		250,000 TPM
50 RPM		1,500,000 TPM
1,000 RPM		3,000,000 TPM
2,000 RPM		5,000,000 TPM
4,000 RPM
GPT-5.3 CodexAzure1,000,000 TPM
1,000 RPM		100,000 TPM
100 RPM		4,000,000 TPM
2,000 RPM		6,000,000 TPM
4,000 RPM		8,000,000 TPM
8,000 RPM
GPT-5.3 CodexOpenAI1,000,000 TPM
1,000 RPM		100,000 TPM
25 RPM		3,000,000 TPM
1,000 RPM		4,000,000 TPM
2,000 RPM		5,000,000 TPM
4,000 RPM
GPT-5.4Azure1,000,000 TPM
1,000 RPM		100,000 TPM
20 RPM		4,000,000 TPM
2,000 RPM		6,000,000 TPM
3,000 RPM		8,000,000 TPM
4,000 RPM
GPT-5.4OpenAI1,000,000 TPM
1,000 RPM		150,000 TPM
30 RPM		3,000,000 TPM
1,500 RPM		6,000,000 TPM
3,000 RPM		10,000,000 TPM
5,000 RPM
GPT-5.4Amazon Bedrock1,000,000 TPM
1,000 RPM		100,000 TPM
50 RPM		250,000 TPM
60 RPM		500,000 TPM
125 RPM		1,000,000 TPM
250 RPM
GPT-5.4Amazon Bedrock (USG)1,000,000 TPM
1,000 RPM		100,000 TPM
50 RPM		250,000 TPM
60 RPM		500,000 TPM
125 RPM		1,000,000 TPM
250 RPM
GPT-5.4 ProOpenAI400,000 TPM
1,000 RPM		250,000 TPM
50 RPM		1,500,000 TPM
1,000 RPM		3,000,000 TPM
2,000 RPM		5,000,000 TPM
4,000 RPM
GPT-5.4 miniAzure1,000,000 TPM
1,000 RPM		100,000 TPM
20 RPM		4,500,000 TPM
2,250 RPM		9,000,000 TPM
4,500 RPM		15,000,000 TPM
7,500 RPM
GPT-5.4 miniOpenAI1,000,000 TPM
1,000 RPM		150,000 TPM
30 RPM		3,000,000 TPM
1,500 RPM		6,000,000 TPM
3,000 RPM		10,000,000 TPM
5,000 RPM
GPT-5.4 nanoAzure1,000,000 TPM
1,000 RPM		100,000 TPM
20 RPM		4,500,000 TPM
2,250 RPM		9,000,000 TPM
4,500 RPM		15,000,000 TPM
7,500 RPM
GPT-5.4 nanoOpenAI1,000,000 TPM
1,000 RPM		150,000 TPM
30 RPM		3,000,000 TPM
1,500 RPM		6,000,000 TPM
3,000 RPM		10,000,000 TPM
5,000 RPM
GPT-5.5Azure1,000,000 TPM
1,000 RPM		100,000 TPM
20 RPM		4,000,000 TPM
2,000 RPM		6,000,000 TPM
3,000 RPM		8,000,000 TPM
4,000 RPM
GPT-5.5OpenAI1,000,000 TPM
1,000 RPM		150,000 TPM
30 RPM		3,000,000 TPM
1,500 RPM		6,000,000 TPM
3,000 RPM		10,000,000 TPM
5,000 RPM
GPT-5.5Amazon Bedrock1,000,000 TPM
1,000 RPM		100,000 TPM
50 RPM		250,000 TPM
60 RPM		500,000 TPM
125 RPM		1,000,000 TPM
250 RPM
GPT-5.6 LunaAzure5,000,000 TPM
2,500 RPM		1,000,000 TPM
200 RPM		10,000,000 TPM
5,000 RPM		20,000,000 TPM
10,000 RPM		30,000,000 TPM
15,000 RPM
GPT-5.6 LunaOpenAI5,000,000 TPM
2,500 RPM		3,000,000 TPM
600 RPM		20,000,000 TPM
10,000 RPM		40,000,000 TPM
20,000 RPM		60,000,000 TPM
30,000 RPM
GPT-5.6 LunaAmazon Bedrock5,000,000 TPM
2,500 RPM		250,000 TPM
50 RPM		500,000 TPM
125 RPM		1,000,000 TPM
250 RPM		2,000,000 TPM
500 RPM
GPT-5.6 LunaAmazon Bedrock (USG)5,000,000 TPM
2,500 RPM		100,000 TPM
50 RPM		1,000,000 TPM
250 RPM		2,000,000 TPM
500 RPM		4,000,000 TPM
1,000 RPM
GPT-5.6 LunaAzure (USG)5,000,000 TPM
2,500 RPM		250,000 TPM
125 RPM		15,000,000 TPM
7,500 RPM		30,000,000 TPM
15,000 RPM		40,000,000 TPM
20,000 RPM
GPT-5.6 SolAzure5,000,000 TPM
2,500 RPM		1,000,000 TPM
200 RPM		9,000,000 TPM
4,500 RPM		10,000,000 TPM
5,000 RPM		15,000,000 TPM
7,500 RPM
GPT-5.6 SolOpenAI5,000,000 TPM
2,500 RPM		3,000,000 TPM
600 RPM		20,000,000 TPM
10,000 RPM		40,000,000 TPM
20,000 RPM		60,000,000 TPM
30,000 RPM
GPT-5.6 SolAzure (USG)5,000,000 TPM
2,500 RPM		250,000 TPM
125 RPM		10,000,000 TPM
5,000 RPM		20,000,000 TPM
10,000 RPM		40,000,000 TPM
20,000 RPM
GPT-5.6 TerraAzure5,000,000 TPM
2,500 RPM		1,000,000 TPM
200 RPM		10,000,000 TPM
5,000 RPM		20,000,000 TPM
10,000 RPM		30,000,000 TPM
15,000 RPM
GPT-5.6 TerraOpenAI5,000,000 TPM
2,500 RPM		3,000,000 TPM
600 RPM		30,000,000 TPM
15,000 RPM		50,000,000 TPM
25,000 RPM		70,000,000 TPM
35,000 RPM
GPT-5.6 TerraAmazon Bedrock5,000,000 TPM
2,500 RPM		250,000 TPM
50 RPM		500,000 TPM
125 RPM		1,000,000 TPM
250 RPM		2,000,000 TPM
500 RPM
GPT-5.6 TerraAmazon Bedrock (USG)5,000,000 TPM
2,500 RPM		100,000 TPM
50 RPM		1,000,000 TPM
250 RPM		2,000,000 TPM
500 RPM		4,000,000 TPM
1,000 RPM
GPT-5.6 TerraAzure (USG)5,000,000 TPM
2,500 RPM		250,000 TPM
125 RPM		15,000,000 TPM
7,500 RPM		30,000,000 TPM
15,000 RPM		40,000,000 TPM
20,000 RPM
GPT-6 AstraAmazon Bedrock2,000,000 TPM
100 RPM		250,000 TPM
50 RPM		300,000 TPM
60 RPM		500,000 TPM
125 RPM		1,000,000 TPM
250 RPM
GPT-6 AstraOpenAI2,000,000 TPM
100 RPM		250,000 TPM
50 RPM		20,000,000 TPM
10,000 RPM		40,000,000 TPM
20,000 RPM		60,000,000 TPM
30,000 RPM
GPT-6 AstraAzure2,000,000 TPM
100 RPM		1,000,000 TPM
200 RPM		9,000,000 TPM
4,500 RPM		10,000,000 TPM
5,000 RPM		15,000,000 TPM
7,500 RPM
GPT-6 LunaOpenAI5,000,000 TPM
2,500 RPM		3,000,000 TPM
600 RPM		30,000,000 TPM
15,000 RPM		50,000,000 TPM
25,000 RPM		70,000,000 TPM
35,000 RPM
GPT-6 LunaAmazon Bedrock5,000,000 TPM
2,500 RPM		250,000 TPM
50 RPM		500,000 TPM
125 RPM		1,000,000 TPM
250 RPM		2,000,000 TPM
500 RPM
GPT-6 LunaAzure5,000,000 TPM
2,500 RPM		1,000,000 TPM
200 RPM		10,000,000 TPM
5,000 RPM		20,000,000 TPM
10,000 RPM		30,000,000 TPM
15,000 RPM
GPT-6 SolOpenAI5,000,000 TPM
2,500 RPM		3,000,000 TPM
600 RPM		30,000,000 TPM
15,000 RPM		50,000,000 TPM
25,000 RPM		70,000,000 TPM
35,000 RPM
GPT-6 SolAmazon Bedrock5,000,000 TPM
2,500 RPM		250,000 TPM
50 RPM		300,000 TPM
60 RPM		500,000 TPM
125 RPM		1,000,000 TPM
250 RPM
GPT-6 SolAzure5,000,000 TPM
2,500 RPM		1,000,000 TPM
200 RPM		9,000,000 TPM
4,500 RPM		10,000,000 TPM
5,000 RPM		15,000,000 TPM
7,500 RPM
GPT-6.1 Sol (Experimental)OpenAI5,000,000 TPM
2,500 RPM		3,000,000 TPM
600 RPM		30,000,000 TPM
15,000 RPM		50,000,000 TPM
25,000 RPM		70,000,000 TPM
35,000 RPM
GPT-6.1 Sol (Experimental)Amazon Bedrock5,000,000 TPM
2,500 RPM		250,000 TPM
50 RPM		300,000 TPM
60 RPM		500,000 TPM
125 RPM		1,000,000 TPM
250 RPM
GPT-6.1 Sol (Experimental)Azure5,000,000 TPM
2,500 RPM		1,000,000 TPM
200 RPM		9,000,000 TPM
4,500 RPM		10,000,000 TPM
5,000 RPM		15,000,000 TPM
7,500 RPM
GPT-OSS-120BPalantir 호스팅50,000 TPM
100 RPM		100,000 TPM
25 RPM		300,000 TPM
450 RPM		450,000 TPM
675 RPM		600,000 TPM
900 RPM
GPT-OSS-20BPalantir 호스팅50,000 TPM
100 RPM		100,000 TPM
100 RPM		300,000 TPM
450 RPM		450,000 TPM
675 RPM		600,000 TPM
900 RPM
Text Embedding 3 LargeAzure1,000,000 TPM
1,500 RPM		1,060,000 TPM
1,400 RPM		2,250,000 TPM
3,500 RPM		3,500,000 TPM
4,750 RPM		4,750,000 TPM
8,500 RPM
Text Embedding 3 LargeAzure (USG)1,000,000 TPM
1,500 RPM		60,000 TPM
400 RPM		1,000,000 TPM
2,000 RPM		2,000,000 TPM
3,000 RPM		3,000,000 TPM
6,000 RPM
Text Embedding 3 LargeOpenAI1,000,000 TPM
1,500 RPM		60,000 TPM
400 RPM		1,250,000 TPM
2,500 RPM		2,500,000 TPM
3,750 RPM		3,750,000 TPM
7,500 RPM
Text Embedding 3 SmallAzure1,000,000 TPM
1,500 RPM		1,060,000 TPM
1,400 RPM		1,625,000 TPM
3,500 RPM		2,250,000 TPM
4,750 RPM		2,875,000 TPM
8,500 RPM
Text Embedding 3 SmallAzure (USG)1,000,000 TPM
1,500 RPM		60,000 TPM
400 RPM		500,000 TPM
2,000 RPM		1,000,000 TPM
3,000 RPM		1,500,000 TPM
6,000 RPM
Text Embedding 3 SmallOpenAI1,000,000 TPM
1,500 RPM		60,000 TPM
400 RPM		625,000 TPM
2,500 RPM		1,250,000 TPM
3,750 RPM		1,875,000 TPM
7,500 RPM
Whisper 1OpenAI1 TPM
50 RPM		1 TPM
100 RPM		2 TPM
500 RPM		3 TPM
1,000 RPM		4 TPM
2,000 RPM
o1Azure600,000 TPM
5 RPM		100,000 TPM
25 RPM		250,000 TPM
50 RPM		400,000 TPM
60 RPM		750,000 TPM
75 RPM
o3Azure400,000 TPM
100 RPM		600,000 TPM
525 RPM		1,500,000 TPM
1,500 RPM		2,500,000 TPM
2,500 RPM		4,500,000 TPM
4,500 RPM
o3-miniAzure (USG)300,000 TPM
30 RPM		100,000 TPM
25 RPM		1,000,000 TPM
100 RPM		2,000,000 TPM
200 RPM		4,000,000 TPM
400 RPM
o4-miniAzure300,000 TPM
100 RPM		1,100,000 TPM
1,025 RPM		2,000,000 TPM
2,000 RPM		3,000,000 TPM
3,000 RPM		5,000,000 TPM
5,000 RPM
text-embedding-ada-002Azure1,000,000 TPM
1,500 RPM		1,450,000 TPM
1,450 RPM		3,625,000 TPM
3,625 RPM		4,875,000 TPM
4,875 RPM		6,250,000 TPM
6,250 RPM
text-embedding-ada-002Azure (USG)1,000,000 TPM
1,500 RPM		450,000 TPM
450 RPM		3,000,000 TPM
3,500 RPM		4,000,000 TPM
4,500 RPM		5,000,000 TPM
5,500 RPM
text-embedding-ada-002OpenAI1,000,000 TPM
1,500 RPM		950,000 TPM
950 RPM		3,125,000 TPM
3,125 RPM		4,437,500 TPM
4,438 RPM		5,750,000 TPM
5,750 RPM
Document Information ExtractionPalantir 호스팅1,000,000 TPM
40 RPM		1,000,000 TPM
40 RPM		1,500,000 TPM
300 RPM		2,000,000 TPM
450 RPM		3,000,000 TPM
600 RPM
Gemma 4 26B A4BAmazon Bedrock50,000 TPM
100 RPM		900,000 TPM
180 RPM		5,000,000 TPM
500 RPM		10,000,000 TPM
1,000 RPM		20,000,000 TPM
2,000 RPM
Gemma 4 26B A4BPalantir 호스팅50,000 TPM
100 RPM		100,000 TPM
20 RPM		300,000 TPM
450 RPM		450,000 TPM
675 RPM		600,000 TPM
900 RPM
Gemma 4 31BAmazon Bedrock1,000,000 TPM
100 RPM		1,000,000 TPM
200 RPM		5,000,000 TPM
500 RPM		10,000,000 TPM
1,000 RPM		20,000,000 TPM
2,000 RPM
Schematic 7BPalantir 호스팅50,000 TPM
100 RPM		60,000 TPM
150 RPM		300,000 TPM
450 RPM		450,000 TPM
675 RPM		600,000 TPM
900 RPM
Whisper Large V3Palantir 호스팅50,000 TPM
100 RPM		60,000 TPM
150 RPM		300,000 TPM
450 RPM		450,000 TPM
675 RPM		600,000 TPM
900 RPM
Snowflake Arctic Embed MediumPalantir 호스팅500,000 TPM
500 RPM		60,000 TPM
150 RPM		300,000 TPM
450 RPM		450,000 TPM
675 RPM		600,000 TPM
900 RPM
Grok 4.3xAI500,000 TPM
100 RPM		250,000 TPM
50 RPM		1,000,000 TPM
200 RPM		1,500,000 TPM
300 RPM		2,000,000 TPM
400 RPM
Grok 4.5xAI1,000,000 TPM
200 RPM		250,000 TPM
50 RPM		3,000,000 TPM
800 RPM		4,000,000 TPM
1,200 RPM		5,000,000 TPM
1,600 RPM
Grok 420 Non-Reasoning LatestxAI500,000 TPM
100 RPM		250,000 TPM
50 RPM		1,000,000 TPM
200 RPM		1,500,000 TPM
300 RPM		2,000,000 TPM
400 RPM
Grok 420 Reasoning LatestxAI500,000 TPM
100 RPM		250,000 TPM
50 RPM		1,000,000 TPM
200 RPM		1,500,000 TPM
300 RPM		2,000,000 TPM
400 RPM
Grok Build 0.1xAI400,000 TPM
100 RPM		250,000 TPM
50 RPM		1,000,000 TPM
200 RPM		1,500,000 TPM
300 RPM		2,000,000 TPM
400 RPM
DeepSeek V3.2Amazon Bedrock1,000,000 TPM
100 RPM		1,000,000 TPM
200 RPM		5,000,000 TPM
500 RPM		10,000,000 TPM
1,000 RPM		20,000,000 TPM
2,000 RPM
DeepSeek V4.1 FlashFireworks1,000,000 TPM
100 RPM		100,000 TPM
100 RPM		2,000,000 TPM
2,000 RPM		4,000,000 TPM
4,000 RPM		6,000,000 TPM
6,000 RPM
Gemini 3.8 FlashGoogle Vertex2,000,000 TPM
400 RPM		1,000,000 TPM
200 RPM		12,000,000 TPM
6,000 RPM		18,000,000 TPM
9,000 RPM		30,000,000 TPM
15,000 RPM
Gemini 3.8 FlashGoogle Vertex (USG)2,000,000 TPM
400 RPM		1,000,000 TPM
200 RPM		12,000,000 TPM
6,000 RPM		18,000,000 TPM
9,000 RPM		30,000,000 TPM
15,000 RPM
Gemini 4 Argon (Experimental)Google Vertex2,000,000 TPM
400 RPM		1,000,000 TPM
200 RPM		7,000,000 TPM
1,500 RPM		10,000,000 TPM
2,250 RPM		15,000,000 TPM
3,750 RPM
Gemini 4 Argon (Experimental)Google Vertex (USG)2,000,000 TPM
400 RPM		1,000,000 TPM
600 RPM		7,000,000 TPM
1,500 RPM		10,000,000 TPM
2,250 RPM		15,000,000 TPM
3,750 RPM
Grok 4.6xAI1,000,000 TPM
200 RPM		1,000,000 TPM
200 RPM		3,000,000 TPM
800 RPM		4,000,000 TPM
1,200 RPM		5,000,000 TPM
1,600 RPM
Grok 4.7xAI1,000,000 TPM
200 RPM		1,000,000 TPM
200 RPM		3,000,000 TPM
800 RPM		4,000,000 TPM
1,200 RPM		5,000,000 TPM
1,600 RPM
Kimi K2.5Amazon Bedrock1,000,000 TPM
100 RPM		1,000,000 TPM
200 RPM		5,000,000 TPM
500 RPM		10,000,000 TPM
1,000 RPM		20,000,000 TPM
2,000 RPM
NVIDIA Nemotron 3 Super 120B FP8Palantir 호스팅50,000 TPM
100 RPM		100,000 TPM
25 RPM		300,000 TPM
450 RPM		450,000 TPM
675 RPM		600,000 TPM
900 RPM
Z.ai GLM-5Amazon Bedrock1,000,000 TPM
100 RPM		1,000,000 TPM
200 RPM		5,000,000 TPM
500 RPM		10,000,000 TPM
1,000 RPM		20,000,000 TPM
2,000 RPM
Kimi K3Fireworks1,000,000 TPM
100 RPM		100,000 TPM
100 RPM		2,000,000 TPM
2,000 RPM		4,000,000 TPM
4,000 RPM		6,000,000 TPM
6,000 RPM
Kimi K3Amazon Bedrock1,000,000 TPM
100 RPM		1,000,000 TPM
200 RPM		5,000,000 TPM
500 RPM		10,000,000 TPM
1,000 RPM		20,000,000 TPM
2,000 RPM
Qwen3 235B A22B 2507Amazon Bedrock1,000,000 TPM
100 RPM		250,000 TPM
50 RPM		5,000,000 TPM
500 RPM		10,000,000 TPM
1,000 RPM		20,000,000 TPM
2,000 RPM
Qwen3 32BAmazon Bedrock1,000,000 TPM
100 RPM		250,000 TPM
50 RPM		5,000,000 TPM
500 RPM		10,000,000 TPM
1,000 RPM		20,000,000 TPM
2,000 RPM
Z.ai GLM-5.3Fireworks1,000,000 TPM
100 RPM		100,000 TPM
100 RPM		2,000,000 TPM
2,000 RPM		4,000,000 TPM
4,000 RPM		6,000,000 TPM
6,000 RPM
Z.ai GLM-5.3Amazon Bedrock1,000,000 TPM
100 RPM		1,000,000 TPM
200 RPM		5,000,000 TPM
500 RPM		10,000,000 TPM
1,000 RPM		20,000,000 TPM
2,000 RPM
Z.ai GLM-5.3 FlashFireworks1,000,000 TPM
100 RPM		100,000 TPM
100 RPM		2,000,000 TPM
2,000 RPM		4,000,000 TPM
4,000 RPM		6,000,000 TPM
6,000 RPM