Skip to content
@deepinfra

Deep Infra

Inference cloud

Popular repositories Loading

  1. deepctl deepctl Public

    Command line tool for Deep Infra cloud ML inference service

    Rust 38 3

  2. deepinfra-node deepinfra-node Public

    Official TypeScript wrapper for DeepInfra Inference API

    TypeScript 21 3

  3. text-generation-inference text-generation-inference Public

    Forked from huggingface/text-generation-inference

    Large Language Model Text Generation Inference

    Python 9 2

  4. ocr-tools ocr-tools Public

    Python 5 2

  5. langchain langchain Public

    Forked from langchain-ai/langchain

    ⚡ Building applications with LLMs through composability ⚡

    Python 1

  6. deepinfra-python deepinfra-python Public

    Unofficial Python wrapper for the DeepInfra Inference API

    Python 1

Repositories

Showing 10 of 48 repositories
  • dynamo Public Forked from ai-dynamo/dynamo

    A Datacenter Scale Distributed Inference Serving Framework

    deepinfra/dynamo's past year of commit activity
    Rust 1 1,607 0 9 Updated Sep 17, 2026
  • deepinfra-hermes-sandbox Public

    DeepInfra cloud sandbox (deep_sands) terminal backend plugin for hermes-agent

    deepinfra/deepinfra-hermes-sandbox's past year of commit activity
    Python 0 MIT 0 0 0 Updated Sep 17, 2026
  • vllm Public Forked from vllm-project/vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

    deepinfra/vllm's past year of commit activity
    Python 0 Apache-2.0 22,600 0 0 Updated Sep 14, 2026
  • docs Public

    DeepInfra platform documentation

    deepinfra/docs's past year of commit activity
    MDX 1 MIT 0 0 2 Updated Sep 11, 2026
  • pi Public Forked from earendil-works/pi

    AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI

    deepinfra/pi's past year of commit activity
    TypeScript 0 MIT 13,548 0 0 Updated Sep 10, 2026
  • TensorRT-LLM Public Forked from NVIDIA/TensorRT-LLM

    TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

    deepinfra/TensorRT-LLM's past year of commit activity
    Python 0 2,787 0 5 Updated Sep 2, 2026
  • deepinfra-node Public

    Official TypeScript wrapper for DeepInfra Inference API

    deepinfra/deepinfra-node's past year of commit activity
    TypeScript 21 MIT 3 7 2 Updated Sep 1, 2026
  • kv-local-indexer Public
    deepinfra/kv-local-indexer's past year of commit activity
    Rust 0 0 0 0 Updated Aug 12, 2026
  • openbench Public Forked from groq/openbench

    Provider-agnostic, open-source evaluation infrastructure for language models

    deepinfra/openbench's past year of commit activity
    Python 0 MIT 109 0 0 Updated Aug 12, 2026
  • deepinfra-python Public

    Unofficial Python wrapper for the DeepInfra Inference API

    deepinfra/deepinfra-python's past year of commit activity
    Python 1 MIT 0 5 1 Updated Aug 12, 2026
View all repositories

Sponsoring

  • @openclaw
GitHub Sponsor