Princeton LLM Inference Platform

• README
  • Solution
  • Development Practices
  • Components
    • Inference Container
    • Web GUI
• Usage
  • Local workflow
    • Open terminal
    • Install library locally
    • (Optional) Download a model
    • Run deploy command
  • Use endpoint!
  • Disconnecting/Cleaning Up
• Vision
• Project Roadmap
  • Status
  • Command-Line Deployment
  • GUI-based Deployment
  • GUIs to interact with the LM
• Della development notes
• Local development notes
  • Software Information
  • Testing 6 Sept 2023

Indices and tables

• Index

• Module Index

• Search Page