Lee-Si-Yoon / dsh-llm-friendli

dsh-llm-friendli

A DeepSeek Harness plugin that adds FriendliAI as an LLM provider. Friendli speaks the OpenAI-compatible chat API, so the adapter implements the harness LlmAdapter contract over it and fetches the model catalog from Friendli at runtime.

Quick start

Install the dsh CLI, add the plugin to a profile, export your key, and launch:

npm i -g @deepseek-ai/dsh                       # the dsh CLI (needs Node.js)
dsh plugin --profile web add dsh-llm-friendli   # register the friendli provider
export FRIENDLI_API_KEY="flp_..."               # your Friendli key
dsh web                                         # friendli is now a provider

That's it. dsh plugin add merges the plugin's bundle patch into the profile, so the friendli provider is registered with working defaults — no config file to touch. Open the web UI, pick a Friendli model, and go. The model list is pulled live from Friendli.

Prefer not to install globally? Prefix each command with npx @deepseek-ai/dsh instead.

Confirm the layer loaded without booting:

dsh --profile web --dump-config   # look for a "# == dsh-llm-friendli" layer

Get a key from the Friendli dashboard. It's read from the environment on every request, so never inline it in a config file or commit it.

Configuration

The defaults work out of the box. To override any of them, add a config block in your profile's own cordis.patch.yml:

- id: dsh-llm-friendli
  name: 'dsh-llm-friendli'
  config:
    apiKeyEnv: FRIENDLI_API_KEY                     # default
    baseURL: https://api.friendli.ai/serverless/v1  # default
    providers: [friendli]                           # default
    thinking: enabled                               # optional; on/off for controllable models
    modelCacheTtlMs: 60000                          # default; model-catalog cache

To use it outside dsh web, point an agent at a Friendli model id (as returned by GET /models). See examples/cordis.yml for a full fragment.

- id: agent-loop
  name: '@deepseek-ai/dsh-agent-loop'
  config:
    agents:
      - id: main
        provider: friendli
        model: zai-org/GLM-5.2

License

MIT © Lee-Si-Yoon