Instructions to use JakeOh/LLaDA-8B-Instruct-fixed with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use JakeOh/LLaDA-8B-Instruct-fixed with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="JakeOh/LLaDA-8B-Instruct-fixed", trust_remote_code=True)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("JakeOh/LLaDA-8B-Instruct-fixed", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
File size: 418 Bytes
05f0d48 | 1 2 3 4 5 6 7 8 9 10 11 | {% set loop_messages = messages %}
{%- for message in loop_messages %}
{% set content = '<|start_header_id|>' + message['role'] + '<|end_header_id|>\n\n' + message['content'] | trim + '<|eot_id|>' %}
{%- if loop.index0 == 0 %}
{% set content = bos_token + content %}
{%- endif %}{{ content }}
{%- endfor %}
{%- if add_generation_prompt %}
{{ '<|start_header_id|>assistant<|end_header_id|>\n\n' }}
{%- endif %}
|