Alpha
Contact
Implement · MORENA 1.5B

Can you run it?

Ownership levelPartialnone·limited·partial·substantial·fullAnalytical input D ยท 46.8/100

This page is a projection of the one entry record, the Reliability and Data control factors that Implement covers. The full verdict is set by all four factors together, floor-weighted so the weakest caps the whole.

Which domain expands which factor
  • AssessUse & modify + Transparency
  • ImplementData control + Reliability
  • UseReliability
  • SupportTransparency

Install & run

The weights are not a transformers architecture, so AutoModelForCausalLM cannot load them. The publisher route is its own PyTorch file (ev-card-instruct, ev-trainer):

pip install torch safetensors tokenizers
# download model.safetensors, config.json, tokenizer.json, modeling_morena.py,
# load_example.py and SHA256SUMS from vamboai/morena-1.5b-instruct at a pinned revision
sha256sum -c SHA256SUMS          # confirm all five files before running anything
python load_example.py           # needs a CUDA GPU as written

load_example.py builds Transformer(ModelConfig(**cfg["model"]), "sdpa"), loads the weights with strict=True and samples with a hand-written loop. The class has no .generate(). The other route is the official GGUF (vamboai/morena-1.5b-instruct-gguf) with llama.cpp:

llama-completion -m morena-1.5b-instruct-f16.gguf \
  -p "<reserved_0>\nNdeipi guta guru reZimbabwe?\n<reserved_1>\n" -e -n 64 --temp 0

Pin the revision hash. The instruct repo was last modified on 2026-10-14. modeling_morena.py is code you will execute, so read it first and run it in a sandbox with no network. load_example.py still opens with "preview weights". The text is stale and does not refer to a different checkpoint (ev-hf-platform).

Hardware & VRAM requirements

The publisher gives file sizes and no requirements table (ev-card-instruct, ev-paper, ev-hf-platform).

ArtefactSize
model.safetensors (bf16, 1,484,900,352 parameters)2.97 GB
GGUF Q4_K_M / Q8_0 / f160.92 / 1.58 / 2.97 GB

The paper reports 4.44 ms per character on one A100, measured on the previous instruct version with the same architecture, and says the GGUF builds run on a laptop CPU offline. The 4,096-token context keeps the KV cache small. The reference loop has no KV cache, so it recomputes the whole sequence per token and suits short tests only. OneHill has not measured memory or speed.

Serving stacks

StackStatus
llama.cppOfficial GGUF. Hugging Face parses it as architecture llama, context 4096 (ev-hf-platform). The publisher says logit equivalence was checked; OneHill has not repeated the check
Publisher PyTorch codeWorks, with no generate() and no KV cache
transformers, vLLM, TGI, OllamaNo documented support or model class
Hosted providersNone. The Hugging Face inference mapping is empty and the cards set inference: false

Operational readiness is therefore 2. Anything beyond llama.cpp means converting the weights or writing a model class.

Safe-deployment controls & Deployment Ceiling

Controls follow the safe-deployment playbook.

Supply chain: pin the revision, verify SHA256SUMS yourself (including the 2.97 GB weights file, which OneHill has not downloaded), and review modeling_morena.py before executing it.

Model layer: use the instruct checkpoint only for experiments, because the base checkpoint has no safety tuning. Expect refusals and degenerate output (1.3%).

Evaluation: have native speakers rate outputs per language before any wider use. Every publisher safety number is one model judging another, and Igbo (75%) and Yoruba (82%) are the weakest languages.

Input and output layers: add your own guardrails. No guard model, acceptable-use policy or jailbreak test ships.

Licence hygiene: add the Apache-2.0 text to anything you redistribute, and record the open Gemma Terms question in your AI-BOM.

Deployment Ceiling: T1 (internal assistant, human reads every output), conditional. The publisher says the instruct model is not yet an assistant, fails 41% of benign requests and has no native-speaker review, so the evidence does not justify customer-facing T2 use.

Available quantizations

The publisher ships GGUF for the instruct model (Q4_K_M, Q8_0, f16), the 0.5B mini and the 0.2B nano (ev-siblings, ev-hf-platform). No GGUF is listed for the 1.5B base, and no GPTQ, AWQ or MLX build exists. The cards say GGUF conversions were checked for logit equivalence with the safetensors. Quality loss at Q4_K_M in the African languages is unmeasured, so test your language.

Fine-tuning & adaptation

The base card recommends the base checkpoint for "fine-tuning, continued pretraining and domain adaptation" (ev-card-base). The repo's modeling_morena.py is the publisher's trainer: FSDP2 sharding, Muon for hidden weights and AdamW for embeddings, a warmup-stable-decay schedule, document-packed sequences, an --anneal mode and a --loss-mask flag for SFT.

It expects configs/*.json, a mixture JSON and sharded data directories that are not published, and it mentions a TRAIN_README.md that is absent. Write your own configs and data loader inputs. The released SFT component is the Fikira dataset (50,000 synthetic rows, MIT); the SFT corpus itself is not public. The paper's instruct recipe, for example 4,500 steps at 2e-5 on batches of 256 with loss masked to assistant turns, is a starting point.

API / OpenAI-compatible integration

There is no hosted endpoint and no documented OpenAI-compatible server. llama.cpp can serve the GGUF over its own HTTP server, but the publisher does not document that route. The prompt format uses reserved tokens, so wrap requests in the chat template from tokenizer_config.json (see the Use domain). Role-based JSON does not apply.

How this scores

The ownership factors this domain covers, drawn from the one entry record.

3

ReliabilityIs it reliable and good enough for the job?

Weak

Operational readiness is 2 (publisher code or llama.cpp GGUF only) and safety is 2 (publisher-only, model-judged evaluation, 41% of benign requests failed). The paper says the instruct model is not an assistant (ev-card-instruct, ev-paper).

How this scores (AOI sub-dimensions)
Operational2/5how practical it is to run, serve and maintain in productionThe only mainstream route is the publisher's GGUF on llama.cpp (Q4_K_M, Q8_0, f16; Hugging Face reads it as architecture llama with 4,096 context).
Safety2/5whether misuse risks are evaluated and guardrails are providedThe instruct model is safety-tuned, and the publisher reports a 3,341-prompt, 13-language, 11-category evaluation that includes its residual risks (89.0% handled well, 41% of benign requests failed, Igbo 75%).
4

Doesn't extract your dataDoes running it keep your knowledge and data yours?

Strong

Self-hosted weights under a declared Apache-2.0 licence with no clawback clause. An outline read of the loader code found no network calls (ev-licence, ev-trainer).

How this scores
Not a scored AOI dimension. For a self-hosted model, data-control is a structural property of running the weights yourself, strong by default unless the model phones home or the licence claws back rights. For a hosted API this factor is the retention + train-on-inputs + residency read, scored from the binding terms.
What this means for adoptionYou own the use of the weights: Apache-2.0 is declared, ungated and commercial use is stated, and your data stays on your hardware. You do not own a finished assistant. The paper says the instruct model is not one, it cannot be rebuilt without the unreleased corpus and configs, and the evaluations are the publisher's own. The level rises if Vambo ships a LICENSE file, releases its corpus and harness, and clears the Gemma Terms question on the SFT data.

Sources

The same evidence records as the entry sheet. Read means the text was verified; unverified means it is known to exist but not yet read.

Model cardread2026-11-19
The instruct card declares Apache-2.0, names twelve languages, and gives 1.485B parameters and a 4,096-token context.
Model cardread2026-11-19
The base card describes a base checkpoint beside the instruct one (vamboai/morena-1.5b-base) with the same Apache-2.0 declaration.
Licenceread2026-11-19
Every MORENA repo declares Apache-2.0 in the front matter and the card 'Licence' section ('Commercial use is permitted, including fine-tuning and redistributing derivatives').
Licenceread2026-11-19
Canonical Apache License 2.0 text, the licence the MORENA declaration points to: section 2 grants copyright, section 3 grants patent rights, and section 4 governs redistribution and requires passing on a copy of the licence.
Technical_reportread2026-11-19
Paper 'MORENA: An African Foundation Model' (23 pages, 18 September 2026, single author).
Documentationread2026-11-19
modeling_morena.py (52,103 bytes, identical in base and instruct) calls itself the 'Morena production trainer' (FSDP2, Muon, mixture sampler, checkpointing) and also defines the model.
Documentationread2026-11-19
SHA256SUMS in the repo lists five files.
Documentationread2026-11-19
Hugging Face platform metadata.
Model cardread2026-11-19
Sibling cards: morena-0.5b-mini and morena-0.2b-nano (pruned and distilled from the 1.5B base, not safety-tested, Apache-2.0) and morena-1.5b-instruct-gguf (Q4_K_M 0.92 GB, Q8_0 1.58 GB, f16 2.97 GB, 'verified for logit equivalence').
Documentationread2026-11-19
vamboai/fikira is a public, ungated MIT dataset of 50,000 synthetic reasoning examples in ten languages, copyright 'Vambo Technologies (trading as Vambo AI)', one named SFT component; vamboai/morena-sft-corpus, listed in the card metadata, returns HTTP 401 and is not public.
Vendor announcementread2026-11-19
The vambo.ai footer names Vambo Technologies (Pty) Ltd, and the site names co-founders.
Third-party analysisread2026-11-19
Three press articles (Tech In Africa 13 Oct 2026, CIO Africa 16 Oct 2026, Daba Finance 7 Oct 2026) describe a South African start-up releasing an open-weight model and say the results are the developer's own and unverified.
Terms of serviceread2026-11-19
Gemma Terms of Use (last modified April 1, 2026).