kingbri efc01d947b API + Model: Add speculative ngram decoding ... Speculative ngram decoding is like speculative decoding without the draft model. It's not as useful because it only decodes on predictable sequences, but it depends on the usecase. Signed-off-by: kingbri <bdashore3@proton.me>		2024-03-13 23:32:11 -04:00
..
sample_preset.yml	API + Model: Add speculative ngram decoding	2024-03-13 23:32:11 -04:00