Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
edunteman
on March 6, 2024
|
parent
|
context
|
favorite
| on:
Show HN: Fructose – LLM calls as strongly typed fu...
Yes. TGI is Huggingface's version of LLVM (some nuance, of course). LLVM also launched grammar support recently too, so we'll be looking into it.
memothon
on March 6, 2024
[–]
All of these acronyms are so confusing. I'm assuming LLVM isn't the compiler tool, but searching "LLVM ai" doesn't give me any good results.
reliableturing
on March 6, 2024
|
parent
[–]
They probably meant vLLM
https://docs.vllm.ai/en/latest/
edunteman
on March 6, 2024
|
root
|
parent
[–]
ah shoot, yes I meant vLLM, sorry for the confusion, lots of comments to reply to :)
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
