{"id":37,"date":"2024-09-20T11:12:32","date_gmt":"2024-09-20T15:12:32","guid":{"rendered":"https:\/\/sites.williams.edu\/gcp1\/?p=37"},"modified":"2024-09-20T11:12:32","modified_gmt":"2024-09-20T15:12:32","slug":"ephbot","status":"publish","type":"post","link":"https:\/\/sites.williams.edu\/gcp1\/genai\/ephbot\/","title":{"rendered":"EphBot"},"content":{"rendered":"

I’m terrible with updates… but EphBot is live<\/strong> this semester (Fall 2024)!<\/p>\n

To quote the project documentation I developed this summer:<\/p>\n

EphBot<\/b> aims to provide the Williams College community with a hands-on, self-contained language model for <\/span>experimentation, research,<\/b> and <\/span>educational<\/b> purposes. By leveraging the Raspberry Pi 5, we offer a <\/span>local<\/b> alternative to cloud-based genAI applications, addressing data privacy concerns and promoting exploration of AI <\/span>sustainability, capacity, user experience design,<\/b> and other areas.<\/span><\/p><\/blockquote>\n

EphBot combines the excellent Llamafile project<\/a> from Mozilla Builders with the Raspberry Pi 5, a Kill-a-Watt meter, and some crafty *nix-fu to make the whole kit a headless plug-and-play hotspot for students and faculty to be more than “users” of LLMs, but have access to a local, adjustable model (AI2’s OLMo<\/a> to be exact) for substantive research.<\/p>\n

It’s listed in the Sawyer Library’s Equipment Loan Center inventory<\/a> – go check it out!<\/p>\n

Many thanks to OIT, the Academic Technology Services Team, the Makerspace, and the Libraries for all the support.<\/p>\n","protected":false},"excerpt":{"rendered":"

I’m terrible with updates… but EphBot is live this semester (Fall 2024)! To quote the project documentation I developed this summer: EphBot aims to provide the Williams College community with a hands-on, self-contained language model for experimentation, research, and educational purposes. By leveraging the Raspberry Pi 5, we offer a local alternative to cloud-based genAI… Continue reading EphBot<\/span><\/a><\/p>\n","protected":false},"author":2961,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[6],"tags":[],"class_list":["post-37","post","type-post","status-publish","format-standard","hentry","category-genai","entry"],"acf":[],"_links":{"self":[{"href":"https:\/\/sites.williams.edu\/gcp1\/wp-json\/wp\/v2\/posts\/37","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sites.williams.edu\/gcp1\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sites.williams.edu\/gcp1\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sites.williams.edu\/gcp1\/wp-json\/wp\/v2\/users\/2961"}],"replies":[{"embeddable":true,"href":"https:\/\/sites.williams.edu\/gcp1\/wp-json\/wp\/v2\/comments?post=37"}],"version-history":[{"count":1,"href":"https:\/\/sites.williams.edu\/gcp1\/wp-json\/wp\/v2\/posts\/37\/revisions"}],"predecessor-version":[{"id":38,"href":"https:\/\/sites.williams.edu\/gcp1\/wp-json\/wp\/v2\/posts\/37\/revisions\/38"}],"wp:attachment":[{"href":"https:\/\/sites.williams.edu\/gcp1\/wp-json\/wp\/v2\/media?parent=37"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sites.williams.edu\/gcp1\/wp-json\/wp\/v2\/categories?post=37"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sites.williams.edu\/gcp1\/wp-json\/wp\/v2\/tags?post=37"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}