anybody here set up local LLM?

Collapse
X
Collapse
 
  • Page of 1
  • Time
  • Show
Clear All
new posts
Previous template Next
  • lezinterracial
    Confirmed User
    • Jul 2012
    • 3117
    #1

    anybody here set up local LLM?

    anybody here set up local LLM? Looking to learn more about them.
    Live Sex Shows
    Tags: None
    • pornmasta
      Too lazy to set a custom title
      • Jun 2006
      • 20017
      #2
      Look for a tutorial for oobabooga

        Comment

        • 2MuchMark
          Mark of 2Much.net
          • Aug 2004
          • 50989
          #3
          Originally posted by lezinterracial
          anybody here set up local LLM? Looking to learn more about them.
          Yes I have setup a few. The best thing I can recommend is that you go to Youtube and look for some tutorials if you are new. Here's a really good tutorial on how to setup your first one:



          You'll need a fast PC with a modern GPU with at least 12 Gigabytes of VRAM, or an Apple M1/M3/M4 Mac Mini with lots of RAM. It's pretty easy, fun, and impressive. Enjoy!

            Comment

            • Publisher Bucks
              Confirmed User
              • Oct 2018
              • 1331
              #4
              Mark,

              With a local LLM, do you know if it is possible to use API functionality by connecting to the local IP address?

              You mentioned setting one up a few weeks ago in a thread of mine and I've been looking into it but not able to find any solid information about allowing others to use the local machine using an API.
              Extreme Link List - v1.0

                Comment

                • trevesty
                  Confirmed User
                  • Aug 2006
                  • 3810
                  #5
                  Originally posted by Publisher Bucks
                  Mark,

                  With a local LLM, do you know if it is possible to use API functionality by connecting to the local IP address?

                  You mentioned setting one up a few weeks ago in a thread of mine and I've been looking into it but not able to find any solid information about allowing others to use the local machine using an API.
                  AnythingLLM I believe can achieve this, but I'm not 100%.
                  The Fap Guide

                    Comment

                    Previous template Next
                    Working...