# Web Search BETA

<img src="https://github.com/user-attachments/assets/1cf8bab5-d4e5-4b8a-9cc2-dbad8cf19923" width="600" />


> [!WARNING]
> You will need a Credit Card for the FREE API access.

> [!IMPORTANT]
> We are exploring other search backends that don’t require such a process to get a key.  
> Brave search was built in to llama 3.1 by Meta which is why we started with this. (Stay posted)

> [!NOTE]
> Join the search for the best system prompt in our Discord thread.  
> [Web-Search-Beta-Release-Prompt-Engineering](https://discord.com/channels/1076964370942267462/1266166982873452566)  
> "The only good bug is a <s>dead</s> reported one!" Join the fight in this discussion.  
> [Web-Search-Beta-Release-Bugs](https://github.com/nomic-ai/gpt4all/discussions/2738)
## Steps to setup

<a id="1"> [1.](https://github.com/nomic-ai/gpt4all/wiki/Web-Search-Beta-Release#web-search-beta#1)</a> Install via the beta release located here: [v3.1.0-web_search_beta](https://github.com/nomic-ai/gpt4all/releases/tag/v3.1.0-web_search_beta)  

<a id="2"> [2.](https://github.com/nomic-ai/gpt4all/wiki/Web-Search-Beta-Release#web-search-beta#2)</a> Sign up for a free Brave search AI API Key: https://brave.com/search/api/  
Jump straight to [Get started for FREE](https://api.search.brave.com/register) <<<< Click here to jump in!  

![Screenshot 2024-07-25 164037](https://github.com/user-attachments/assets/0ebd3f55-2395-4969-8b90-18660e7117dd)

![image](https://github.com/user-attachments/assets/a134300f-44f8-45e8-8eeb-c0196a294004)

<a id="3"> [3.](https://github.com/nomic-ai/gpt4all/wiki/Web-Search-Beta-Release#web-search-beta#3)</a> Ensure you verify your email. Then "login".  
![Screenshot 2024-07-25 164414](https://github.com/user-attachments/assets/2ec939f9-be93-4d7c-8ee3-fc73b14d302a)

<a id="4"> [4.](https://github.com/nomic-ai/gpt4all/wiki/Web-Search-Beta-Release#web-search-beta#4)</a> At the Welcome screen you first need a free "subscription". (Credit Card Required)
![Screenshot 2024-07-25 164550](https://github.com/user-attachments/assets/0c688343-0a8b-4294-a832-adf3cb2822e9)

<a id="5"> [5.](https://github.com/nomic-ai/gpt4all/wiki/Web-Search-Beta-Release#web-search-beta#5)</a> Choose <ins>Data for AI</ins> then "Free AI" and click (Subscribe) at the bottom.  
![Screenshot 2024-07-25 164639](https://github.com/user-attachments/assets/86a6f6a8-6fa0-4b8a-ac1e-bb94b5bdbaed)

<a id="6"> [6.](https://github.com/nomic-ai/gpt4all/wiki/Web-Search-Beta-Release#web-search-beta#6)</a> Next we add an API key, click this button (+ Add API key).  
![Screenshot 2024-07-25 164559](https://github.com/user-attachments/assets/c1308ff8-7171-4801-93ac-66223c30becb)

<a id="7"> [7.](https://github.com/nomic-ai/gpt4all/wiki/Web-Search-Beta-Release#web-search-beta#7)</a> Name it GPT4All then select the "Free AI" option.  
![Screenshot 2024-07-25 165505](https://github.com/user-attachments/assets/8b50a6e2-54c8-495d-be0e-a9071505841d)

<a id="8"> [8.](https://github.com/nomic-ai/gpt4all/wiki/Web-Search-Beta-Release#web-search-beta#8)</a> Copy the newly created key by clicking "copy"  
![Screenshot 2024-07-25 165551](https://github.com/user-attachments/assets/44be4e94-38c4-42d8-9fce-44312e1009ef)

<a id="9"> [9.](https://github.com/nomic-ai/gpt4all/wiki/Web-Search-Beta-Release#web-search-beta#9)</a> Paste this key in the Tools Settings in GPT4All  
![image](https://github.com/user-attachments/assets/1b45d1fb-9751-4373-b282-6b48997554a4)

<a id="10"> [10.](https://github.com/nomic-ai/gpt4all/wiki/Web-Search-Beta-Release#web-search-beta#10)</a> Download the Llama 3.1 8B Instruct model provided here, if you don't have it already.  
![image](https://github.com/user-attachments/assets/f9ac133d-3a64-46d6-a409-3540c71cdd6b)

<a id="11"> [11.](https://github.com/nomic-ai/gpt4all/wiki/Web-Search-Beta-Release#web-search-beta#11)</a> Copy the following system prompt for the brave api access.
```
<|start_header_id|>system<|end_header_id|>
Environment: ipython
Tools: brave_search

Cutting Knowledge Date: December 2023
Today Date: 25 Jul 2024

You are a helpful assistant.<|eot_id|> 
```

<a id="12"> [12.](https://github.com/nomic-ai/gpt4all/wiki/Web-Search-Beta-Release#web-search-beta#12)</a> Paste this into the model settings for the system prompt.  
![image](https://github.com/user-attachments/assets/4eac0969-c1fe-471b-9513-3dfce66d5228)  
Do not set the context larger than 8192. (full rope scaling is coming soon)  
![image](https://github.com/user-attachments/assets/d914893d-3e21-4565-aa9f-6a0fdfe8f400)


<a id="13"> [13.](https://github.com/nomic-ai/gpt4all/wiki/Web-Search-Beta-Release#web-search-beta#13)</a> Go to the chat view and load the Llama 3.1 8B Instruct model and type in:

`Search the web and tell me who the 44th president of the United States was`

You should see this:

<img src="https://github.com/user-attachments/assets/afd3d165-e4c3-4077-a6fa-5af078e52ee7" width="300" />

Enjoy and let us know of any problems or feedback on discord - https://discord.com/invite/4M2QFmTt2k