groq.APIStatusError: Error code: 413 - {'error': {'message': 'Request too large for model `llama-3.1-70b-versatile Limit 6000, Requested 10648, please reduce your message size and try again

For the purposes of my application, which is analyzing an OCR'd bank account statement markdown text, I need to feed the entire information. I need an analysis over the entire bank account statement.

The LLM needs to see all of the text to answer the question I want it to answer. Is the way the this problem is usually solved by sending multiple messages that would then encompass all information? e.g. chunk 1, contains 50% of the info, chunk 2 contains the other 50%.

Are ways of going around perhaps by providing multiple calls to Groq? But the limit is 6,000 tokens PER MINUTE.

My current code is simply:

completion = client.chat.completions.create(
    model="llama-3.1-70b-versatile",
    messages=[
    {
        'role': 'user',
        'content': prompt, # ******** PROMPT IS TOO LARGE!
    },
    {"role": "assistant", "content": "{"}

    ],
    temperature=1,
    max_tokens=530, #prev 1024
    top_p=1,
    stream=False,
    stop=None,
)

1) I've tried running the model locally with ollama but my Mac M1 Pro takes forever to run it. 2) Is the solution to find a different provider?