Pasting textin AI chat app takes too long

Posted by Specialist_Ruin_9333@reddit | LocalLLaMA | View on Reddit | 13 comments

I've observed for more than an year that pasting text in the text fields of apps like ChatGPT, Gemini takes too long, only on the web app, and it gets worse the longer your chat history becomes, does anyone know why? I suspect that they're tokenizing the text locally on the app itself but I can't prove it.

Reply to Post

13 Comments

[-]

ContextLengthMatters@reddit

How did you find this sub?

[-]

Specialist_Ruin_9333@reddit (OP)

Your mom told me

[-]

ContextLengthMatters@reddit

Gotcha. Well she doesn't know anything about AI either. That was pretty dumb.

[-]

Specialist_Ruin_9333@reddit (OP)

Brave assumption

[-]

ContextLengthMatters@reddit

I didn't assume anything. I asked and you told.

[-]

Specialist_Ruin_9333@reddit (OP)

Well you asked me how I found the sub, the sub is related to AI but knowing of its existence is in no way a marker of your expertise in the subject.

[-]

ContextLengthMatters@reddit

I'm asking how you found this sub because the question you asked was in no way relevant to what this sub is. This sub is for self-hosting. You don't have to be an expert to be here, but you shouldn't be this lost.

[-]

Specialist_Ruin_9333@reddit (OP)

You win bro

[-]

Specialist_Ruin_9333@reddit (OP)

Maybe on one of the apps but it happens on both ChatGPT and Gemini, I've seen it on Microsoft Copilot too

[-]

DeltaSqueezer@reddit

It happens on facebook too.

Pasting textin AI chat app takes too long

Reply to Post

13 Comments

ContextLengthMatters@reddit

Specialist_Ruin_9333@reddit (OP)

ContextLengthMatters@reddit

Specialist_Ruin_9333@reddit (OP)

ContextLengthMatters@reddit

Specialist_Ruin_9333@reddit (OP)

ContextLengthMatters@reddit

Specialist_Ruin_9333@reddit (OP)

ContextLengthMatters@reddit

ttkciar@reddit

phenotype001@reddit

Specialist_Ruin_9333@reddit (OP)

DeltaSqueezer@reddit