Skip to content

Not fetching all messages in channels #11

Description

@Seb-135

I used Guilded daily for over a year and have tens of thousands of messages across a few servers, but every time I run the scrubber, it only deletes a few hundred.
2024-07-15 20:34:10 Guilded Scrubber — LibreWolf Private Browsing
2024-07-15 20:45:10 Guilded Scrubber — LibreWolf Private Browsing
Watching it progress in a channel, it seems to arbitrarily stop after a few messages before moving on to the next channel.

I have tried both, the official instance and self-hosting.

Edit: I have just repeatedly ran the scrubber on one channel, until it started consistently deleting 0 messages, despite there being messages from me in the channel.

The log of an attempted scrub that deleted nothing:
{
  externalApiUrl: 'https://www.guilded.gg/api/channels/eb0e8bd9-xxxx-xxxx-xxxx-xxxxxxxxxxxx/messages?limit=100&beforeDate=2024-07-15T19%3A00%3A00.000Z&afterDate=2023-04-19T04%3A55%3A00.000Z',
  fetchOptions: {
    method: 'GET',
    headers: {
      authority: 'www.guilded.gg',
      accept: '*/*',
      'cache-control': 'no-cache',
      'content-type': 'application/json',
      cookie: 'hmac_signed_session=TOKEN; authenticated=true;',
      'guilded-client-id': '69baa5b2-xxxx-xxxx-xxxx-xxxxxxxxxxxx',
      'guilded-viewer-platform': 'desktop',
      pragma: 'no-cache',
      'sec-fetch-mode': 'cors',
      'sec-fetch-site': 'none'
    },
    retry: { retries: 10, randomize: true }
  }
}
{
  res: {
    messages: [
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object]
    ],
    repliedToMessages: [],
    hasPastMessages: true,
    threads: []
  }
}
 GET /api/channels/eb0e8bd9-xxxx-xxxx-xxxx-xxxxxxxxxxxx/messages 200 in 226ms
{
  externalApiUrl: 'https://www.guilded.gg/api/channels/eb0e8bd9-xxxx-xxxx-xxxx-xxxxxxxxxxxx/messages?limit=100&beforeDate=2024-07-15T19%3A00%3A00.000Z&afterDate=2023-04-19T04%3A55%3A00.000Z',
  fetchOptions: {
    method: 'GET',
    headers: {
      authority: 'www.guilded.gg',
      accept: '*/*',
      'cache-control': 'no-cache',
      'content-type': 'application/json',
      cookie: 'hmac_signed_session=TOKEN; authenticated=true;',
      'guilded-client-id': 'c44f721a-xxxx-xxxx-xxxx-xxxxxxxxxxxx',
      'guilded-viewer-platform': 'desktop',
      pragma: 'no-cache',
      'sec-fetch-mode': 'cors',
      'sec-fetch-site': 'none'
    },
    retry: { retries: 10, randomize: true }
  }
}
{
  res: {
    messages: [
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object]
    ],
    repliedToMessages: [],
    hasPastMessages: true,
    threads: []
  }
}
 GET /api/channels/eb0e8bd9-xxxx-xxxx-xxxx-xxxxxxxxxxxx/messages 304 in 225ms
{
  externalApiUrl: 'https://www.guilded.gg/api/channels/eb0e8bd9-xxxx-xxxx-xxxx-xxxxxxxxxxxx/messages?limit=100&beforeDate=2023-04-19T07%3A21%3A34.501Z&afterDate=2023-04-19T04%3A55%3A00.000Z',
  fetchOptions: {
    method: 'GET',
    headers: {
      authority: 'www.guilded.gg',
      accept: '*/*',
      'cache-control': 'no-cache',
      'content-type': 'application/json',
      cookie: 'hmac_signed_session=TOKEN; authenticated=true;',
      'guilded-client-id': '3466258a-xxxx-xxxx-xxxx-xxxxxxxxxxxx',
      'guilded-viewer-platform': 'desktop',
      pragma: 'no-cache',
      'sec-fetch-mode': 'cors',
      'sec-fetch-site': 'none'
    },
    retry: { retries: 10, randomize: true }
  }
}
{
  res: {
    messages: [
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object]
    ],
    repliedToMessages: [],
    hasPastMessages: false,
    threads: []
  }
}
 GET /api/channels/eb0e8bd9-xxxx-xxxx-xxxx-xxxxxxxxxxxx/messages 200 in 520ms
{
  externalApiUrl: 'https://www.guilded.gg/api/channels/eb0e8bd9-xxxx-xxxx-xxxx-xxxxxxxxxxxx/messages?limit=100&beforeDate=2023-04-19T07%3A21%3A34.501Z&afterDate=2023-04-19T04%3A55%3A00.000Z',
  fetchOptions: {
    method: 'GET',
    headers: {
      authority: 'www.guilded.gg',
      accept: '*/*',
      'cache-control': 'no-cache',
      'content-type': 'application/json',
      cookie: 'hmac_signed_session=TOKEN; authenticated=true;',
      'guilded-client-id': '8afd191a-xxxx-xxxx-xxxx-xxxxxxxxxxxx',
      'guilded-viewer-platform': 'desktop',
      pragma: 'no-cache',
      'sec-fetch-mode': 'cors',
      'sec-fetch-site': 'none'
    },
    retry: { retries: 10, randomize: true }
  }
}
{
  res: {
    messages: [
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object], [Object], [Object], [Object],
      [Object], [Object], [Object]
    ],
    repliedToMessages: [],
    hasPastMessages: false,
    threads: []
  }
}
 GET /api/channels/eb0e8bd9-xxxx-xxxx-xxxx-xxxxxxxxxxxx/messages 304 in 232ms

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions