It's possible, but those golden crumbs may be sawdust from wood in your ceiling/walls. I'd first check to see if the ants you have are carpenter ants and then try controlling the infestation.

Here is a link that might be useful: carpenter ants

annz says ants! Agreed.

Annz, It's not sawdust.

Sounds like nobody has gone up into the attic to see from the other side.

Carpenter ants do not digest wood like termites, but excavate galleries to nest in.

The frass they produce looks like tiny shards of wood, not exactly sawdust, but very similar. You would likely need a magnifier (at least) to see what it actually is.

You should inspect above the ceiling, and even consider removing some of the ceiling if required to gain access.

Or get a consultation from a pro exterminator. Extirminators are using organics as much as possible these days that are harmless to humans and pets. Ask them about that as well.

thanks everyone