Feed problem, some videos do not show up

[EsmailELBoBDev2]

Official Instance

• The bug is reproducable on the official hosted instance or is API related.

Describe the bug

I self host piped.esmailelbob.xyz and I noticed videos from channels I subbed to in invidious show up and takes so long to show up in piped

To Reproduce

sub to some channels
take channels file
add it to both invidious and piped

Expected behavior

videos show up in my feed when some channel upload a video

Logs/Errors

hmm, not sure what to add here

Browser, and OS with Version.

No response

Additional context

No response

[FireMasterK]

Do you have a list of channel IDs that are affected by this bug?

I can check their pubsub subscription status then at https://pubsubhubbub.appspot.com/

[EsmailELBoBDev2]

I can give you the sub file...
subscriptions.json.txt (had ti change it to .txt for github)

but I noticed something weird, I had problem with my instance I think it was problem with the database, while piped worked okay the login page did not work (pressing on login button did nothing) till I restarted the docker image so I assume it's problem in my own instance, somehow fetchers do not run right?

[FireMasterK]

This should be fixed with TeamPiped/Piped-Backend@3a00940, let me know if it is not.

[azR-103]

This should be fixed with TeamPiped/Piped-Backend@3a00940, let me know if it is not.

Still have same issue, not all channel feed are being loaded, although i dont have this issue on this custom instance.

https://pipedus.palash.dev

[FireMasterK]

Still have same issue, not all channel feed are being loaded

Only new videos uploaded from 6 hours back would be updated in the feed, this is due to the nature of how PubSub works.

Let me know if this happens on new uploads from now.

[EsmailELBoBDev2]

@FireMasterK out of context issue, I noticed piped instance and login (I guess db) sometimes disconnect and I can't login without restart the whole instance so do I need to restart it every hour like invidious?

about feed because what happened, my sync stopped 3 days ago and now I'm waiting it to pull new videos and tell you it worked or no

[EsmailELBoBDev2]

I have to visit each channel to get new videos in my feed, weird behavior

Is there a command or way to force it to fetch updates from yt?

[EsmailELBoBDev2]

still do not work, as you see in these pics, in freetube it detected it but in piped I had to visit the channel to make it appear in my feed

[FireMasterK]

Is there any logs that you can provide? run docker-compose logs piped-backend
The pubsub debug shows that there has been no attempts to subscribe to feed updated for over a month (!!!)
Could you also provide you instance's config.properties file? Just ensure to redact any database information

See: https://pubsubhubbub.appspot.com/subscription-details?hub.callback=https%3A%2F%2Fpipedapi.esmailelbob.xyz%2Fwebhooks%2Fpubsub&hub.topic=https%3A%2F%2Fwww.youtube.com%2Fxml%2Ffeeds%2Fvideos.xml%3Fchannel_id%3DUCadoKaQadkmNZg-MymcKWqg&hub.secret=

[EsmailELBoBDev2]

Im away from my pc so excuse my werid english

Umm weidly enoguh, i get ERROR: No such service: piped-backend so hmmm

And my config file

# The port to Listen on.
PORT: 8080

# The number of workers to use for the server
HTTP_WORKERS: 2

# Proxy
PROXY_PART: https://pipedproxy.esmailelbob.xyz

# Outgoing HTTP Proxy - eg: 127.0.0.1:8118
#HTTP_PROXY: 127.0.0.1:8118

# Captcha Parameters
CAPTCHA_BASE_URL: https://api.capmonster.cloud/
CAPTCHA_API_KEY: INSERT_HERE

# Public API URL
API_URL: https://pipedapi.esmailelbob.xyz

# Public Frontend URL
FRONTEND_URL: https://piped.esmailelbob.xyz

# Enable haveibeenpwned compromised password API
COMPROMISED_PASSWORD_CHECK: false

# Disable Registration
DISABLE_REGISTRATION: true

# Feed Retention Time in Days
FEED_RETENTION: 30

# Hibernate properties
hibernate.connection.url: jdbc:postgresql://postgres:5432/piped
hibernate.connection.driver_class: org.postgresql.Driver
hibernate.dialect: org.hibernate.dialect.PostgreSQL10Dialect
hibernate.connection.username: piped
hibernate.connection.password: donotchangeme

[FireMasterK]

Umm weidly enoguh, i get ERROR: No such service: piped-backend so hmmm

Try copying the name of the container from docker ps and replace it in the docker logs command.

[EsmailELBoBDev2]

Hmm, i have piped backend running but i cant access its logs, it throws same error

[FireMasterK]

Nvm, you have to run docker logs piped-backend, not docker-compose, my bad!

[EsmailELBoBDev2]

Ohhhhh 😂

Amyways i cant provide logs as im on phone and cant copy logs and when i send them to commandline pastebin it sends different output