Timelapse, Keogram, Startrail not appearing on the local (PI) website

[ova103]

Hello

First of all wat a great website Allsky is. Thanks for all what you guys are doing.

I'm new to this all, first time I'm using a PI.

I have a PI 4, 4GB. Installed webUI succesfully. Website is also locally (on PI) installed. The current image appears correctly. I have the sidebar displayed. The information of the camera is displayed (on the right).

But no timelapse, mini-timelapse, keogram nor startrails. I know the files are made as I can see them in allsky/html/allsky

So what is going wrong? I put some screenshots here below. If you need more info please let me know.

Thanks for your support!

Olivier

(camera is just sitting on my desk for the moment)

[EricClaeys]

But no timelapse, mini-timelapse, keogram nor startrails.

What happens when you click on the icons on the left side? Try forcing a browser refresh by entering SHIFT-F5.

If that doesn't help, press F12 in your browser and go to the "Network" tab on the right, then refresh your browser. Files the browser can't find are in red.

Also, see if there are any errors in /var/log/lighttpd/error.log.

[ova103]

Hello Eric

Thanks for the feedback.

When I click on the icons on the left side nothing happens. Even after shift-F5. Only when clicking on the i-icon I got the info.
So that did not help.

But following your suggestion I pressed F12 and then refreshed browser with shift-F5. Now timelapse etc appears !

Ex below for timelapse:

So this worked also for Keogram and startails. Also when I close browser and I open it again it worked. Idem when I stop and restart Allsky. I also rebooted the PI and it still works. Great !

I just don't understand why it's working now ? What happened by pressing F12?

Hopefully it works tomorow and I see the files of the last 2 days.

The only thing that did not work is mini-timelapse. It did not appear. I just see the current picture

See below when I press F12

I don't know why. Can you find it out?

Thanks !

Olivier

[EricClaeys]

@ova103, the browser needed to be refreshed. Going into F12 disables the browser cache which forces a refresh. We see that from time to time. It's not an Allsky issue as far as I can tell.

In your configuration.json file, go to the section for the mini-timelapse. You should have this:

[ova103]

Hello

"current/tmp/mini-timelapse.mp4" did not work.
But it worked with "mini-timelapse.mp4".

One more issue, maybe to do with the browser cache as you mentionned before. Today (so a new day) the newly created timelapse did not appear, not the Keogram nor the startrail. I did F12 and shift F5 and it appeared.

So how could I avoid this issue for the next time?

Thanks.

[EricClaeys]

@ova103, did you use current/tmp/mini-timelapse.mp4 or /current/tmp/mini-timelapse.mp4? You need an initial /.

When you press the timelapse, keogram, or startrails icons on the Website home page, what do you see?

[ova103]

Hello

I tried again with the inital "/"

It does not work. This is where it points to: http://allsky.local/current/tmp/mini-timelapse.mp4
That's nok, right?
If I remove the current then I got error 404 not found.

For info, the timelapse points to http://allsky.local/allsky/videos/
This is working.

On this question:
When you press the timelapse, keogram, or startrails icons on the Website home page, what do you see?

This is something I need to do at the start of a new day. So this morning I saw the timelapse, keogram, .. of the 2nd previous day but not the one of the latest night. Cannot show it again as it works now. Will show it tomorow when new files are created.

Thanks.

[ova103]

Hello,

A new day, so like said yesterday I will check if the latest data appears on the website and if not send you the screenshot.

So it does not appear op the local website when I'm on the PI, nor on the desktop, nor on my phone (they are all pointing to the local website on the PI)

Here screenshot when I'm on the PI:

Idem on the desktop but with an addtional issue on json file.

Idem on the phone (did not make screenshots)

But when I press shift F5 (or if I refresh the website address) the data of last night appears (and the issue of json file on desktop PC dissapears).
But I need to do refresh as well for timelapse, Keogram and startrails. So 3 times on each machine.
No need to press F12

Why is data not appearing immediatly?
Any idea why this happens and how to solve it?

Thanks for your help

[EricClaeys]

For the mini-timelapse problem, try F12 with it. The URL is correct. /current points to ~/allsky.

The data.json error is also due to browser caching.

Is your Pi showing the same time as your PC?

Please attach /etc/lighttpd/lighttpd.conf. You will need to append .txt to its name.

Also, try leaving a browser window open while in F12 mode. and tomorrow do a normal CTRL-R refresh of the window to see if that works.

[ova103]

Hello Eric,

Thanks.

My PI is showing same time as on PC (at least within 1 second)

Please find attached the /etc/lighttpd/lighttpd.conf

lighttpd.txt

For info, I did not run the allsky yesterday, but will do today untill tomorow, with browser window open while in F12 mode.

Thanks again.

[EricClaeys]

@Alex-developer, any ideas? His /etc/lighttpd/lighttpd.conf file is correct. Can you take a look at the file starting on line 34? I believe it's caching the allsky/{videos|startrails|keograms} files, which I think is opposite to what we want, right?
Not sure why other people aren't having this problem...

[Alex-developer]

It will catch everything apart from urls starting current and json files

I presume you have checked permissions?

[ova103]

Hello

as requested yesterday (try leaving a browser window open while in F12 mode. and tomorrow do a normal CTRL-R refresh of the window to see if that works.)

I thaught I had left while in F12 mode, but when I logged in it was not in F12 ...

Here are the screenshots:

Life image: this is ok, it's the most recent image

Minitimelapse: it worked ok.

timelapse: NOK

after ctr-r: it works

Keogram NOK

after ctr-r: it works

startrails: idem, no screenshots

The question of alex (§I presume you have checked permissions?): I suppose it's directed to you, not to me (I don't know what to anwer here).

Thanks.

[EricClaeys]

@ova103, try the attached file. Do this:

cd ~/allsky/tmp
# Save the attached file to the current directory and rename to lighttpd.conf
cd /etc/lighttpd
sudo systemctl stop lighttpd
sudo mv lighttpd.conf lighttpd.conf-SAVED
sudo cp ~/allsky/tmp/lighttpd.conf .
cd /var/log/lighttpd
sudo rm error.log
sudo systemctl start lighttpd
cat error.log            # Should only have a line about starting

Go to the Website home page and press F12 and tell it to "Disable cache". Refresh the page and then turn off "Disable cache".
Try the videos, startrails, and keograms buttons. The videos/, startrails/, and keograms/ entries in F12 should have a size. If so, that means it didn't cache those pages.

Eric
lighttpd.txt

[ova103]

Hello

I've done what you described:

Save the attached file to the current directory and rename to lighttpd.conf
--> in fact, I renamed it to .conf on my desktop PCa and then copied to ~/allsky/tmp. I guess that is ok.

Then I done all the commands. See errorlog output, indeed just one line about starting.

then went to home page, F12, went into configuraiton and disabled cache there. Left F12 open, refresh by CTR R. Click on videos button,

See entries in F12 - I don't see a size:

Then I did it again as I saw a button disabled cache at the top of the F12 screen, under Network.
--> home page, F12, disabled cache . Left F12 open, refresh by shift F5 (instead of CTR R) . Click on videos button,

See entries in F12 - I don't see a size- and everything is in the cache now.

I guess it's nok I we don't see the size ... ?

BTW: I checked the lighttpd.conf (in /etc/lighttpd) and it's indeed the one you attached at your previous reply.

Thanks.

[EricClaeys]

Please double check /etc/lighttpd/lighttpd.conf to make sure it's the same as what I posted, then run

sudo systemctl stop lighttpd
sudo systemctl start lighttpd

The version I posted tells your browser not to cache anything in videos, startrails, or keograms. F12 should then always show a size for those, and not "(disk cache)", which means it's using the cached version that doesn't have the new images.

Are you sure you checked the "Disable cache" button in F12? I don't see it checked in any of your screenshots.

Another thing to try: in configuration.json", append a /` to the url for "videos", "startrails", and "keograms" so they look like "videos/". That will eliminate the first network entry in F12.

[ova103]

Hello

I copied again your version of lighttpd.txt into the right destination. I know it's the right file as I have added a comment in the modified file. When I'm opening the file in etc/lighttpd I can see that comment (on first line):

I added / to the the url's in configuration.json

I open the home page and press F12.
I ticked the "disable cache" button - see screenshot . Is this ok??

I refresh the page shift F5 and untick the "disable cache" button.
I'm still on home page:

I click on videos - I don't see the size in window of F12:

But if I refresh the video page and now I see the size

I think it's still nok, right?

[EricClaeys]

I don't think it's working correctly. The videos/ file should never come from "(disk cache)" so it should always have a size. After you have been to the page once, subsequent visits should cache the other files.

Please click on the "videos/" line in F12. That should add some information about "headers". Can you attach a screenshot of the header info?
Then click on some of the cached entries. Do any of them have a "max-age" of 31536001 ? If so, it's using the file I gave you.

[ova103]

Hello

Here is screenshot when I click on video line in F12

Screenshot when I click on a cached entry. yes it has ithas a max age of 31536001

idem for allmin.js and allsky.css

But I don't find max age of ... on the jpg

[EricClaeys]

It looks like it's working now. The max-age is how many seconds before the page expires - 31536001 seconds is a year.
Un-cached entries have this:

The "Response Headers" are what the web pages sends to your browser. In the screenshot it's telling your browser not to cache the page.
The rule that I set up in the lighttpd.conf file says not to cache an item if the URL has "videos" in it, which includes the "videos" directory as well as everything below it. Try the attached file - it does not cache the .jpg files since doing so would download them every time you visit the page, and that's a lot of network traffic.

lighttpd.txt

[ova103]

Hello

Great news. Thanks a lot.

I copied the file lightpd.txt. I'm sure it's the right file as I had added a comment to it (different than previous time).

But I still see this on the keogram:

Tried to find for myself what it could be by looking for differences in the files between video and keogram, but could not find it ...
Sorry for that

Edit: I justed look at the website (located on PI) but from my PC, I see this for video/trails/keogram:

so here keogram is ok. Not sure why it's different than when I'm looking from the PIO ...

For info I did not tick 'disable cach" on PC nor on PI

[EricClaeys]

You might have to Disable Cache in the Pi's browser.

[ova103]

Hello

It all worked fine today on the PI and on PC.

Thanks a lot Eric for all the support you have given to me.

My next step is to have access to the Allsky website when I'm not connected to my home network. Hopefully this will work fine;

Again, thanks a lot !

[EricClaeys]

That's good news. I'll close this Discussion item. If the problem crops up again please reopen this.
Eric