Commit Graph

45 Commits

Author SHA1 Message Date
Mattéo Delabre 6f7852eedb
openalex: Handle missing primary location dict 2023-07-23 12:07:04 +02:00
Mattéo Delabre beb0cfeec9
openalex: Ignore unknown author names 2023-05-13 12:50:48 -04:00
Mattéo Delabre 2f8f7f1804
openalex: Create endpoint 2023-05-13 12:35:40 -04:00
Mattéo Delabre 23c2b4b664
youtube: Filter out YouTube Shorts from feeds 2023-05-13 00:42:10 -04:00
Mattéo Delabre f22a758e2e
twitch: Exclude highlights and only use stream_id for archives 2021-09-13 15:33:35 +02:00
Mattéo Delabre 90858fbf7b
youtube: Handle missing uploads playlist 2021-09-13 11:01:26 +02:00
Mattéo Delabre 20c3d12331
twitch, youtube: Lengthen user profile TTL 2021-09-13 00:22:20 +02:00
Mattéo Delabre ed35201a22
youtube: Fix references to twitch module 2021-09-13 00:19:15 +02:00
Mattéo Delabre efdbd0fdb2
youtube: Don’t fail if default thumb size is missing 2021-09-13 00:06:59 +02:00
Mattéo Delabre 527077fab4
Add youtube endpoint 2021-09-13 00:00:24 +02:00
Mattéo Delabre 33d10c20a1
Revert "Make app object easily accessible from gunicorn"
This reverts commit 6e25af03c4.
2021-09-12 22:39:23 +02:00
Mattéo Delabre 6e25af03c4
Make app object easily accessible from gunicorn 2021-09-12 15:52:30 +02:00
Mattéo Delabre 9c1aa9d346
Code cleanup and make service generic 2021-09-12 15:42:57 +02:00
Mattéo Delabre 031671f94a
Add requirements.txt 2021-09-10 18:38:30 +02:00
Mattia Di Eleuterio 70b27b87eb implemented new helix twitch API support 2021-08-16 14:11:54 +02:00
Laszlo Zeke 9470cc1fd5 Add a note about caching in README.md 2021-02-26 20:06:34 +01:00
Laszlo Zeke 58e1421262 Bump cache sizes again 2020-09-04 23:13:07 +02:00
Laszlo Zeke f8321aea0d Implemented gzip compression
Also rewritten fetch gzip logic.
2020-09-04 23:11:44 +02:00
Laszlo Zeke e8f89e9d44 Update README link to python 3 GAE docs 2020-09-04 22:39:11 +02:00
Laszlo Zeke e303af090d Tune performance
- Added threading to gunicorn instance
- Changed cache to cachetools's TTL cache since it uses LRU if
the cache is full
- Increased cache sizes 1.5x
2020-09-04 22:36:19 +02:00
Laszlo Zeke 5fccffc2f0 Migrate application to python3
Notables:
- Python 3 migration
- The client id is now set via environment variable instead of
hardcoding it in a py file
- Using Flask instead of web2
- Migrate away from Memcache (Google depeciated it in py3) to
an in-memory data structure
- Moved landing page to static serving
2020-09-04 19:42:42 +02:00
Laszlo Zeke fc67ccba75 Disable autoscaling in GCP config
GAE regularly keeps an idle instance alive just in case but
that seems to count towards the instance hours quota. Disable
that to avoid being instanceless for a few hours a day.
2020-09-04 14:14:01 +02:00
Laszlo Zeke 246ae47c80 Allow down to 2 char IDs 2019-06-17 20:12:00 +02:00
Laszlo Zeke 8b3b098166
Merge pull request #8 from pngwjpgh/feat/game-description
Add game played to item description
2018-10-04 22:36:37 +02:00
Gregor Kleen 3d45961b16 Add game played to item description 2018-06-13 01:35:13 +02:00
Laszlo Zeke 226c4012f8 Bump fetched videos to 10 2018-04-03 12:30:54 +02:00
Laszlo Zeke 842da0100a Use gzipped fetches from twitch 2018-04-03 00:05:49 +02:00
Laszlo Zeke ba12777444 Add /vodonly to omit ongoing streams from results 2018-04-02 23:56:03 +02:00
Laszlo Zeke 8944c521f7 Increase vod data cache lifetime to 10 mins 2017-07-26 00:59:52 +02:00
Laszlo Zeke 53da7045d9 Limiting feed to the newest 5 items instead of 10
GAE started counting UrlFetches to the free quota of incoming bandwith
and this made the app go over it's daily limit. Limited to only 50%
should be able to keep it under limit but users may miss some new
content if they arrive in burst or clients don't update frequently.
2017-07-20 11:40:32 +02:00
Laszlo Zeke 4555518112 Changing Content-Type to be RSS2.0 compliant 2017-04-02 21:18:28 +02:00
Laszlo Zeke 620f4c3d20 Setting isPermaLink attrib to false when the guid is not a link 2017-04-02 21:11:10 +02:00
Laszlo Zeke 00b1cbdb1d Fixing ttl tag
The ttl tag should be associated with channel object rather than the
item. See
https://validator.w3.org/feed/docs/rss2.html#ltttlgtSubelementOfLtchannelgt
2017-04-02 20:17:47 +02:00
Laszlo Zeke c69fda0fbc Fixing RFC-822 compatibility 2017-04-02 20:12:23 +02:00
Laszlo Zeke 248aeca9ab Separating client id from app code 2017-04-02 20:02:23 +02:00
Laszlo Zeke 100a24bd77 Adding category to live stream items 2017-04-01 22:14:06 +02:00
Laszlo Zeke 36aa75b967 Merge pull request #1 from pngwjpgh/feat/category
Set feed item category to broadcast type
2017-04-01 22:00:41 +02:00
Gregor Kleen ee43b3f675 Set feed item category to broadcast type 2017-03-31 18:10:16 +02:00
Laszlo Zeke cd31a1a8bf Added mechanism retry for url fetch 2017-01-27 23:11:29 +01:00
Laszlo Zeke 34de0cb7e5 Add support for HEAD 2017-01-21 21:35:22 +01:00
Laszlo Zeke cbb5c654c5 Support for v5 twitch api
-Using v5 Twitch API
-Caching for userids
-Using the largest thumbnail available
-Adding description if available
-Changed feed date to creation time
-Changed feed title to use display name
-Some extra error handling + cleanup
2017-01-21 20:13:40 +01:00
Laszlo Zeke 1a69557460 Adding Client_ID to requests 2016-06-04 00:58:43 +02:00
Laszlo Zeke 07518aaa60 Title for live content 2015-10-10 12:30:39 +02:00
Laszlo Zeke 66c83f82d8 Initial commit 2015-10-10 00:43:29 +02:00
Laszlo Zeke 3f88b5dd52 💥🐫 Added .gitattributes & .gitignore files 2015-10-10 00:06:24 +02:00