New and generic scrape algorithm #11

Merged

SoXX merged 20 commits from dev/algorithm into main

2024-11-01 21:39:21 +00:00

Author	SHA1	Message	Date
SoXX	af0dc2ab0d	fix: variable userSource.UserID to userSource.AccountID for clarity All checks were successful Gitea Build Check / Build (push) Successful in 39s Details Gitea Build Check / Build (pull_request) Successful in 38s Details	2024-11-01 22:34:43 +01:00
SoXX	ffd3767f32	fix: error when userID is empty All checks were successful Gitea Build Check / Build (push) Successful in 37s Details Gitea Build Check / Build (pull_request) Successful in 36s Details - a error could happen if the user dose not have a source UserID/UserName set	2024-11-01 22:29:09 +01:00
SoXX	282e769c13	fix: unused variable warning in post-processing loop All checks were successful Gitea Build Check / Build (push) Successful in 39s Details Gitea Build Check / Build (pull_request) Successful in 38s Details	2024-11-01 22:15:43 +01:00
SoXX	4d209f2a90	fix: favorites creation timestamps and remove duplicate imports Some checks failed Gitea Build Check / Build (push) Failing after 25s Details Gitea Build Check / Build (pull_request) Failing after 24s Details	2024-11-01 22:14:29 +01:00
SoXX	0224a43736	Merge branch 'dev/algorithm' of git.anthrove.art:Anthrove/plug-sdk into dev/algorithm All checks were successful Gitea Build Check / Build (push) Successful in 38s Details Gitea Build Check / Build (pull_request) Successful in 38s Details	2024-11-01 21:43:00 +01:00
SoXX	3da2501459	Fix: variable name typo from anthroveFaves to pageAnthroveFaves	2024-11-01 21:42:16 +01:00
SoXX	0c0d8451c6	fix: Remove redundant break statement in taskSummery block All checks were successful Gitea Build Check / Build (push) Successful in 40s Details Gitea Build Check / Build (pull_request) Successful in 40s Details	2024-11-01 21:29:28 +01:00
SoXX	9d950cf31d	fix: comparison logic in algorithm to correctly break the loop All checks were successful Gitea Build Check / Build (push) Successful in 41s Details Gitea Build Check / Build (pull_request) Successful in 41s Details	2024-11-01 21:15:29 +01:00
SoXX	996ec30de1	fix: Remove unused BatchSummery return values in error cases All checks were successful Gitea Build Check / Build (push) Successful in 44s Details Gitea Build Check / Build (pull_request) Successful in 41s Details	2024-11-01 21:10:13 +01:00
SoXX	799f943650	refactor: improve readability and efficiency Some checks failed Gitea Build Check / Build (push) Failing after 31s Details Gitea Build Check / Build (pull_request) Failing after 27s Details - Remove nested for loop and redundant checks - Streamline error handling and logging - Rename getAnthrovePost to getAnthrovePostReferences for clarity - Simplify BatchPostProcessingWithSummery to return only necessary values	2024-11-01 21:06:03 +01:00
SoXX	16846c59c4	fix: variable scope and append results in BatchPostProcessing All checks were successful Gitea Build Check / Build (push) Successful in 54s Details Gitea Build Check / Build (pull_request) Successful in 56s Details	2024-10-28 21:33:45 +01:00
SoXX	263d65adc1	fix: Fix conditional check for anthroveFaves length All checks were successful Gitea Build Check / Build (push) Successful in 59s Details Gitea Build Check / Build (pull_request) Successful in 56s Details	2024-10-28 21:29:25 +01:00
SoXX	44137a7251	feat: Add tracing events and logging for batch processing steps All checks were successful Gitea Build Check / Build (push) Successful in 58s Details Gitea Build Check / Build (pull_request) Successful in 57s Details	2024-10-28 21:08:54 +01:00
SoXX	b2db0664d6	feat: start implementing new algorithm All checks were successful Gitea Build Check / Build (push) Successful in 1m2s Details Gitea Build Check / Build (pull_request) Successful in 1m4s Details	2024-10-26 23:13:24 +02:00
SoXX	1435ae8ea4	refactor: Rename SetTaskExecutionFunction to RegisterPlugInterface for clarity and add docstring All checks were successful Gitea Build Check / Build (push) Successful in 53s Details Gitea Build Check / Build (pull_request) Successful in 54s Details	2024-10-26 21:31:27 +02:00
SoXX	376d7ba75d	feat: implemented generic algorithm All checks were successful Gitea Build Check / Build (push) Successful in 57s Details Gitea Build Check / Build (pull_request) Successful in 55s Details	2024-10-26 21:15:02 +02:00
SoXX	36d6ecd873	fix: Remove redundant error logging and tracing in TaskStart function All checks were successful Gitea Build Check / Build (push) Successful in 56s Details	2024-10-26 20:36:43 +02:00
SoXX	408c977432	fix: nil pointer for DB All checks were successful Gitea Build Check / Build (push) Successful in 57s Details	2024-10-26 20:30:12 +02:00
SoXX	107a317095	fix: Capitalize struct fields for public access All checks were successful Gitea Build Check / Build (push) Successful in 1m2s Details	2024-10-25 22:46:22 +02:00
SoXX	41882b9bfb	feat: Refactor task execution to use Plug interface and update algorithm implementation All checks were successful Gitea Build Check / Build (push) Successful in 1m3s Details	2024-10-25 22:33:13 +02:00

New and generic scrape algorithm #11

20 Commits