Commit Graph

68 Commits

Author SHA1 Message Date
a686b5956f feat: Add source URLs to batch post processing and update database query
All checks were successful
Gitea Build Check / Build (pull_request) Successful in 45s
Gitea Build Check / Build (push) Successful in 42s
2024-11-08 15:50:21 +01:00
0919b0bb15 chore(dependencies): update to latest otter-space-sdk
All checks were successful
Gitea Build Check / Build (push) Successful in 46s
Gitea Build Check / Build (pull_request) Successful in 44s
2024-11-06 13:39:30 +01:00
af0dc2ab0d fix: variable userSource.UserID to userSource.AccountID for clarity
All checks were successful
Gitea Build Check / Build (push) Successful in 39s
Gitea Build Check / Build (pull_request) Successful in 38s
2024-11-01 22:34:43 +01:00
ffd3767f32 fix: error when userID is empty
All checks were successful
Gitea Build Check / Build (push) Successful in 37s
Gitea Build Check / Build (pull_request) Successful in 36s
- a error could happen if the user dose not have a source UserID/UserName set
2024-11-01 22:29:09 +01:00
282e769c13 fix: unused variable warning in post-processing loop
All checks were successful
Gitea Build Check / Build (push) Successful in 39s
Gitea Build Check / Build (pull_request) Successful in 38s
2024-11-01 22:15:43 +01:00
4d209f2a90 fix: favorites creation timestamps and remove duplicate imports
Some checks failed
Gitea Build Check / Build (push) Failing after 25s
Gitea Build Check / Build (pull_request) Failing after 24s
2024-11-01 22:14:29 +01:00
3da2501459 Fix: variable name typo from anthroveFaves to pageAnthroveFaves 2024-11-01 21:42:16 +01:00
9d950cf31d fix: comparison logic in algorithm to correctly break the loop
All checks were successful
Gitea Build Check / Build (push) Successful in 41s
Gitea Build Check / Build (pull_request) Successful in 41s
2024-11-01 21:15:29 +01:00
996ec30de1 fix: Remove unused BatchSummery return values in error cases
All checks were successful
Gitea Build Check / Build (push) Successful in 44s
Gitea Build Check / Build (pull_request) Successful in 41s
2024-11-01 21:10:13 +01:00
799f943650 refactor: improve readability and efficiency
Some checks failed
Gitea Build Check / Build (push) Failing after 31s
Gitea Build Check / Build (pull_request) Failing after 27s
- Remove nested for loop and redundant checks
- Streamline error handling and logging
- Rename getAnthrovePost to getAnthrovePostReferences for clarity
- Simplify BatchPostProcessingWithSummery to return only necessary values
2024-11-01 21:06:03 +01:00
16846c59c4 fix: variable scope and append results in BatchPostProcessing
All checks were successful
Gitea Build Check / Build (push) Successful in 54s
Gitea Build Check / Build (pull_request) Successful in 56s
2024-10-28 21:33:45 +01:00
263d65adc1 fix: Fix conditional check for anthroveFaves length
All checks were successful
Gitea Build Check / Build (push) Successful in 59s
Gitea Build Check / Build (pull_request) Successful in 56s
2024-10-28 21:29:25 +01:00
44137a7251 feat: Add tracing events and logging for batch processing steps
All checks were successful
Gitea Build Check / Build (push) Successful in 58s
Gitea Build Check / Build (pull_request) Successful in 57s
2024-10-28 21:08:54 +01:00
b2db0664d6 feat: start implementing new algorithm
All checks were successful
Gitea Build Check / Build (push) Successful in 1m2s
Gitea Build Check / Build (pull_request) Successful in 1m4s
2024-10-26 23:13:24 +02:00
1435ae8ea4 refactor: Rename SetTaskExecutionFunction to RegisterPlugInterface for clarity and add docstring
All checks were successful
Gitea Build Check / Build (push) Successful in 53s
Gitea Build Check / Build (pull_request) Successful in 54s
2024-10-26 21:31:27 +02:00
376d7ba75d feat: implemented generic algorithm
All checks were successful
Gitea Build Check / Build (push) Successful in 57s
Gitea Build Check / Build (pull_request) Successful in 55s
2024-10-26 21:15:02 +02:00
36d6ecd873 fix: Remove redundant error logging and tracing in TaskStart function
All checks were successful
Gitea Build Check / Build (push) Successful in 56s
2024-10-26 20:36:43 +02:00
408c977432 fix: nil pointer for DB
All checks were successful
Gitea Build Check / Build (push) Successful in 57s
2024-10-26 20:30:12 +02:00
107a317095 fix: Capitalize struct fields for public access
All checks were successful
Gitea Build Check / Build (push) Successful in 1m2s
2024-10-25 22:46:22 +02:00
41882b9bfb feat: Refactor task execution to use Plug interface and update algorithm implementation
All checks were successful
Gitea Build Check / Build (push) Successful in 1m3s
2024-10-25 22:33:13 +02:00
684d52d64c feat: pumped SDK version to 4.0.0
All checks were successful
Gitea Build Check / Build (push) Successful in 58s
Gitea Build Check / Build (pull_request) Successful in 58s
2024-10-16 12:20:21 +02:00
a99c4457d2 fix: Handle multiple error returns in TaskStart by joining errors
All checks were successful
Gitea Build Check / Build (push) Successful in 58s
Gitea Build Check / Build (pull_request) Successful in 58s
2024-10-16 12:12:20 +02:00
cc2b0374da fix: Refactor error handling by introducing errorString function to check for nil errors
All checks were successful
Gitea Build Check / Build (push) Successful in 59s
Gitea Build Check / Build (pull_request) Successful in 59s
2024-10-16 10:22:35 +02:00
2707806a08 feat: Update scrape history on task failure and completion
All checks were successful
Gitea Build Check / Build (push) Successful in 56s
2024-10-16 10:11:00 +02:00
22b0edabfe fix(grpc): force ID length to 25 chars
All checks were successful
Gitea Build Check / Build (push) Successful in 59s
2024-10-16 09:47:48 +02:00
9de22d3176 feat: Add ScrapeHistory tracking and refactor task execution return type
All checks were successful
Gitea Build Check / Build (push) Successful in 58s
- Add `ScrapeHistory` record creation and update during task execution
- Modify `TaskExecution` function to return `TaskSummery` instead of using a cancel function
- Reintroduce and move `removeTask` function for cleanup after task execution
2024-10-15 16:08:34 +02:00
38cecba455 fix(grpc): spelling
All checks were successful
Gitea Build Check / Build (push) Successful in 48s
Gitea Build Check / Build (pull_request) Successful in 50s
2024-09-04 14:56:27 +02:00
b497348d2a feat(grpc): add logging
All checks were successful
Gitea Build Check / Build (push) Successful in 51s
Gitea Build Check / Build (pull_request) Successful in 47s
2024-09-04 14:53:01 +02:00
2c8d6bd682 fix(grpc): get necessary information
All checks were successful
Gitea Build Check / Build (push) Successful in 51s
Gitea Build Check / Build (pull_request) Successful in 53s
getting data from database for the userSource
2024-09-04 14:17:00 +02:00
601ce9eae7 feat(grpc): added GetUserMessages & SendMessage
All checks were successful
Gitea Build Check / Build (push) Successful in 50s
Gitea Build Check / Build (pull_request) Successful in 53s
finalized first draft for the endpoint integration
2024-09-04 14:01:04 +02:00
42954c7cf1 feat(grpc): added ping
added ping function
2024-09-04 13:41:29 +02:00
909e84fe1c feat(grpc): added middleware
All checks were successful
Gitea Build Check / Build (push) Successful in 42s
Gitea Build Check / Build (pull_request) Successful in 44s
added the ability to receive otel data from clients
2024-08-30 15:20:32 +02:00
76174e3247 feat(dependencies): update to latest version
All checks were successful
Gitea Build Check / Build (push) Successful in 51s
Gitea Build Check / Build (pull_request) Successful in 51s
updated OtterSpaceSDK to v4.0.0
2024-08-29 15:26:58 +02:00
ea41bef942 fix: move before new context gets created
All checks were successful
Gitea Build Check / Build (push) Successful in 39s
Gitea Build Check / Build (pull_request) Successful in 47s
2024-08-27 14:21:33 +02:00
caef31f48f feat: Add validation check for user account before starting task
All checks were successful
Gitea Build Check / Build (push) Successful in 43s
Gitea Build Check / Build (pull_request) Successful in 45s
2024-08-27 14:17:31 +02:00
19b96e64e1 feat: added summery
All checks were successful
Gitea Build Check / Build (pull_request) Successful in 42s
Gitea Build Check / Build (push) Successful in 44s
- Introduce `BatchSummery` struct for post and favorite counts
- Add `BatchPostProcessingWithSummery` function to include summary
- Update error returns to include empty `BatchSummery` struct
2024-08-27 12:25:00 +02:00
969bc17737 feat(telemetry): added more info 2024-08-27 10:04:55 +02:00
942bbede1b feat(telemetry): added light logging 2024-08-27 09:56:52 +02:00
08e4364069 feat(telemetry): Integrate OpenTelemetry tracing into BatchPostProcessing function 2024-08-27 09:49:20 +02:00
0070352623 fix: upsertSource function
now returning the correct source after finding it or creating it
2024-08-27 09:35:25 +02:00
f708706d50 feat: Add batch post-processing functionality for scraping posts 2024-08-27 09:15:17 +02:00
7975791d9b chore: sort imports 2024-08-27 08:26:39 +02:00
ceba57ffd8 refactor: move source function to own function 2024-08-27 07:50:36 +02:00
23bae0a5f8 refactor: move object functions to own ones 2024-08-27 07:45:30 +02:00
c0f069b3c0 refactor: remove telemetry from getter and setter functions 2024-08-27 07:38:24 +02:00
311de674ba feat: listen function now has an own context and implemented an graceful stop 2024-08-27 07:37:19 +02:00
130f6928fc refactor: move otlp to custom file out of the scope from plug instance 2024-08-27 07:32:24 +02:00
7ce3b94756 feat: Assign new context with span context to address gRPC closure issue 2024-08-26 16:44:50 +02:00
426701f58c fix: context creation to use request context in TaskStart method 2024-08-26 16:38:14 +02:00
bef94becce feat: tracer initialization and add OTLP text map propagator setup 2024-08-26 16:33:40 +02:00