schmittlauch/Hash2Pub
1
0
Fork 1
Code Issues 47 Pull requests Releases Wiki Activity
316 commits 7 branches 1 tag 5.2 MiB
Commit graph

316 commits

This branch
This branch
All branches
Author SHA1 Message Date
Trolli Schmittlauch 9d8df6d3d8 make the multithread-runtime use all cores by default 2020-10-02 02:36:02 +02:00
Trolli Schmittlauch d7355aa04d increase HTTP timeout for initial post publication to 60 seconds 
After a while, experiments made some publication events time-out.
Increasing the timeout just in case, although it i likely to be a mere symptom but the core fault.
 2020-09-22 19:47:39 +02:00
Trolli Schmittlauch d8b2186016 make inclusion of HIE overlay conditional as well 2020-09-21 22:16:02 +02:00
Trolli Schmittlauch b48b7a7bba Merge branch 'measurement_logging' into mainline 
closes #11, implements #60
 2020-09-17 02:19:04 +02:00
Trolli Schmittlauch eee40ce4fb add log messages for failed relays as well 2020-09-17 02:17:57 +02:00
Trolli Schmittlauch 556b69d887 increase subscription lease to 1 (simulated) day for achieving higher subscriber numbers 2020-09-16 16:07:39 +02:00
Trolli Schmittlauch f5de7601bb do not store published posts for reducing memory consumption 2020-09-16 13:49:26 +02:00
Trolli Schmittlauch a2f268d374 improve logging: line buffering, time stamps 
contributes to #60
 2020-09-16 01:54:50 +02:00
Trolli Schmittlauch bb17b136d6 increase stabilise interval 2020-09-16 01:54:40 +02:00
Trolli Schmittlauch c036dea7f9 periodically purge expired subscriptions 2020-09-14 15:49:44 +02:00
Trolli Schmittlauch a0e7142a7d report number of subscriptions 2020-09-14 14:57:25 +02:00
Trolli Schmittlauch 3c28cde942 catch and print all Socket bind exceptions 2020-09-12 15:45:03 +02:00
Trolli Schmittlauch 1fc264a226 manage logging via file handle 
reason: `appendFile` combined with lazy evaluation lead to exhaustion of
open file descriptors, as each file is opened again for each write and
due to lazy evaluation is kept open multiple times.
 2020-09-12 12:37:41 +02:00
Trolli Schmittlauch da579a0756 decrease logging verbosity 2020-09-11 00:39:14 +02:00
Trolli Schmittlauch e12d8ef70a properly format stats log numbers: no e-notation 2020-09-11 00:39:14 +02:00
Trolli Schmittlauch 0f9727c05a log the post rates instead of the absolute sums 2020-09-10 22:41:06 +02:00
Trolli Schmittlauch 34ecdd66e1 make stats measurement delay configurable, take speedup into account 2020-09-10 21:23:33 +02:00
Trolli Schmittlauch 8f917130c4 tag normalisation includes lower case conversion 2020-09-10 13:14:48 +02:00
Trolli Schmittlauch 3ac89d301c bugfix: subscribe as default if not subscribed yet, when posting to a tag 2020-09-10 13:14:23 +02:00
Trolli Schmittlauch 3c76544afb launch background worker threads 2020-09-10 12:00:17 +02:00
Trolli Schmittlauch f8d30d0cc4 report post fetches to statistics 2020-09-09 19:55:34 +02:00
Trolli Schmittlauch 620e998876 report incoming relay posts to statistics 2020-09-09 19:25:48 +02:00
Trolli Schmittlauch 85d10f6773 report published posts to statistics 2020-09-09 18:50:55 +02:00
Trolli Schmittlauch e3a8912360 process incoming posts in parallel 2020-09-09 18:50:45 +02:00
Trolli Schmittlauch 12fcd13754 annotate the PostService server/ request-handler functions 2020-09-09 18:01:51 +02:00
Trolli Schmittlauch 72eca0f4fe log metrics to file 
contributes to #60
 2020-09-09 17:22:20 +02:00
Trolli Schmittlauch 0ffe9effc0 refactor relay processing to STM-retry instead of busy-wait 2020-09-09 14:24:34 +02:00
Trolli Schmittlauch 2b39648a77 actually implement simple relaying of posts 
was still missing for #41
 2020-09-09 11:51:09 +02:00
Trolli Schmittlauch df479982fa make RingMap instance of Functor and Foldable 2020-09-08 08:46:36 +02:00
Trolli Schmittlauch c536994afe re-format Servant client pattern matching 2020-09-07 16:35:59 +02:00
Trolli Schmittlauch 5c338b9cd7 split up stats summing and evaluating, launch threads 2020-09-07 16:27:56 +02:00
Trolli Schmittlauch c823e6357a accumulate all statistic/ measurement events to a measurement summary 
- RingMap can now be mapped over
 2020-09-07 13:00:15 +02:00
Trolli Schmittlauch 6b166ac4ca fixup! Merge branch 'measurement_logging' into mainline 2020-09-07 10:32:58 +02:00
Trolli Schmittlauch 4d2d6faf1b Merge pull request 'Improve general readability' (#69) from Hecate/Hash2Pub:readability into mainline 
brings several readability enhancements:

- Text is always unqualified
- The Servant API declaration is moved to its own file
- Redundant imports are removed
 2020-09-05 16:27:23 +02:00
Hécate 7d833e064b Improve readability 2020-09-05 15:45:47 +02:00
Trolli Schmittlauch fa78c6fc43 clarify different nix-shell environments in readme 2020-09-05 15:01:46 +02:00
Hécate d3e5eac5c5 Unsused imports and syntax error 2020-09-05 12:41:18 +02:00
Trolli Schmittlauch 60f5780742 Merge branch 'measurement_logging' into mainline 
more values are parametrised through FediChordConfig
 2020-09-05 12:31:40 +02:00
Trolli Schmittlauch c9b0e66110 scale request timeout with speedup and pass it directly to function 2020-09-05 12:30:31 +02:00
Trolli Schmittlauch 4f08d33d2e make all delays configurable and scale them according to a speedup factor 2020-09-05 12:30:31 +02:00
Trolli Schmittlauch 20050654bc make passing bootstrap information optional 
reason: allow the first node to start without having to wait for a
timeout
part of #58
 2020-09-03 11:20:38 +02:00
Trolli Schmittlauch 59beb3441f instrumentation script executes the prepared schedule 
- reads CSV schedule from file
- sends the given schedule of post events
- not thoroughly tested yet

implements #59
 2020-09-02 21:37:01 +02:00
Trolli Schmittlauch 1aee41db88 enable compiler optimisation 2020-08-31 13:37:40 +02:00
Trolli Schmittlauch 3c1652d86d prototype instrumentation of periodically sending posts to a test setup of 3 nodes 
- contributes to #59
 2020-08-27 12:01:08 +02:00
Trolli Schmittlauch 1b5fc039b3 Merge branch 'fix_networking': fix some DHT joins and crashes 
several major flaws in the basic DHT communication had been discovered,
see individual commits for details
 2020-08-27 00:39:08 +02:00
Trolli Schmittlauch 1a962f1500 stylish run 2020-08-27 00:33:19 +02:00
Trolli Schmittlauch ab9d593a1b bugfix: fix wrong partial Response sender access 
- replaces improper record field access of `sender`, only existing in a
  Request, by `senderID` of a Response
- fixes the resulting exception-crash
- adds new function that enqueues a verification mark and timestamp bump
  of an existing cache entry
 2020-08-27 00:27:36 +02:00
Trolli Schmittlauch f1b15d5a9e bugfix: fix join by adding join node and waiting for it 
- additionally to adding neighbours of join node, add the join node
  itself as a neighbour as well
- wait for migrations from the node
 2020-08-26 17:43:32 +02:00
Trolli Schmittlauch fc8aa3e330 bugfix: properly process QueryID responses so FOUND is conserved 
fixes dproper discovery of announced responsibility by FOUND
 2020-08-25 22:01:01 +02:00
Trolli Schmittlauch b23201a49c Make key lookups fail after request exhaustion instead of providing default 
Returning the own node as a default does not make sense in all contexts:
Especially for bootstrap joining this can be harmful, so signalling
instead that the lookup failed makes distinguishing on a case by case
basis possible.

Also contributes to #57
 2020-08-25 12:51:33 +02:00