Commit Graph

45 Commits

Author SHA1 Message Date
Emilien Puget
cbe1201cbd removed golang x package in favour of the std lib 2024-07-08 10:13:23 -04:00
quobix
f32dd873fd added more coverage
Signed-off-by: quobix <dave@quobix.com>
2024-02-20 13:34:39 -05:00
quobix
2f82a69d6c A clean sweep around resolving during model builds.
Really hammering on this model using all available examples of crazy references used in crazy ways. The fixes mean I can delete the recent patch added to handle lost indexes.

I spent two days on this commit.

Signed-off-by: quobix <dave@quobix.com>
2024-02-20 13:34:39 -05:00
quobix
561396d85d fixed locked remote loader
This could be the last one!

Signed-off-by: quobix <dave@quobix.com>
2024-02-06 22:13:41 -05:00
quobix
1bf4bc9449 addressed test coverage
Signed-off-by: quobix <dave@quobix.com>
2024-02-03 10:33:36 -07:00
quobix
4a9f048ebe cleaned up remote file loader tests
The remote file loader is no longer going to care about anything other that explicit http links, trying to figure out where things should be loaded form using an overridden basepath and host is too complex of a usecase that I cannot be sure even exists.

Signed-off-by: quobix <dave@quobix.com>
2024-02-03 10:33:36 -07:00
quobix
a24c05036b Fixed runaway rolodex.
The rolodex was running away and locking up vacuum.

Signed-off-by: quobix <dave@quobix.com>
2024-02-03 10:33:36 -07:00
quobix
7026e83f7c adding in path overlap feature
discovered glitch when reworking test for pipeline

Signed-off-by: quobix <dave@quobix.com>
2024-01-18 15:11:39 -05:00
quobix
e699968768 Working through windows support 2024-01-18 15:11:39 -05:00
Tristan Cartledge
41557cebcb cleanup: add sync version of ExtractSpecInfoWithDocumentCheck 2023-12-07 12:57:46 +00:00
Tristan Cartledge
fac9a4b3b1 fix: attempted fix to infinite yaml parsing bug 2023-12-07 11:34:36 +00:00
quobix
8335db72e2 added coverage for fixed remote unsupported handler
Signed-off-by: quobix <dave@quobix.com>
2023-11-25 21:09:21 -05:00
quobix
a0d9204099 added logger check to remote loader
Signed-off-by: quobix <dave@quobix.com>
2023-11-25 21:09:21 -05:00
quobix
6082f3ccdc added correct error handling for unsupported remote files
Signed-off-by: quobix <dave@quobix.com>
2023-11-25 21:09:21 -05:00
quobix
af1ee6c620 added tests for file size and total files.
Signed-off-by: quobix <dave@quobix.com>
2023-11-25 21:09:21 -05:00
quobix
b2616dde29 updated remote loaders
Signed-off-by: quobix <dave@quobix.com>
2023-11-25 21:09:21 -05:00
quobix
0d76e517a5 disabling channel close, looks like it causes a panic.
Signed-off-by: quobix <dave@quobix.com>
2023-11-25 10:10:51 -05:00
quobix
aada30d83c looking for leaks
Signed-off-by: quobix <dave@quobix.com>
2023-11-25 10:10:51 -05:00
quobix
f56cdeae9e Tuned up local file handling and cleaned things up
Signed-off-by: quobix <dave@quobix.com>
2023-11-25 10:10:51 -05:00
quobix
745142d9e0 Fixed logic and test failure
Signed-off-by: quobix <dave@quobix.com>
2023-11-17 16:44:01 -05:00
quobix
af5cb775aa Stop the remote FS from looking up local files
added [empty] to represent literally empty refs

Signed-off-by: quobix <dave@quobix.com>
2023-11-17 16:44:01 -05:00
quobix
f3094d0b14 Cleanup, sweep-up and tuneup
Signed-off-by: quobix <dave@quobix.com>
2023-11-04 09:38:33 -04:00
quobix
80b2b2d0b5 More cleaning and added docs.
We’re ready for review

Signed-off-by: quobix <dave@quobix.com>
2023-11-01 16:14:11 -04:00
quobix
276c3959fd Changed remote loader to use a timeout
rather than a hard block, it will wait 50ms then try again, regardless of cores, so it won’t ever block fully.

Signed-off-by: quobix <dave@quobix.com>
2023-11-01 14:29:52 -04:00
quobix
d096163f0e Deleting old code that cannot be run anymore.
Signed-off-by: quobix <dave@quobix.com>
2023-11-01 14:04:13 -04:00
quobix
2bc3c67776 Removed some dead code that does not need to exist
A consequence of the old index design, now gone

Signed-off-by: quobix <dave@quobix.com>
2023-11-01 13:07:53 -04:00
quobix
97659f2244 rolodex remote loader coverage at 100%
Signed-off-by: quobix <dave@quobix.com>
2023-11-01 10:58:34 -04:00
quobix
fec99623f3 ensuring we capture empty responses
Signed-off-by: quobix <dave@quobix.com>
2023-10-31 15:44:29 -04:00
quobix
8f3f568e5f Tuned some glitches with v3 doc creation.
all covered now

Signed-off-by: quobix <dave@quobix.com>
2023-10-31 15:31:19 -04:00
quobix
fde9ede4ac Working through more coverage
adding more tests.

Signed-off-by: quobix <dave@quobix.com>
2023-10-31 08:25:56 -04:00
quobix
d8dfafd0a4 Working through test cases
There are still gaps to be found based on various combinations of crazy references.

Signed-off-by: quobix <dave@quobix.com>
2023-10-30 10:03:02 -04:00
quobix
a87d9236d8 bumping test coverage
more to go, more cleaning inbound also

Signed-off-by: quobix <dave@quobix.com>
2023-10-25 08:09:33 -04:00
quobix
b82b46eb02 Pipeline is failing because it’s hanging somewhere
cannot re-create the problem locally, even when setting GOMAXPROCS to 1

Signed-off-by: quobix <dave@quobix.com>
2023-10-24 18:17:15 -04:00
quobix
e26897d8a1 Updated logic to handle a single core
The remote loader was blocking the only thread.

Signed-off-by: quobix <dave@quobix.com>
2023-10-24 17:54:02 -04:00
quobix
8717b3cd33 An enormous amount of surgery on the low level model.
Every `Build()` method now requires a `context.Context`. This is so the rolodex knows where to resolve from when locating relative links. Without knowing where we are, there is no way to resolve anything. This new mechanism allows the model to recurse across as many files as required to locate references, without loosing track of where we are in the process.

Signed-off-by: quobix <dave@quobix.com>
2023-10-23 15:04:34 -04:00
quobix
3bf830c2b3 Another round of cleaning.
Signed-off-by: quobix <dave@quobix.com>
2023-10-21 18:41:53 -04:00
quobix
28047d08d2 First sweep at cleaning up dead code
first round of a number I am sure, lots to clean.

Signed-off-by: quobix <dave@quobix.com>
2023-10-21 18:26:21 -04:00
quobix
be7e477529 index tests all pass! now time to clean.
Signed-off-by: quobix <dave@quobix.com>
2023-10-21 17:29:53 -04:00
quobix
bf270d3d2b whacking the shit out of exploded use-cases
Before everything worked, but was completely accurate, now everything works and everything is absolute and can be resolved. Phew, what a mission!

Signed-off-by: quobix <dave@quobix.com>
2023-10-21 14:14:49 -04:00
quobix
b295e8fd5c bashing through usecases and updating tests as we go.
so many things that can go wrong. have to catch them all.

Signed-off-by: quobix <dave@quobix.com>
2023-10-19 15:18:33 -04:00
quobix
054103b733 working through logging now and further tests
starting the circle dance now.

Signed-off-by: quobix <dave@quobix.com>
2023-10-18 17:27:56 -04:00
quobix
9ee1afe1f3 digital ocean now running correctly
Sucking in all the files!

Signed-off-by: quobix <dave@quobix.com>
2023-10-18 16:52:32 -04:00
quobix
51971762a9 Another massive surgical strike with the rolodex and index reshuffle.
Signed-off-by: quobix <dave@quobix.com>
2023-10-18 09:29:26 -04:00
quobix
de85651414 Performing some major surgery on the index
To make this work correctly, this needs completely shaking up and a transfer of ownership. The index is now local,
the rolodex is now global.

Signed-off-by: quobix <dave@quobix.com>
2023-10-13 15:51:41 -04:00
quobix
81902efddc working through rolodex build
Signed-off-by: quobix <dave@quobix.com>
2023-10-12 17:32:04 -04:00