Caching Issues - Running out of Disk Space

There seems to be a couple of issues with caching the datasets:

The cache does not realize when the original dataset files have been updated. --overwrite_cache must be used in this case. Can we add a simple check for this as well?
Hash Error which causes tokenization to be rerun and multiple caches of same data:

of the transform datasets.arrow_dataset.Dataset._map_single couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.

This seems to be a known issue: https://github.com/huggingface/datasets/issues/4506#issuecomment-1157417219 It is happening in other versions as well not just 3.9. We may be able to resolve with an older version of dill: pip install "dill<0.3.5"

Datasets with overlapping files will be stored as multiple caches. This causes me to run out of disk space quickly. For example, if I have an experiment that uses NQ and another that uses NQ + List Data they will be separate caches with significant overlap.

Related known issue:  https://github.com/huggingface/datasets/issues/3847

Here is source code for datasets.fingerprints https://huggingface.co/docs/datasets/v1.12.0/_modules/datasets/fingerprint.html
See update_fingerprint() and finger_transform() functions.    The later has. a randomized_function arg that defaults to False.
There is a  Hasher class that accepts python objects as inputs.   The generate_fingerprint() method uses that.   If generate_fingerprint() fails (not clear why) the generate_random_fingerprint() is called.

Here's the message that indicates the custom Hasher is not being used.
Parameter 'function'=<function TyDiQAPreprocessor._rename_examples at 0x14f8cabd01f0> of the transform datasets.arrow_dataset.Dataset._map_single couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.


Fix code block language

Codecov Report

Merging #881 (d9a94ab) into main (4a30248) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main     #881   +/-   ##
=======================================
  Coverage   84.01%   84.01%
=======================================
  Files         378      378
  Lines       38166    38166
=======================================
  Hits        32065    32065
  Misses       6101     6101

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 4a30248...d9a94ab. Read the comment docs.


Add wait for packet to be relayed function to e2e tests

Summary
While writing the e2e tests for ics20, I noticed the relayer did not relay my packets before the next assertion came. This issue was solved by adding a .waitForBlocks call. Several blocks were required to be waited on. Instead of waiting for enough blocks to be committed for the relayer to relay the packet, we should wait on the packet to be relayed by. I guess this can be done by waiting for a block to be committed and then querying to see if the packet was relayed, otherwise wait for the next block. Any other ideas?

For Admin Use

[ ] Not duplicate issue
[ ] Appropriate labels applied
[ ] Appropriate contributors tagged/assigned

I think we could generalize this one step further and simply have a WaitForCondition(func() (bool, error)). This should be quite flexible and let us wait for arbitrary conditions to be met. We would also need to specify a timeout and some sort of polling interval.


[master] Float next window to be created on space

There are still some tiling issues with some applications preference windows (see #481 for an example). This could be solved by adding a command that makes the next window to be created on the current space floating when it spawns.
This way, you could create the following keybinding in khd:
cmd - , [ Safari ] -> : kwmc float-next-window

The existing command to toggle the float status of a window is kwmc window -t focused.
I have added kwmc window -t next to make the next window be treated as floating.

Would you prefer this 'flag' to reset upon a space-transition?

My only use case for the functionality is for pass-through cmd-, mapping, so I don't really mind either option. I think resetting upon transitioning feels more natural, though.
Thanks for implementing this! 👍

This fix has now been released. I ended up adding this to my .khdrc to fix the issue:
cmd - 0x2B [ Safari ] -> : kwmc window -t next


smoothing is done two times

https://github.com/neuropoly/spinalcordtoolbox/blob/master/scripts/sct_straighten_spinalcord.py#L284
https://github.com/neuropoly/spinalcordtoolbox/blob/master/scripts/sct_straighten_spinalcord.py#L402
@benjamindeleener: is there a particular reason for it?

Yes, the first straightening is done on the initial image. The second one is done on the padded image, after calculating the length of the spinal cord.
I believe it is not necessary anymore and can be done differently. I'll work on that.

I removed the second nurbs fitting as it is not necessary anymore (as the fitting is done in the physical coordinates system).


CustomTool hangs in VS2019

See #199 - in some cases, the custom tool can hang.
Reproduced with a simple solution that @FransdeJong shared - contains two projects, on 1 project (created by UaaS.cmd) the tool hangs, on 1 project (created in VS) the tool works.
Now to figure what is causing this, and whether the problems comes from MB or UaaS...

@hfloyd did you start the project with a beta UaaS tool?

@FransdeJong in our tests... the YourProject.Core project, created by UaaS.cmd, is a <Project Sdk="Microsoft.NET.Sdk"> project type, whereas the YourProject.Test project, which we created manually in Visual Studio, is a <Project ToolsVersion="15.0"> project type.
There seem to be some problems with single file generators (ie IVsSingleFileGenerator, the interface we implement to provide the custom tool) and VS2019 and NET.Sdk projects. Almost looks like they wanted to dig custom tools entirely at one point. Digging into it now.

Ah. So, the APIs that Visual Studio provides to add/remove files to/from a project, just don't work with NET.Sdk projects. Need to modify the raw Xml of the project file, it seems. Working on it..

Is it worth it? Or can we convert the project to Toolsversion="15.0"?

Well, the problem will happen one day anyways, so I'd rather fix it + have the fix in MB not in UaaS.

True.

Hey. Want to try this VSIX: Umbraco.ModelsBuilder.CustomTool-8.1.1.vsix.zip ? By my tests, it works both on traditional (ToolsVersion...) projects and Net.Sdk projects. If it works for you too, I'll upload to the market place.

I tried it and it works in both projects here as well.
It looks like the Net.Sdk project is twice as fast to.

Awesome work, @zpqrtbnk ! I was able to install the updated VSIX with no issues. I moved my Models files back into my original ".Core" project and ran it - no errors, no hanging! :-) #H5YR

Well, I might have written too soon in regards to "no errors".
Though the "Output" window shows:
UmbracoModelsBuilder: Starting v8.1.1 7/17/2019 3:18:47 PM.
UmbracoModelsBuilder: Done.

The "Error List" window includes this one:
Error		Custom tool UmbracoModelsBuilder failed to produce an output for input file 'Models\ContentTypes\_ModelBuilder.cs' but did not log a specific error.
referencing my MB "config" file (\Models\ContentTypes_ModelBuilder.cs)
The good news is that it actually DID work - my new Doctypes and properties are reflected in the .generated.cs files. So, I'm not sure why the error is getting displayed.

Ah well. There is no need to produce an output, ie to generate anything, corresponding to the "config" file _ModelBuilder.cs, so I have simplified things by returning nothing. And, everything works, but I had not paid attention to the fact that it would log an error in the list.
Going to revert that change to generate something, again. Stay tuned.

Want to try Umbraco.ModelsBuilder.CustomTool-8.1.2.vsix.zip ? Same thing, but generates the dummy file again, so there should not be errors anymore. Let me know.

right - i hoped it would "just" work - working on it

right - i hoped it would "just" work - working on it

We have the same coding style I see :D

OK, this was interesting. Traditional custom tools implement a "Visual Studio Single File Generator" and then hack the generator to, in fact, generate more than one file. Turns out this leads to all sorts of problems when supporting both old-style "ToolsVersion" projects, and new-style "Net.Sdk" projects.
So... I want to move from using a "File Generator" to a proper "Visual Studio Command". What this means is:

You don't set a "custom tool" on a CSharp file anymore
Instead, you Add | New Item... then pick Visual C# Items | Umbraco and add an Umbraco Models placeholder, with a .md extension (the name does not matter, but the extension is important) - for instance, Models.md - the content of the file is, for now, of no importance
That placeholder will automatically have a Build Models command in its context menu. So, right-click and Build Models ... and models are generated and nicely nested under the placeholder, both in "ToolsVersion" projects and in "NET.Sdk" projects.

And it should be way more robust, and easier to maintain.
Want to test? Umbraco.ModelsBuilder.CustomTool-8.1.3.vsix.zip

In the old project it works great.
In the Net.Sdk project it fails with following error:
UmbracoModelsBuilder: UmbracoModelsBuilder failed to generate code: Exception: Response status code does not indicate success (InternalServerError) {"Message":"An error has occurred.","ExceptionMessage":"{ expected","ExceptionType":"Umbraco.ModelsBuilder.Building.CompilerException","StackTrace":"   at Umbraco.ModelsBuilder.Building.Compiler.ThrowExceptionFromDiagnostic(String path, String code, Diagnostic diagnostic)\r\n   at Umbraco.ModelsBuilder.Building.Compiler.<>c__DisplayClass14_0.<GetCompilation>b__0(KeyValuePair2 x)\r\n   at System.Linq.Enumerable.WhereSelectEnumerableIterator2.MoveNext()\r\n   at System.Linq.Buffer1..ctor(IEnumerable1 source)\r\n   at System.Linq.Enumerable.ToArray[TSource](IEnumerable1 source)\r\n   at Umbraco.ModelsBuilder.Building.Compiler.GetCompilation(String assemblyName, IDictionary2 files, SyntaxTree[]& trees)\r\n   at Umbraco.ModelsBuilder.Building.Builder.PrepareAmbiguousSymbols()\r\n   at Umbraco.ModelsBuilder.Building.Builder.IsAmbiguousSymbol(String symbol, String match)\r\n   at Umbraco.ModelsBuilder.Building.TextBuilder.WriteNonGenericClrType(StringBuilder sb, String s)\r\n   at Umbraco.ModelsBuilder.Building.TextBuilder.WriteClrType(StringBuilder sb, String type)\r\n   at Umbraco.ModelsBuilder.Building.TextBuilder.WriteInterfaceProperty(StringBuilder sb, PropertyModel property)\r\n   at Umbraco.ModelsBuilder.Building.TextBuilder.WriteContentType(StringBuilder sb, TypeModel type)\r\n   at Umbraco.ModelsBuilder.Building.TextBuilder.Generate(StringBuilder sb, TypeModel typeModel)\r\n   at Umbraco.ModelsBuilder.Api.ApiHelper.GetModels(UmbracoServices umbracoServices, String modelsNamespace, IDictionary2 files)\r\n   at Umbraco.ModelsBuilder.Api.ModelsBuilderApiController.GetModels(GetModelsData data)\r\n   at lambda_method(Closure , Object , Object[] )\r\n   at System.Web.Http.Controllers.ReflectedHttpActionDescriptor.ActionExecutor.<>c__DisplayClass6_2.b__2(Object instance, Object[] methodParameters)\r\n   at System.Web.Http.Controllers.ReflectedHttpActionDescriptor.ActionExecutor.Execute(Object instance, Object[] arguments)\r\n   at System.Web.Http.Controllers.ReflectedHttpActionDescriptor.ExecuteAsync(HttpControllerContext controllerContext, IDictionary2 arguments, CancellationToken cancellationToken)\r\n--- End of stack trace from previous location where exception was thrown ---\r\n   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)\r\n   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)\r\n   at System.Web.Http.Controllers.ApiControllerActionInvoker.<InvokeActionAsyncCore>d__1.MoveNext()\r\n--- End of stack trace from previous location where exception was thrown ---\r\n   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)\r\n   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)\r\n   at System.Web.Http.Filters.ActionFilterAttribute.<CallOnActionExecutedAsync>d__6.MoveNext()\r\n--- End of stack trace from previous location where exception was thrown ---\r\n   at System.Web.Http.Filters.ActionFilterAttribute.<CallOnActionExecutedAsync>d__6.MoveNext()\r\n--- End of stack trace from previous location where exception was thrown ---\r\n   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)\r\n   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)\r\n   at System.Web.Http.Filters.ActionFilterAttribute.<ExecuteActionFilterAsyncCore>d__5.MoveNext()\r\n--- End of stack trace from previous location where exception was thrown ---\r\n   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)\r\n   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)\r\n   at System.Web.Http.Controllers.ActionFilterResult.<ExecuteAsync>d__5.MoveNext()\r\n--- End of stack trace from previous location where exception was thrown ---\r\n   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)\r\n   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)\r\n   at System.Web.Http.Filters.AuthorizationFilterAttribute.<ExecuteAuthorizationFilterAsyncCore>d__3.MoveNext()\r\n--- End of stack trace from previous location where exception was thrown ---\r\n   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)\r\n   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)\r\n   at System.Web.Http.Dispatcher.HttpControllerDispatcher.<SendAsync>d__15.MoveNext()"} UmbracoModelsBuilder:    at Umbraco.ModelsBuilder.Api.ApiClient.EnsureSuccess(HttpResponseMessage result)    at Umbraco.ModelsBuilder.Api.ApiClient.GetModels(Dictionary2 ourFiles, String modelsNamespace)
at Umbraco.ModelsBuilder.CustomTool.Generator.TryGenerate(ProjectItem sourceItem)
at Umbraco.ModelsBuilder.CustomTool.Generator.Generate(AsyncPackage package, ProjectItem sourceItem)`
I had this error before in V7 projects when using IPublishedContent as model somewhere but I cant find something like that in this project. Also the previous versions worked so let me know if you want me to test something specific.

Cause: the models.mb file was in a directory named "New Models" which we turned into a namespace "New Models" which is not a valid C# namespace. Need to use the same (or similar) logic Visual Studio uses to derive namespaces from folder names.
Want to test? Umbraco.ModelsBuilder.CustomTool-8.1.4.vsix.zip

And then... with NET.Sdk projects, there's some race conditions in the Solution Explorer where files appear un-nested and then nested, or even remain un-nested. Trying to fix.
Want to test? Umbraco.ModelsBuilder.CustomTool-8.1.5.vsix.zip

I tested this version and it works great in the standard and the old project. No more unnested models.
Great work Stephan!!

Fixed in the new Visual Studio Extension which replaces the old Visual Studio Custom Tool, read this blog post for details. Closing.

Nice investigation! A question - where would we put the "config" stuff, then for this new version? (https://github.com/zpqrtbnk/Zbu.ModelsBuilder/wiki/ModelsGenerationConfiguration)

It should be possible to put them in a cs file like before

Awesome work, @zpqrtbnk ! Thanks for your ongoing dedication to this tool. :-)

It should be possible to put them in a cs file like before.
And the question to this answer disappeared...

Haha! Yes, sorry about that - I had left this page open from yesterday and hadn't refreshed for Stephan's comment about the blog post - until I posted my question, I realized that all questions were answered in the Blog and thought to hide my mistake - but you, sir are way too quick for me! :-)


What is the best solver?

Right now we use a least squares approach using the trust region method (levenberg-marquadt also works well). Scipy also has a bunch of other routines we should test out:
Unconstrained:
BFGS
Nelder Mead
CG / Newton-CG
Constrained (ie explicitly enforce BC rather than with penalty method):
SLSQP
trust-region constrained

Closing this for now, after switching to linear BC it seems like the best method is explicitly enforcing the BC with a matrix factorization and then doing a trust region least squares optimizer (eg trf, lm, etc). Most quasi-newton methods without the full hessian don't seem to converge very well.


Virtual Tour - by default in center

Now:

by default the virtual tour in left-top on the screen.
Want:
in the center of the screen

➤ Ilya Kitayev commented:
fixed in virtual-tour v1.1.5


SAK-32244 Changed the word Meeting to Event in GB properties file.

Can another school that runs with en_GB approve these changes? I don't understand if this is EN-wide, EN-GB specific, or Oxford-specific.

Are we sure this isn't just an Oxford-specific edit?

@adrianfish do you want this change at Lancaster?  It affects sign-ups only.  We think you are the only other GB Sakai user.  I can close the PR if you don't want the change.

Makes sense to me. Meeting is too specific imho.

This still seems super odd to me, but I trust that this is a GB-specific edit and not an EN-specific edit


Enhanced Recurring Donations: Other information not required on Pause RD field permission error

Summary
When a user does not have read access on Recurring Donation “Amount”, “Day of Month” and “Payment Method” fields, then no installment is displayed. An error message and [OK] button are displayed as expected. However, the pause description message and the “Paused Reason” field are displayed as well and this additional information is not required.
Steps to Reproduce

View a user profile > Object Settings > Recurring Donations > [Edit] > remove read access on  “Amount”, “Day of Month” and “Payment Method” fields > [Save]
Login as the user > view a Recurring Donation record > click [Pause]
Verify the page content:

Expected Result

The Recurring Donation name, the installment permission error and the [OK] button are displayed. No other RD/pause information is displayed.

Actual Result

Besides the Recurring Donation name, the installment permission error, and the [OK] button, there are pause page description and Paused Reason field being displayed on the page.

Workaround
Not applicable, the page displays the error and the [OK] button. User cannot edit or save a pause which is expected. Additional information does not interfere with the page interaction on this error type.

W-7976546

Please follow this Known Issue in the Trailblazer Community for updates.


Refresh Kusto cluster doesn't seem to reconnect properly

Azure Data Studio Version:

Steps to Reproduce:

Connect to ADX cluster in the Connections viewlet.

After a few minutes, try to expand the objects. It will show:

Click on Refresh on the database level or the cluster level, it still doesn't seem to reconnect.

Expected: reconnecting.
Current workaround: disconnect and create a new connection.

Related to #11830

This was fixed with PR#1085 ^. Closing issue.


List webpack as an integration in README.md

The sass-loader project is a webpack loader that makes direct use of node-sass to do its bidding.
https://github.com/jtangelder/sass-loader

Thanks @nmschulte we'll merge this into https://github.com/sass/node-sass/issues/730


Demo/ PoC: Nexodus + Submariner in a multi-cluster setup

Validate/ demo operation of Apex + Submariner in a multi-cluster topology. Document any issues found that may need additional work.

I can do this .. please assign

This was completed by some developers on the Submariner project


New release

Please Release a new Version with current GitHub Content or even better allow the Adapter Core Dependency to get automatically Updated in the Same Major Release by specifying it with ^3.1.4 instead of a fixed version. This prevents from such scenarios in the future.
see also https://github.com/rg-engineering/ioBroker.heatingcontrol/issues/560

done with 3.1.14


Add localized e-mail support

We need to pass a locale parameter along with the request
so Komoju can figure out which e-mail locale to use.

Looks good to me :+1:


Display API Name on the UI page layout (see screen shot)

Describe the solution you'd like
As a System Admin, I want to open the Salesforce Inspector Reloaded, then click a link or button to "display the API name" next to or below the field label displayed on the page.
As an added bonus, if I click on the API name displayed on the page it should highlights the full API name to make copy / paste simple. This behaviour is the same as Salesforce Inspector Reloaded > click the "Show All Data" button > using the mouse, click on any text in the table. The data auto highlights the text clicked.
As an additional added bonus, add an icon next to the API Name e.g.  that allows the user to click and go to Setup> Object field.
Describe alternatives you've considered
I use another Chrome extension called "Salesforce Show API Name". However much like the orginal Salesforce Inspector it is no longer being maintained.
Salesforce Show API Name
By adding this feature we can consolidate Salesforce helper chrome apps and look forward to additional features and support over time.
Additional context
Add any other context or screenshots about the feature request here.
Example screen shot

Hi @tprouvot
Can you assign me to this issue? It corresponds to this PR https://github.com/tprouvot/Salesforce-Inspector-reloaded/pull/202. Thank you! 😄

Will be available in the next version !

Hi @tprouvot and @MD931. I just wanted to say thank you both for adding my feature enhancement request. I have now uninstalled the old API Name Chrome Add-on since this replaces it! Love it, thank you both.
Cheers,
John

Hi @Johno72,
Thanks for your feedback, glad to hear that you enjoyed the feature, well done @MD931 👏
Reloaded to rule them all ! 🚀


Refactor of Sass (and JS)

Trying to tidy up what was copied from eLife's pattern library, and create a more future-proof structure.
Highlights:

Make normalize.css a dependency (and update it!)
Remove things that aren't yet needed/won't be needed
Restructure files to break them up and provide more specific imports to show dependencies (there could be more refactoring here)
Lint test files

Things I started to look at but haven't done yet:

More Sass tests.
Introduce http://sassdoc.com/.
Make the fonts a dependency.


Linear Motor Support

Hi,
Your drive looks very nice - but I'm wondering if the control software can drive a brushless DC linear motor.
I have a linear shaft motor with no hall sensor, so needs an initial commutation alignment, but with an incremental encoder is able to commutate effectively.
Does ODrive support this type of motor?
Thanks,
James

Yes, I think that should work just like the same situation with a rotary motor.

Please let us know how your build goes.  It's been talked about quite a bit, and we believe it will work, but I don't think anyone has actually completed a linear motor test.  https://discourse.odriverobotics.com/

Thanks - I have 3 Tecnotion linear motors which are currently being run by Kollmorgen AKD servo drives.
I am considering 4 linear shaft motors (http://www.nipponpulse.com/products/overview/linear-shaft-servomotors) for a set of axis required in the machine and need a cost competitive way of driving them.
Is there anywhere I can buy a sample ODrive populated board for me to investigate if this would be a suitable option?
I am intending on pairing these with RLS linear encoders, so it would be useful to know the max frequency the ODrive can read the A/B pulses as this determines which encoder resolution to source.

Sure, you can buy ODrives here.
We haven't tested to the encoder speed limit (we don't have a fast enough encoder). However the input filtering settings on the ODrive by default should allow signals up to 3.5MHz, so about 14 Mcounts/s. If you need more speed than that, we can reconfigure the filters, which allows a theoretical max frequency of 21MHz (84 Mcount/s).

@jamescarter-le did you end up testing this?

No I ended up using specific servo drivers from Kollmorgen. For this
application the cost was not the main driver and so these servo drives are
able to drive linear motors natively, and also communicate with the linear
encoders. Also the built in feedback across drives helps drives gantries
very easily.
On Mon, 25 Mar 2019, 19:22 Paul Guenette<EMAIL_ADDRESS>wrote:

@jamescarter-le https://github.com/jamescarter-le did you end up
testing this?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/madcowswe/ODrive/issues/256#issuecomment-476341698,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABkUrLjZBv1G220gafCdyD59mWLAKqTVks5vaSHmgaJpZM4XFr3k
.

Ok, I'm going to close this issue for now.  If you end up trying the drivers out let us know how it goes.


Error case on namespace

Hi,
I have an error in namespace on RepositoryInterface.
namespace Mimetyper\Repository;
to
namespace MimeTyper\Repository;
Thanks for resolution of problem.
Best regards,
Jérémy

Thanks,
It shouldn't be a problem for the execution of the code but I will definitely fix it.

Fixed in tag 0.2.2

#12

Thanks, I detected this error in Symfony with an exception


Thread leak issue

Does <IP_ADDRESS> supports elasticsearch 2.4.0?
I found the thread pool is not shutdown for each iteration to update index to elasticsearch 2.4.0.

Hi, I have met this pro this days. Do you solve it?

Hi, I have met this pro this days. Did you solve it?


AJ Stuff

more {{ .Site.BaseURL }}
max-width on header

[ ] head issue fixed
[ ] asset absolute urls fixed
[ ] see super wide browsers discussion #12
[ ] I'll update the default nav partial #13


[R25.03] [Architecture] Propose a B2C tech solution to enable public access of cx-data maintaining Data Sovereignty

Overview
As we got to know by the VDA Verband der Automobilindustrie e. V. one of the requirements from the regulations is that a part of the "Battery Passports", "Digital Product Passports" and other products' data MUST be accessed not in B2B by any public consumer.  It was noted during a meeting with the Digital Product Pass Expert group and the stutainability domain that Catena-X has currenltly no plan or solution to tackle that.
I have something in mind already, but I would like to propose it formally and discuss it with the architecture committee first

One possible solution

Enabled a public access "Access & Usage Purpose" that any "self-deployed unauthorized" EDC can retrieve.
In this way the protocol is still followed and just the "authorization" is skipped for public data.
And the EDCs can be found in the "DID:WEB" placed in the batterypass/dpp qr code.
The security and data sovereighty would be not in the "data exchange level" but in the "data" level using Verifiable Credentials and Verifiable Presentations as proposed in this catena-x dpp verification whitepaper:

https://github.com/eclipse-tractusx/digital-product-pass/tree/main/dpp-verification

No digital twin would be needed.

Motivation

I want to find how big is the problem, and what are the actual requirements on this topic, talking with the expert groups and discussion possible solutions.
I want that people do not need to use two dataspaces or not use catena-x at all because this feature is not clarified or available.
I want that Catena-X can provide an answer to this topic so that companies choose Catena-X as a "complete" solution for complying with the regulations.
I want to make it easy for people to access public data in Catena-X while still following standards.

Explain the topic in 2 sentences
There MUST be a solution that allows end users to view data from OEMs. Currently, Catena-X supports only, B2B and not B2C because the EDC requires companies to be onboarded in Catena-X.
I want to propose and analyze the impact of enabling a tech solution for B2C interaction while still maintaining the Data Sovereighty, increasing the interoperability with other non-edc dataspaces.
What's the benefit?
Enables any users to use Catena-X Standards and Values (Data Sov, Decentrality, Interoperability, Secure) to retrieve data from B2C.
Increasing also the interoperability with multiple networks which do not use the EDC connector.
What are the Risks/Dependencies ?

Architecture Committee
Digital Product Pass Expert Group -> Problem Description
Sustainability Committee
Data Sovereighty Expert Group
Certification Expert Group
SSI Expert Group

Detailed explanation
I have drafted a proposal on how can Catena-X maintain their data sovereighty concept, and still be able to handover data throught the EDC to other non-edc dataspaces. Also providing a "public interface" for Customers to retrieve a limited set of data which lies behind the EDC in a Data Source.
This is mandated by regulation, so many organizations are implementing central solutions to enable this kind of behavior. So the idea here is to decentralize the public data provision and enable data sovereignty concepts using SSI.
In this way that the "complete" set of data would be shared via the "EDC" and the regulatory public data using another interface which needs to be proposed and discussed in this feature.

Current implementation

Eclipse Data Space Connectors (EDC) supports only B2B connections by design.
Catena-X is using just the EDC to retrieve and provide data for companies.
The EU regulations mandate that economic operator companies provide public data to customers.
Currently, Authorities and Customers are not allowed to retrieve data

Proposed improvements

Catena-X propose a standard for providing public data (B2C) with data sovereighty. Provides simple reference implementation.
Authorities and Consumers can retrieve a set of partial data using catena-x B2C interface and visualize the data.
Catena-X will help companies comply with the regulations and it will have success in the market
Companies that require more than just "public" data can use the "Connector" and the policies to retrieve the complete set of data.

Feature Team
Committer

@matbmoser
Any volunteers?

User Stories

Issue 1: Document and Specify the problem
Issue 2: Draft a technical concept which gives a solution to the B2C public data access problem
Issue 3: Create a whitepaper with the Architecture Committe
Issue 4: Present to the respective committees and expert groups, aligning the perspectives.

Acceptance Criteria

[ ] The problem statement is cleary defined
[ ] The technical solution is drafted and clear
[ ] Consensus from the Architecture Committee is granted
[ ] A white paper document in Github must be generated to document this proposal (create sig-architecture?)

Test Cases
None
Expected Result

Catena-X has at least a draft solution for B2C at the Architecture Committee publishing whitepaper
Feedback is gathered from all the interested expert groups
Catena-X Expert Groups (DPP, PCF, ESG, etc..) can propose a standard for this use case

Examples

https://thebatterypass.io/en/did:web:acme.battery.pass:0226151e-949c-d067-8ef3-162431e28976
https://vera-staging.dpp.spherity.dev/?did=did:web:api-rcs.susi.spherity.dev:did-registry:acme-power-drive-x-1000-3985-cb-1739186-d-8-d

Architectural Relevance
It will enable Catena-X to do B2C data exchanges, maintaining data sovereignty and increasing interoperability.
The following items are ensured (answer: yes) after this issue is implemented:

[ ] This feature aligns with our current architectural guidelines

Data Sovereignty: All data sharing activities across company boundaries follow the Catena-X Regulatory Framework, in particular the Data Exchange Governance, and the Dataspace Protocol via a compliant Connector (like the tractusx-edc or similar, see Connector KIT)

[ ] CX-0010 Business Partner Number
[ ] CX-0013 Identity of Member Companies
[ ] CX-0018 Data Space Connectivity (EDC)
[ ] CX-0049 DID Document Schema
[ ] CX-0050 Framework Agreement Credential
[ ] CX-0149 Verified Company Identity

Interoperability: Digital Twins are used (compliant to the Digital Twin KIT and the Industry Core KIT)

[ ] CX-0001 EDC Discovery API
[ ] CX-0002 Digital Twins in Catena-X
[ ] CX-0018 Data Space Connectivity (EDC)

Data Format:

[ ] The data model is based on a published Semantic Model

[ ] The impact on the overall system architecture has been assessed. The Feature does not require changes to the architecture or any existing standard? Please have a look here on the overarching architecture
[ ] Potential risks or conflicts with existing architecture has been assessed

Justification: This feature will be proposed in the Architecture Management committee
Additional information

[ ] I am aware that my request may not be developed if no developer can be found for it. I'll try to contribute a developer (bring your own developer)

Other Possible Solutions

Enable DID:WEB interface that is able to retrieve public data from an EDC connector.

Maybe the Web App in the consumer side is an "not authenticated connector?"
Maybe this connector can have a "self issued credential? by default?" so anyone can deploy it in their local and retrieve public data???
How would catena-x specify this public data agreement

Create a new type of "operating"/"certified" company which is allowed to provide public data to the external world using an application without login.

@lgblaumeiser now that I am not inside yet of the Architecture Committee can you let them aware that there is this problem, I have found it yesterday in a meeting with @stanfaldin and the VDA.
I want to take this topic and discuss with them together once I join Catena-X.

I would like to create a "sig-architecture" so we can centralize this topics. @stephanbcbauer what do you think about that?

Maybe place the dpp in Cofinity-X? And all the cofinity-x

I have added a new diagram to explain what is my first solution proposal...

The new Volvo has it already https://youtu.be/_-eDg3dO7Yo?si=UHV8VCTIkf0MXHwN and you are able to access with your phone. That's a B2C connection that can be done for other manufacturers with Catena-X
Great job Volvo and Circulor!

Some hints from Release Management (@ther3sa) and Tractus-X Project Lead (@stephanbcbauer)

Status currently in Inbox. ⇾ Only features with status backlog are considered in open planning
Please add missing sections from the feature template, or fill them out

The idea here is also that the QR Codes that are in thar Car can remain the same, but the way how you access and ammount of data you get will vary on the "access type" if public it will be limited and if private and using Catena-X it would retrieve the ammount of data you can see.

Ideas

Define clear scope for the use case
Data Exchange KIT?

Thank you for the detailed description!
Some hints and thoughts from my side:

I want to propose and analyze the impact of enabling a tech solution for B2C interaction while still maintaining the Data Sovereighty, increasing the interoperability with other non-edc dataspaces.

I would always change the wording from "EDC" to "Dataspace Protocol" (DSP). The EDC is just one possible reference implementation based on the protocol. Since nearly all dataspaces are under the umbrella of the International Data Spaces Association (IDSA), we should have an eye on those other data spaces. A good overview is the Dataspace Radar. Historically, the Connector and the Protocol also started at the IDSA and are pushing to bring all dataspaces to the DSP.

Increasing also the interoperability with multiple networks which do not use the EDC connector.

Do you know another non-Catena-X company or dataspace that is interested in this? We should collaborate with them to prevent building a solution that doesn't fit the market.

Acceptance of data usage conditions would be like the "cookies" acceptance banners we have today in most websites. The conditions shall mirror the regulations.

If we talk about publicly available data that everyone can view and use, we do not need specific usage conditions. Therefore, we don't need those acceptance banners.

I want that manufacturers can provide this solution to their clients in a harmonized way, so that users can scan the qr code and with the browser retrieve the data from the manufacturer, or other manufacturers.

There is another standard for this called EPCIS from GS1 (these are the guys that generate the barcodes on all consumer products). This standard is made for traceability so that customers can get information about their products. In this area, the food industry is way ahead of us (if you buy a fish in the supermarket, you can trace it back to the angler and the ocean). Maybe we can get some inspiration from them.

Thank you @mhellmeier for your feedback.

I would always change the wording from "EDC" to "Dataspace Protocol" (DSP). The EDC is just one possible reference implementation based on the protocol. Since nearly all dataspaces are under the umbrella of the International Data Spaces Association (IDSA), we should have an eye on those other data spaces. A good overview is the Dataspace Radar. Historically, the Connector and the Protocol also started at the IDSA and are pushing to bring all dataspaces to the DSP.

Forgive my unprecision with the "terms", please not understand me wrong when I say "change" the edc, is just one of the possible solutions we could propose, to improve the public data access using the edc, and not changing the protocol, it would be something additional or like an extension. Lets talk more about it in person, when we will try to find a way forward.

Increasing also the interoperability with multiple networks which do not use the EDC connector.

Do you know another non-Catena-X company or dataspace that is interested in this? We should collaborate with them to prevent building a solution that doesn't fit the market.

-> Factory-X said they need this feature + CX-NEXT also...
And this is "MANDATORY" by the regulations, and if we want to comply by design we should give at least an answer..

There is another standard for this called EPCIS from GS1 (these are the guys that generate the barcodes on all consumer products). This standard is made for traceability so that customers can get information about their products. In this area, the food industry is way ahead of us (if you buy a fish in the supermarket, you can trace it back to the angler and the ocean). Maybe we can get some inspiration from them.

Good idea, my point is that the "id" should always remain the same and the "access" for it shall be defining the amount of data you should get.
-> Thx for the hint, but note that the GS1 is a proprietary solutions and we from the DPP group have decided not to use it, because we have not the rights. But lets talk about it.

If we talk about publicly available data that everyone can view and use, we do not need specific usage conditions. Therefore, we don't need those acceptance banners.

Because a data is "public" accesible and viewable, does not mean that you need to loose the data sovereignty over it. Just because is public and you can see it as a consumer does not means that is yours.
-> And here I want to bring the value of Catena-X Certified data.

Please consider as well, that "external" data access is also required for restriced data in a battery DPP for persons with legitimate interest (e.g. recyclers) as well as authorities who are not necessarily onboarded on CATENA-X as well. So it should be considered that  role-based data access policies on attribute level are available as well for external data access. Detailed definition of access groups for the battery passport are part of future secondary legislation. Which data points are restricted in the battery passport is described in the battery regulation and concluded here (refer to column O "access rights"): https://thebatterypass.eu/assets/images/content-guidance/pdf/2023_Battery_Passport_Data_Attributes.xlsx

I have found that if Consumers want to retrieve data from Catena-X or any other dataspace based on Tractus-X, they need to have a deployed EDC and application available. To help them to use a possible "Tractus-X" browser as a application to consumer the data from the EDC, an easy approach to reduce complexity would be to use a pattern like this one: https://github.com/eclipse-tractusx/sig-architecture/issues/5
Which is being drafted by me, and also proofed to be working. Allowing data exchanges to be fast and simple for the application.


How to ship release version

Go version: 1.21.3
Go-SDL2 version: v0.4.35
SDL2 version: 2.28.5
OS: MacOS
Architecture: ARM
Hi,
I installed sdl2 + sdl2 mixer via brew. I then built a binary and then uninstalled sdl2 to simulate the environment of a potential user of my app. When running the executable I get the following error:
dyld[54995]: Library not loaded: /opt/homebrew/opt/sdl2_mixer/lib/libSDL2_mixer-2.0.0.dylib
  Referenced from: <SOME-GUID-HERE> /Users/momchil/Workspace/sdl-audio/demo
  Reason: tried: '/opt/homebrew/opt/sdl2_mixer/lib/libSDL2_mixer-2.0.0.dylib' (no such file), '/System/Volumes/Preboot/Cryptexes/OS/opt/homebrew/opt/sdl2_mixer/lib/libSDL2_mixer-2.0.0.dylib' (no such file), '/opt/homebrew/opt/sdl2_mixer/lib/libSDL2_mixer-2.0.0.dylib' (no such file)

I can't seem to find dylib distributables in the official SDL releases. There are dmg files but those contain extensionless files. Any idea where I could get the dylib files from? Also, once I do get a hold of them, what needs to be done to trick the app to search for such files in the same directory as the binary and not in homebrew?
I am trying to ensure that an app can easily be packaged afterwards, without having to put for MacOS run brew install ....; for Linux run apt install documentation and expecting users to know what to do and want to do it.

Hi @mokiat, app bundle could be a way. I'm not too familar with it but perhaps this could help? https://github.com/veandco/go-sdl2/issues/574

@mokiat You can use https://github.com/auriamg/macdylibbundler to pack libraries that app depend on in the bundle. Also, you can use install_name_tool -change to change @executable_path, you can see where it currently points with otool -L. Here is an example script I was using for some project:
#!/bin/sh

mkdir -p mupen64plus/Contents/MacOS/

cp test/*.dylib mupen64plus/Contents/MacOS/

APP_CONTENTS="./mupen64plus/Contents"

FIX_LIST="-x $APP_CONTENTS/MacOS/libmupen64plus.dylib \
 -x $APP_CONTENTS/MacOS/mupen64plus-audio-sdl.dylib \
 -x $APP_CONTENTS/MacOS/mupen64plus-input-sdl.dylib \
 -x $APP_CONTENTS/MacOS/mupen64plus-rsp-hle.dylib \
 -x $APP_CONTENTS/MacOS/mupen64plus-rsp-z64.dylib \
 -x $APP_CONTENTS/MacOS/mupen64plus-video-arachnoid.dylib \
 -x $APP_CONTENTS/MacOS/mupen64plus-video-rice.dylib \
 -x $APP_CONTENTS/MacOS/mupen64plus-video-z64.dylib \
 -x $APP_CONTENTS/MacOS/mupen64plus-video-glide64mk2.dylib"

dylibbundler -cd -b $FIX_LIST -d $APP_CONTENTS/MacOS/ -p '@executable_path/'

rm -rf $APP_CONTENTS/Resources
rm -rf $APP_CONTENTS/SharedSupport
mkdir -p $APP_CONTENTS/Resources
mkdir -p $APP_CONTENTS/Frameworks
cp test/*.ini test/*.ttf test/*.txt $APP_CONTENTS/Resources
cp -r test/doc $APP_CONTENTS/SharedSupport
cp -r /Library/Frameworks/SDL2.framework $APP_CONTENTS/Frameworks

FILES="$APP_CONTENTS/MacOs/libmupen64plus.dylib
$APP_CONTENTS/MacOs/mupen64plus-audio-sdl.dylib
$APP_CONTENTS/MacOs/mupen64plus-input-sdl.dylib
$APP_CONTENTS/MacOs/mupen64plus-video-rice.dylib
$APP_CONTENTS/MacOs/mupen64plus-video-glide64mk2.dylib
$APP_CONTENTS/MacOs/mupen64plus-video-z64.dylib"

for file in $FILES; do
    install_name_tool -change @executable_path/libSDL2-2.0.0.dylib @executable_path/../Frameworks/SDL2.framework/Versions/A/SDL2 ${file}
done

Hope this helps, all in all, the issue is not really related to this repo.

@veeableful , I am familiar with app bundles. I already have a tool that builds such a bundle with glfw. The benefit there is that I don't need to package any libs, since the OS already has them by default.
I am looking into using SDL2 for a number of reasons (sound being one of them), however, but the library part is making the whole process painful.
@gen2brain , thanks for the ideas. I managed to use otool and install_name_tool to get something working. The problem is that it only works if I copy the dylib files from homebrew into the app folder and use install_name_tool with them. It does not work with the Framework that is officially released by SDL2.
I think that it has to do with the fact that brew says it has installed one version of SDL but the dylibs are a totally different version. And when I use install_name_tool to point to the official ones with the same version, it complains that there is a mismatch. I should probably open a bug to SDL2.
Do you know if there is a way to force Go to ignore pkg-config and use the lib inside the framework? I tried all sorts of flags on the go compiler and environment variables but could not get it to work.

In the end I went with static linking of SDL2. Closing this.


ask for document title

Hello,
does this only do tagging and correspondent or can it also do document title?

It also does the title.

thanks, this is great.
looking at it now in more detail.
two more qq.
a) setup seems to not always failback to GPT4.5T and not accepting my switch to 4o-mini.
b) is there a way to have it look only at inbox tagged items?

Thank you for your questions:
A) I will look this issue up and try to reproduce it.
B) Currently it looks for all documents that are not already processed by paperless-ai. Though it might be a neat feature request for upcoming versions to declare which documents gonna be processed.

I can't reproduce the issue with fallback to a different OpenAI Model. Also the setup process does not include GPT4 Turbo.
Please verify something for me:

Do a fresh install process of paperless-ai
Select for example GTP-4o-mini
Finish the installation
Look into the created .env file and verify what model is saved there

Then please get back here and tell me your findings.

Yeah regarding the switch back is because if you reload or reopen the setup process it will alway preselect the first entry from the drop down. So its just a visual thing.
I assume I can close the issue here?

appreciate your work and help!

I will tag you here in the next days when the new feature is implemented.
You are most welcome 👍


(Bug) React-engine error when req.url store dot character.

When I do a request that store a dot character, e.x: http://localhost/profile/abc.xyz. Then, nodejs will notify 'error: uncaughtException: Cannot find module 'xyz'. I know it occur due to the ReactEngineView function in the react-engine/lib/expressView.js, in depth the ReactEngineView function will call the View function at express/lib/view.js. The View function as the following code:
function View(name, options) {
  var opts = options || {};

  this.defaultEngine = opts.defaultEngine;
  this.ext = extname(name); // <--------- Error here
  this.name = name;
  this.root = opts.root;

  if (!this.ext && !this.defaultEngine) {
    throw new Error('No default engine was specified and no extension was provided.');
  }

  var fileName = name;

  if (!this.ext) {
    // get extension from default engine name
    this.ext = this.defaultEngine[0] !== '.'
      ? '.' + this.defaultEngine
      : this.defaultEngine;

    fileName += this.ext;
  }
  console.log(this.ext);
  if (!opts.engines[this.ext]) {
    // load engine
    opts.engines[this.ext] = require(this.ext.substr(1)).__express;
  }

  // store loaded engine
  this.engine = opts.engines[this.ext];

  // lookup path
  this.path = this.lookup(fileName);
}

I have created a PR at https://github.com/paypal/react-engine/pull/140


hw+device-type: Add jetson-agx-orin-devkit device type

Change-type: patch
Signed-off-by: Alexandru Costache<EMAIL_ADDRESS>

@balena-ci I self-certify!


Why dart lang can not bootstraping self?

bootstrapping is a programming who will be more stable and strong .
by wikipedia :
In computer science, bootstrapping is the technique for producing a self-compiling compiler — that is, a compiler (or assembler) written in the source programming language that it intends to compile. An initial core version of the compiler (the bootstrap compiler) is generated in a different language (which could be assembly language); successive expanded versions of the compiler are developed using this minimal subset of the language. The problem of compiling a self-compiling compiler has been called the chicken-or-egg problem in compiler design, and bootstrapping is a solution to this problem.[1][2]

Many compilers for many programming languages are bootstrapped, including compilers for BASIC, ALGOL, C, C#, D, Pascal, PL/I, Factor, Haskell, Modula-2, Oberon, OCaml, Common Lisp, Scheme, Go, Java, Elixir, Rust, Python, Scala, Nim, Eiffel, Vala, and more.

Reference: https://en.wikipedia.org/wiki/Bootstrapping_(compilers)

Large parts of the Dart toolchain are written in Dart (e.g. Dart CFE, type flow analysis, dart2js compiler, dartdevc compiler etc).
Where there are significant benefits and no draw backs we tend to write code in Dart.
Full bootstrapping is non-goal because it does not really yield enough benefits that would out-weight amount of work we need to put into it to achieve it.

Here document about why golang self bootstrapping,
https://www.infoq.com/news/2015/01/golang-15-bootstrapped/
By my side, Dart lang it is a more powerful language, better than Golang, i work on Android app develop, using Dart lang in my day life.

If we self bootstrapping, we can do it early.

You somehow think that rewriting C++ to Dart is going to magically improve it. This is unquantified. I will repeat myself: it's a large investment for imaginary / questionable gains.
Anyway - this is offtopic. We have no plans to fully rewrite all our C++ code to Dart.


Can the Cesium add the DEM service published by arcgis?

I want add the DEM service published by arcgis. I want to know the method to add DEM layer. I tried all the API about
but did not work. My code is like:
var viewer = new Cesium.Viewer('cesiumContainer', {
imageryProvider : new Cesium.ArcGisMapServerImageryProvider({
url : 'https://services.arcgisonline.com/ArcGIS/rest/services/World_Street_Map/MapServer'
}),
terrainProvider : new Cesium.CesiumTerrainProvider({
url : 'http://kn-gis-43.gedi.net:6080/arcgis/rest/services/HKDEM/ImageServer',
requestVertexNormals : true
}),
baseLayerPicker : false
});

Hello @RemoteSensingFrank,  the CesiumTerrainProvider is only compatible with heightmap and quantized mesh terrain tiles (see https://cesiumjs.org/data-and-assets/terrain/formats/)
CesiumJS does not have an ArcGis compatible terrain provider because ArcGis Image Server does not output terrain tiles in a web friendly format.  This is something we might look into soon, but in the meantime you can try tiling your terrain data on Cesium ion.  See more at https://cesium.com/
Thanks!

Ok，thanks a lot


Multi-deployment Testing on Android needs matchingFallbacks to be specified

Recently, I tired to setup the staging in one our fresh projects. I followed the instructions on how to do the Multi-deployment Test (https://docs.microsoft.com/en-us/appcenter/distribution/codepush/react-native#android), but I was not able to sync, build, or run the project because gradle could not resolve the releaseStaging class path on included libraries, which makes sense of coures, since these libraries provide only debug and release buildTypes.
It took me a few days to readup the docs around gradle and test different configs to find the right solution. All it needs is a fallback. (http://google.github.io/android-gradle-dsl/current/com.android.build.gradle.internal.dsl.BuildType.html#com.android.build.gradle.internal.dsl.BuildType:matchingFallbacks)
Keep in mind that this was a fresh project with every package and tool on their latest versions.
Android Studi 3.1.2
react-native: "0.54.0"
react-native-code-push: "^5.3.3"
appcenter: "^1.5.0"
appcenter-analytics: "^1.5.0"
appcenter-crashes: "^1.5.0"
appcenter-push: "^1.5.0"`
I guess it makes sense to include this tip in the doc somewhere. I have already create a PR. I hope it saves someone else the trouble.
https://github.com/MicrosoftDocs/appcenter-docs/pull/154

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 39490e39-be97-2bba-5afc-6bc8bed39690
Version Independent ID: 357a2070-e41c-b346-e18b-606eec7255c2
Content: Using the React Native SDK with CodePush - Visual Studio App Center
Content Source: docs/distribution/codepush/react-native.md
Service: vs-appcenter
Product: unspecified
GitHub Login: @Zakeelm
Microsoft Alias: zakeelm

@farzadshafiee thanks for sharing.  We don't want you to have to work for several days to figure something out. Don't forget that you have direct access to our dedicated support team, you can ask them for help anytime. Just look for the blue chat icon in the lower-right corner of any App Center page, click that to open a chat with our support team.  You won't always get an immediate response, but you will get your questions answered in a timely manner.


RP-439 Stub added for prisoner-offender-search API

Can you add in the prisoner with ID G4274GN so it aligns with the other data we have in the stubs? Ideally if you could match up the details between the different endpoints so it makes sense i.e. same name, prison, DOB everywhere


Introduce admin and orderer Node OUs

Is your feature request related to a problem? Please describe.
Make use of orderer and admin Node OUs. This allows any new certificate that has admin role being able to use for administration purpose, need not be stored in the admincerts directory of the MSP. Allowing multiple certs to be generated on demand for a given MSP.
Describe the solution you'd like
Add support of orderer and admin Node OUs in the config file.
Describe alternatives you've considered
None
Additional context
orderer and admin Node OUs were not supported at the time of writing BAF for Fabric.

This issue will be solved by PR #1393


When pidfile is invalid

In file Server/Main.cc, in function writePid of PidFile.
When the FILE* file is NULL, it would be pass to fwrite.
I think use PANIC instead of ERROR (in line 203) when we found fill is NULL would be better.

Agreed. "ERROR" should be "PANIC" on https://github.com/logcabin/logcabin/blob/9704f012fb8bd6305a1e75b0a12c13377252cd98/Server/Main.cc#L203


Remove not needed services

In presto product-test script which runs the tests there is the bellowing:
function stop_unnecessary_hadoop_services() {
  HADOOP_MASTER_CONTAINER=$(hadoop_master_container)
  docker exec ${HADOOP_MASTER_CONTAINER} supervisorctl status
  docker exec ${HADOOP_MASTER_CONTAINER} supervisorctl stop mapreduce-historyserver
  docker exec ${HADOOP_MASTER_CONTAINER} supervisorctl stop zookeeper
}

That function is executed before all the tests. The best would be to not to have such services which needs to be then stopped in tests execution.
FYI: @ilfrin

It looks version 3 solves this.


Create Documentation

I've been trying to use this plugin but can't figure it out. Can you write some documentation or make a tutorial please?

https://github.com/acegiak/Godot4TerrainShader/commit/8572dc7811bf92976afe5f4a23713ba2925f28fc
Updated the readme document, added a demonstration gif, and added an example material. Let me know if that helps make things clearer?

yes, this is great. thank you very much!!


Add Shooting Stars by Paul Pollux

Song Name
Shooting Stars
Artist Name
Paul Pollux
Source
Youtube
Youtube Link
vtXhlUMYVTDUJOyw
Direct File Link
No response
Song ID
730373
Start Offset [ms]
1
Extra
Created from Auto Nong.
Created for level: 32292932

reject
invalid YouTube link


MGMT-18832: in case istallation stopped we should exit reconcile loop right away

Can you squash out the second commit or make the message more meaningful?


On extract chips, --write-geojson should receive an output path

We'll use an implicit path on output directory for now.
Also, renamed --write-geojson to --write-footprints on https://github.com/dymaxionlabs/satproc/commit/f011bb5ffa2377a9d8fe48dfb94a8c8a682247bf


Migrate FAQ page into the Typesense backend

Closes #377
Description
Using react-instantsearch-dom, creating custom components for SearchBox, Hits, and RefinementList
Current Tasks

[ ] Create custom components for SearchBox, Hits, and RefinementList
[ ] Update url query parameters based on search keyword/filter

Neat!
Should we highlight relevant words in the search results? I think it will provide clarity for the user, as it gives context why presented results are relevant.

@ekamuktia After some discussions with @zainfathoni earlier, we decided to go forward with using Typesense, since the current search infrastructure gave us more problems than expected (e.g. #405). Therefore we need to migrate to Typesense sooner than expected.
Let's see if we can get this up and running asap as a proof-of-concept, so we can apply it to other places (e.g. province search).

@resir014 @zainfathoni
The UI itself is customizeable, so it doesn't matter whether we use original typesense widget (https://www.algolia.com/doc/guides/building-search-ui/widgets/showcase/react/) or customize it to current UI
On my local development, the problem is solved but somehow on the deploy preview the handleFilterChange doesn't work.
Changed it to non modal filter because I thought it's probably the problem, but same thing still happens.
Any idea why?
Local:
https://user-images.githubusercontent.com/9606523/126901072-d4c92172-9b4e-47be-ab77-45c224048a29.mp4
Deploy Preview:
https://user-images.githubusercontent.com/9606523/126901096-84c356bb-b3db-41ea-aded-b8919ffc853a.mp4

@zainfathoni @ekamuktia Created an environment variable in the Netlify dashboard called NEXT_PUBLIC_TYPESENSE_API_KEY. Let's put all secret values (e.g. apiKey) there.

What about the GitHub Actions build, @resir014? I think we should also put some env vars on the GitHub Secrets, shouldn't we?

@zainfathoni @ekamuktia Created an environment variable in the Netlify dashboard called NEXT_PUBLIC_TYPESENSE_API_KEY. Let's put all secret values (e.g. apiKey) there.

For this, how can I use it on the code? Like this process.env.NEXT_PUBLIC_TYPESENSE_API_KEY?
@famasya @zainfathoni @resir014
Finally, I found the problem why the filter didn't work on deploy preview and fixed it.
Some things to note:

For FAQ, I couldn't find way to sort it based on the document order (tried objectID:asc and id:asc, but both failed)
For test case, since the data is from index, then it cannot use mock data. Test case needs to be updated.
Since I'm using new components, some functionality still not applied here (loading, empty state, preserve url parameter, etc)

@zainfathoni @ekamuktia Created an environment variable in the Netlify dashboard called NEXT_PUBLIC_TYPESENSE_API_KEY. Let's put all secret values (e.g. apiKey) there.

For this, how can I use it on the code? Like this process.env.NEXT_PUBLIC_TYPESENSE_API_KEY?
@famasya @zainfathoni @resir014
Finally, I found the problem why the filter didn't work on deploy preview and fixed it.
Some things to note:

For FAQ, I couldn't find way to sort it based on the document order (tried objectID:asc and id:asc, but both failed)
For test case, since the data is from index, then it cannot use mock data. Test case needs to be updated.
Since I'm using new components, some functionality still not applied here (loading, empty state, preserve url parameter, etc)

For the sorting, it's intended since the schema I wrote doesn't store any numeric value to be sorted. Results are sorted by relevance by default.
Do you need any sortable field for this? If so, let's put that

@zainfathoni @ekamuktia Created an environment variable in the Netlify dashboard called NEXT_PUBLIC_TYPESENSE_API_KEY. Let's put all secret values (e.g. apiKey) there.

For this, how can I use it on the code? Like this process.env.NEXT_PUBLIC_TYPESENSE_API_KEY?

Yes, something like that.
And to make it work in the GitHub actions, you need to pass secrets.NEXT_PUBLIC_TYPESENSE_API_KEY to the environment variables.

Tried to use process.env.NEXT_PUBLIC_TYPESENSE_API_KEY but the testing failed so I can't commit/push.
Tried adding setupFiles: ["dotenv/config"] in jest.config.js as mentioned here but it didn't work.

For the sorting, it's intended since the schema I wrote doesn't store any numeric value to be sorted. Results are sorted by relevance by default.
Do you need any sortable field for this @ekamuktia ? If so, I'll put that on

@famasya
For FAQ, I may need it based on the row order on the sheet (just like current order)
And for Contact data, I need to order by verifikasi

Putting reference: https://www.algolia.com/doc/guides/building-search-ui/going-further/server-side-rendering/react/
In case we want to support a static filtering via path param

How can I checkout from this branch ya 😂?

How can I checkout from this branch ya 😂?

You can use GitHub VSCode Extension, Mas @mazipan.
There's an option to checkout to the Pull Request, and when you make commits on top of it, you can push it into the remote branch, even if the branch is on a forked repository. 😎


Deploying multiple stylesheets

My application has multiple sub-domains with very different use cases. While the sub-domains share some comment elements, each has a series of stylesheets that utilise @apply as part of a system to create reusable components.
The first step in migrating from Webpack was simple enough; instead of bundling Tailwind into stylesheets for each section, tailwind.css is shared across the sub-domains and the unique styles are kept in separate stylesheets.
When it came to ensuring the component CSS was compiled by Tailwind, however, I found the process a bit painful due to a lack of documentation. After seeing in the README that:

If you need to use a custom input or output file, you can run bundle exec tailwindcss to access the platform-specific executable, and give it your own build options.

I was able to use tailwindcss to compile the component stylesheets in development. When attempting to deploy, however, I encountered an exception running assets:precompile because Sprockets couldn't find the compiled stylesheets. It seemed that running that tailwindcss in production didn't fix the issue.
Digging into tailwindcss: build showed me that application.tailwind.css is hardcoded and so I ended up enhancing the task to compile any stylesheets that include ".tailwind" in the name.
I think the deployment process needs better documentation to avoid unfortunate surprises and, if there isn't currently a better way to compile other files, it would be nice to discuss creating a convention. While ".tailwind.css" is the reverse order to how Sprockets works, the idea of using file extensions as an indication that processing is required has already been established, maybe this could be expanded upon?

I've now also enhanced the tailwindcss:watch task to use threads to run multiple instances of the Tailwind watcher. It's hardly elegant but it seems like it'll work until there is time for discussion.
I've also raised a feature request on the tailwindcss project asking for the CLI to support multiple inputs and outputs. While we could solve the issue just for this gem, it would probably be nicer if it was supported by the underlying CLI

Let's consolidate this conversation into one place: https://github.com/rails/tailwindcss-rails/discussions/355


Defaulting to random emulatorID causes inconsistant results

By default SA should use a consistent emulatorID on every run. To randomly cycle through emulators, the user must explicitly set a default flag.
Proposal:

If emulatorId is null or undefined when calling SecretAgent.createBrowser() then default emulatorId will be used (for now, it will be chrome-80).

If emulatorId is set to "random" then a random emulator will be picked.

If emulatorId is set to a valid/known emulator then use that.

Otherwise (if emulatorId is invalid/unknown) then throw an error.

I wonder if this shouldn't evolve into looking a bit like Browserlist:

Defaults
Top 3 Browsers
Last 3 versions Chrome, Last 2 versions Safari

@blakebyrnes v2?

For sure. Just wondering where an api like this goes.


Customize endpointId

Issue #, if available:
For users to customize endpointId in Analytics
Description of changes:
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Wrong branch, close


Can't work with "gzip, deflate"

When add http.header like this:
head := http.Header{}
head.Set("Accept", "*/*")
head.Set("Accept-Encoding", "gzip, deflate")
head.Set("Connection", "keep-alive")
bow.SetHeadersJar(head)

Then method Body can only got garbled text like:
�Z�SW�<�W��Af����ĔF'�[)�jz���=v��C��D1�h⃨(����H4�A�Y�g�俰���s�l�R\�}���{��BߎG�?v�+c%�ا���d�D�@2y �;�A��a.�HqyMPtِUE(%�?�9

And many other method(like Title, Links) can't get expected results.

Hi, I've submitted PR #104 for this. Pretty straightforward.


[zh] Resync kubelet configuration

The kubelet reference was out-of-sync, and there have been some new changes in 1.20. This PR does a fresh resync.

Every time I see your PR, I have kind of foreboding... cause it is a huge one 😨

@howieyuen It was huge. It took me 4 hours to get it done. I had to run kubelet --help on 1.20, cross verify the English version (which is also outdated) and the Chinese version (much older).

preview: https://deploy-preview-25812--kubernetes-io-master-staging.netlify.app/zh/docs/reference/command-line-tools-reference/kubelet/

It takes me one hour and a half to finish reviewing~~~hope these are valuable suggestions

It takes me one hour and a half to finish reviewing~~~hope these are valuable suggestions

Thanks for the huge effort. I cannot figure out for how long this page has been outdated. It was a huge effort to sync and to review.

/lgtm

/approve

/approve


Update to senzing/template-python:1.2.0

See https://github.com/Senzing/template-python/issues/14
Tasks
:black_square_button: Update README.md
:black_square_button: Update Preamble "Documentation issue" URL
:ballot_box_with_check: Add .github/ISSUE_TEMPLATE/documentation_request.md
:ballot_box_with_check: Delete .github/README_TEMPLATE
:ballot_box_with_check: Add docs/README.md
:ballot_box_with_check: Add docs/errors.md
Legend
:black_square_button: Not done
:ballot_box_with_check: Done

closed due to inactivity


require("html2canvas.min");           html2canvas is not defined

Please make sure you are testing with the latest release of html2canvas.
Old versions are not supported and issues reported for them will be closed.
Please follow the general troubleshooting steps first:

[ ] You are using the latest version
[ ] You are testing using the non-minified version of html2canvas and checked any potential issues reported in the console

Bug reports:
Please replace this line with a brief summary of your issue AND if possible an example on jsfiddle.
Specifications:

html2canvas version tested with:
Browser & version:
Operating system:

help me


fix for audio.c(607): error C2036 in Visual Studio.

Fix for audio.c(607): error C2036: 'void *': unknown size in Visual Studio 2015.

Is it better to separate the code by _MSC_VER definition?

I've been thinking about the best way to write this... I think it's clearer to use void * to note type-independence but it's true that it's basically a bytes buffer...
I'm merging your change.


Session doesn't work

Hi, i have this setup
"dependencies": {
"@formatjs/intl-relativetimeformat": "^2.8.3",
"@formatjs/intl-utils": "^0.7.0",
"@material-ui/core": "^4.3.3",
"@material-ui/icons": "^4.2.1",
"express": "^4.17.1",
"formatjs": "^0.1.1",
"intl": "^1.2.5",
"isomorphic-unfetch": "^3.0.0",
"js-cookie": "^2.2.1",
"material-ui": "^0.20.2",
"micro": "^9.3.4",
"next": "9.0.5",
"next-cookies": "^1.1.3",
"next-i18n-routes": "^1.0.2",
"next-i18next": "^1.1.2",
"next-session": "^2.0.0",
"react": "16.9.0",
"react-dom": "16.9.0",
"react-intl": "^3.1.13",
"react-redux": "^7.1.1",
"redux": "^4.0.4",
"redux-devtools-extension": "^2.13.8"
}
and here is my /api/x.js test page
import { withSession } from 'next-session';
const yourOptions = {}
const handler = (req, res) => {
req.session.views = req.session.views ? (req.session.views + 1) : 0;
res.send(In this session, you have visited this website ${req.session.views} time(s).)
};
export default withSession(handler, { ...yourOptions });
all i get is "0" after each page refresh

Nevermind i found the error, you didn't write the correct example in JS
this line will always set ZERO
req.session.views = req.session.views ? (req.session.views + 1) : 0;
i've modified it like so
req.session.views = req.session.views ? (req.session.views + 1) : 1; // which is in my opinion even closer to the real world :D

Oh, that's my bad. Thanks for pointing it out. I will update the documentation accordingly.

:)


Pure-python-json

Pure Python implementation of STAC IO for export of the static catalog.

Should that be merged into stac_structure instead?


please add gRPC ability

gRPC adoption grows including on Postman and world adoption on 20% usage most on Google Go ecosystem, but not only and grows and maybe also Rust make it dominance a reality, but JavaScript is reality on cloud streaming providers for a long time...
Now there is https://github.com/grpc/grpc-web as some abstraction and now there is also Microsft love initiative https://grpc.io/blog/grpc-on-dotnetcore/, so it should be in future maybe enabled by default, but some tools are maybe required not only Chrome/Edge DevTools but also network issues and regulations or abilities... https://grpc.io/blog/grpc-web-interceptor/ and a lot of is happening on Conferences worlds... like for 2024
So please make some addititions for your roadmap and also maybe some healthy setup, but it is maybe difficult in the CORS(not only) world and SPACE...

Maybe be in future related with this OpenAPI MS initiative on .NET 9


SCM viewlet needing frequent manual updates

Found myself today several times needing to manually refresh the SCM viewlet before it'd let me commit (it thought the working directory was empty). I haven't seen this before so just heads up

This could be a regression from adopting the file watching support: https://github.com/microsoft/vscode/commit/044092db5597de273b8fe7030332ec3454043102
However, this is not such a big change as it may seem, in the end we still use fs.watch on the provided path, though our watcher covers a lot more corner cases and is more complex:
https://github.com/microsoft/vscode/blob/b03fe7a97c06ae1906efd62e616d383704ee95e7/src/vs/platform/files/node/watcher/nodejs/nodejsWatcherLib.ts#L20
Some questions:

do you have reliable repros?
do you maybe open VSCode with the wrong path casing (i.e. the path you open is not the same as it is on disk)?

@eamodio I think in a different issue you outlined what GitLens is doing to detect changes and it seems the patterns were a lot more complex. Have you noticed any regressions with using that watcher pattern over the past months? I wonder whether the Git extension should use the same patterns as you do to detect changes.

I haven't seen this since so no reliable repro, but I don't have files.watcherExclude configured. I'll keep an eye on possible casing issues.

@bpasero I haven't noticed any issues so far. Ultimately, I think it would be great for the Git extension to get closer to the patterns that GitLens has, so that it can provide more granular repository change events.

@eamodio just to clarify, do you think that the Git extension watching only top level files in .git means some events are missed? Why does GitLens watch a lot more compared to the Git extension?

@bpasero Looking at what I have in GitLens, I don't really think the Git extension is missing anything. The things that I'm watching for outside of the top level, are rebase specific changes and I also listen for all changes in /refs/** (since I show all the branches/tags/etc), where as the Git extension sets up a specific watcher for the upstream of the current ref.
Technically though without watching for any of the /ref/** changes, other users of the Git extension's onDidChange event could be missing something they might care about. But it doesn't affect the current needs of the Git extension itself.

Thanks!

Will watch for more issues like this but currently I am not sure whether this is actionable or not. If fs.watch was catching file events that @parcel/watcher is not, it would be good to learn how we can possibly fix this.
If not possible, we could bring back support for fs.watch even if the folder is within the workspace but that comes at the risk of sending duplicate events (once from @parcel/watcher and once from fs.watch). We can maybe prevent duplicates by adding another delayed filter around all events (from fs.watch and @parcel/watcher) but there is no guarantee about the timing (the one could fire first and the other with a delay later).


Option for post-deployment template

It would be nice to have an option to apply a post-deploy arm template to do things like add additional disks, VM extensions, NSGs etc.

That's an interesting idea, so to be clear you would want the post-deploy arm template to do the same as the pre-deployment template, in the same resource group as the created resources?

Yes thanks, exactly that - it would be really useful for us to make the test VMs look more like production by applying some post deploy config.

I'm parking this one for now as we have lifecycle hooks in Test Kitchen now, see https://github.com/test-kitchen/test-kitchen/blob/00ef30e4b9b0055afd712fa145727431ed628b10/RELEASE_NOTES.md#life-cycle-hooks

Released in v0.14.4


Update Emacs instructions to use MELPA

Allows users to use a package manager to install import-js. Also, fix some escaping.

Looks good. Does this require a new gem being built? I'm assuming it doesn't.


Load playlist status has always been loading

mpv_player.dart 144 row
_setState(_State.ready);
await update();

This doesn't look like a bug report.


Preprocess fill [WIP]

[ ] Closes #423  .
[ ] I am familiar with the contributing guidelines.
[ ] Tests added.
[ ] Updates entries to docs/source/api.rst for API changes.
[ ] Adds descriptions to appropriate "what's new" file in docs/source/whatsnew for all changes. Includes link to the GitHub Issue with :issue:`num` or this Pull Request with :pull:`num`. Includes contributor name and/or GitHub username (link with :ghuser:`user`).
[ ] New code is fully documented. Includes numpydoc compliant docstrings, examples, and comments where necessary.
[ ] Maintainer: Appropriate GitHub Labels and Milestone are assigned to the Pull Request and linked Issue.

Completed:

added the preprocessing apply_fill methods
datamodel.ReportParameters added missing_forecast str attribute

TODO:

[ ] finish test preprocessing.process_forecast_observation for ProbabilisticForecast (need to support DataFrames) - add test for DataFrame for apply_fill
[ ] Added results as datamodel.PreprocessingResult
[ ] Add the preprocessing result to report raw and html

@alorenzo175
Let me know if i can help given your guidance, at least for the core side (api.py).

@alorenzo175
Let me know if i can help given your guidance, at least for the core side (api.py).

Thanks. I don't think any changes will be required actually. We should make sure to set some default on the new datamodel field though so that loading old reports works.

@alorenzo175
Let me know if i can help given your guidance, at least for the core side (api.py).

Thanks. I don't think any changes will be required actually. We should make sure to set some default on the new datamodel field though so that loading old reports works.

Cool. I'll go with 'forward' for now and we can change it later if needed.

hanks. I don't think any changes will be required actually. We should make sure to set some default on the new datamodel field though so that loading old reports works.

Cool. I'll go with forward for now and we can change it later if needed.

Old reports used exclude, so this could be a problem if anything in the report serving process actually looks at it (I don't think it does). We'll also need to think about what to do with the reference site reports - perhaps explicitly set exclude.

Old reports used exclude, so this could be a problem if anything in the report serving process actually looks at it (I don't think it does). We'll also need to think about what to do with the reference site reports - perhaps explicitly set exclude.

Maybe confusing but exclude is only applied to the validation of the observations. drop is used for the forecast fill.  Because of how exclude is based on the quality flags it is a unique function.  I can give some thought how we merge the observation and forecast handling methods but I think they are distinct enough where they have to be considered separate.
I"ll change drop to be the default.

I think everything in metrics for this is done and the processed results are producing the PreprocessingResult for the forecast fill with what I think are reasonable human-readable names:

"Total Forecast Values Dropped" for the drop method
"Total Forecast Values Forward Filled" for the forward method
"Total Forecast Values Filled with 99.9" for the constant fill method for example of '99.9'
Forecast is replaced with "Reference Forecast" if it is such

I'll start working on integrating it into the reports.

@wholmgren , @alorenzo175
I'm trying to merge the latest changes and getting an error with the metrics result construction when running the reports.  (This is just recent as I ran it yesterday before I merged the latest master branch). I see that the master branch completes the CI so the tests on that branch must be passing, and I haven't done any changes to metrics so I'm a bit stumped what I did. The error occurs on the abbreviation function as it is expecting a string but instead gets a Forecast. Anyone have any ideas?
(venv37) pawi002@pawi002-MBP solarforecastarbiter-core % solararbiter report -u<EMAIL_ADDRESS>-p Thepassword123! --base-url https://api.solarforecastarbiter.org ./solarforecastarbiter/tests/data/report_metadata.json ./solarforecastarbiter/tests/data/result_det_report.html
/Users/pawi002/software/solar_arbiter/venv37/lib/python3.7/site-packages/pvlib/clearsky.py:749: RuntimeWarning:

invalid value encountered in less

/Users/pawi002/software/solar_arbiter/venv37/lib/python3.7/site-packages/pvlib/clearsky.py:750: RuntimeWarning:

invalid value encountered in less

/Users/pawi002/software/solar_arbiter/venv37/lib/python3.7/site-packages/pvlib/clearsky.py:751: RuntimeWarning:

invalid value encountered in greater

/Users/pawi002/software/solar_arbiter/venv37/lib/python3.7/site-packages/pvlib/clearsky.py:751: RuntimeWarning:

invalid value encountered in less

/Users/pawi002/software/solar_arbiter/venv37/lib/python3.7/site-packages/pvlib/clearsky.py:752: RuntimeWarning:

invalid value encountered in less

/Users/pawi002/software/solar_arbiter/venv37/lib/python3.7/site-packages/pvlib/clearsky.py:754: RuntimeWarning:

invalid value encountered in less

2020-06-26 16:07:23,927 WARNING Only filtering on Quality Flag is currently implemented
2020-06-26 16:07:24,358 ERROR Uncaught exception
Traceback (most recent call last):
  File "/Users/pawi002/software/solar_arbiter/venv37/bin/solararbiter", line 11, in <module>
    load_entry_point('solarforecastarbiter', 'console_scripts', 'solararbiter')()
  File "/Users/pawi002/software/solar_arbiter/venv37/lib/python3.7/site-packages/click/core.py", line 764, in __call__
    return self.main(*args, **kwargs)
  File "/Users/pawi002/software/solar_arbiter/venv37/lib/python3.7/site-packages/click/core.py", line 717, in main
    rv = self.invoke(ctx)
  File "/Users/pawi002/software/solar_arbiter/venv37/lib/python3.7/site-packages/click/core.py", line 1137, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/Users/pawi002/software/solar_arbiter/venv37/lib/python3.7/site-packages/click/core.py", line 956, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/Users/pawi002/software/solar_arbiter/venv37/lib/python3.7/site-packages/click/core.py", line 555, in invoke
    return callback(*args, **kwargs)
  File "/Users/pawi002/software/solar_arbiter/solarforecastarbiter-core/solarforecastarbiter/cli.py", line 343, in report
    raw_report = reports.create_raw_report_from_data(report, data)
  File "/Users/pawi002/software/solar_arbiter/solarforecastarbiter-core/solarforecastarbiter/reports/main.py", line 194, in create_raw_report_from_data
    report_plots = plotly_figures.raw_report_plots(report, metrics_list)
  File "/Users/pawi002/software/solar_arbiter/solarforecastarbiter-core/solarforecastarbiter/reports/figures/plotly_figures.py", line 937, in raw_report_plots
    metrics_df = construct_metrics_dataframe(metrics, rename=abbreviate)
  File "/Users/pawi002/software/solar_arbiter/solarforecastarbiter-core/solarforecastarbiter/reports/figures/plotly_figures.py", line 618, in construct_metrics_dataframe
    'abbrev': f(metric_result.name),
  File "/Users/pawi002/software/solar_arbiter/solarforecastarbiter-core/solarforecastarbiter/reports/figures/plotly_figures.py", line 638, in abbreviate
    components = x.split(' ')
AttributeError: 'Forecast' object has no attribute 'split'

Thanks, @wholmgren . I still have 2 tests failing (1 each in test_reports_main.py and test_cli.py) but will try to fix them tongith or this weekend.

Here's an example of a report the fills using a day that is missing GFS for a day and fill of "999.999" just to make it obvious.

The template picks the PreprocessingResult for the fill up nicely as well.

The text above the table  needs to add the fill process on the forecasts (2nd step).  I'll take a stab at it but you may want to wordsmith it yourself obviously.
I've tested each of the forward, drop and numeric fill it they all seem to work fine.
Also do you know of any forecasts that are filled with actual NaN values instead of the data being missing so I can try it out?
my test json file

{
  "_comment": "This file is not currently used for tests, but can be used with the CLI tool to generate a real report when using data from the prod. API.",
  "report_parameters": {
    "name": "UO SRML Ashland OR PV  GHI Forecast Analysis June 9 missing test fill",
    "start": "2020-06-07T07:00:00Z",
    "end": "2020-06-10T07:00:00Z",
    "missing_forecast": "999.999",
    "filters": [
      {
        "quality_flags": [
          "USER FLAGGED",
          "INCONSISTENT IRRADIANCE COMPONENTS"
        ]
      }
    ],
    "metrics": [
      "mae",
      "rmse",
      "mbe"
    ],
    "categories": [
      "total",
      "date",
      "hour"
    ],
    "object_pairs": [
      {
        "forecast": "0b4da1f6-9a07-11e9-a1ee-0a580a8003d4",
        "observation": "93d0c01a-7e49-11e9-a9fd-0a580a8003e9"
      },
      {
        "forecast": "84cb6bf6-9c22-11e9-840a-0a580a8003d4",
        "observation": "93d0c01a-7e49-11e9-a9fd-0a580a8003e9"
      }
    ]
  }
}
/details>

The output looks good.

Also do you know of any forecasts that are filled with actual NaN values instead of the data being missing so I can try it out?

I don't, but as long you have a test for this I'm not too worried about it.

@wholmgren All tests are passing. Ready for review.

Thanks @awig. Comments on the code below. I've not yet looked at the tests.

All tests are passing except now that I"m using the interval_label with the datamodel.CLOSED_MAP I get an error for EventForecast because "event" is not a key in the dictionary.
See
https://github.com/SolarArbiter/solarforecastarbiter-core/blob/b0d2c89d79656d37bce996e8225a90872fe6814c/solarforecastarbiter/conftest.py#L1010
@wholmgren @alorenzo175  Suggestions?

All tests are passing except now that I"m using the interval_label with the datamodel.CLOSED_MAP I get an error for EventForecast because "event" is not a key in the dictionary.
See
https://github.com/SolarArbiter/solarforecastarbiter-core/blob/b0d2c89d79656d37bce996e8225a90872fe6814c/solarforecastarbiter/conftest.py#L1010
@wholmgren @alorenzo175 Suggestions?

I think we're treating event forecasts like instant, so we could add that to CLOSED_MAPPING. I'll let @wholmgren verify

I think 'event': None is the way to go.

I think 'event': None is the way to go.

Done and done. Everything seems to be passing


Upgrade to Vaadin 24.1.2, 24.0.9

@ZheSun88 there is no need to create PRs bumping the version here, this is done in a cron job

In fact this was already done in: https://github.com/quarkusio/quarkus-extension-catalog/commit/e1474ce93a751685bd338436b73b8a1f516af2f7
Closing this PR now


Setting for cpu_has_dotprod = false

How to enable cpu_has_dotprod for ARM CPU?
The ./arm_compute_benchmark benchmark has indicated me there is no this feature ebnabled.

Hi @peter197321 ,
That's probably because either your CPU doesn't support it or you're using an old Linux kernel.
What device / platform are you running on ?

I have NXP i.MX8 4xA53 and 2xA72
root~# uname -a
Linux 4.14.78-imx_4.14.78_1.0.0_ga+g66620c3 #1 SMP PREEMPT Fri Feb 1 09:09:25 UTC 2019 aarch64 aarch64 aarch64 GNU/Linux
How to check if cpu_has_dotprod is available or what that cpu_has_dotprod is (hw support, some sort of library) ?

You need a cpu that supports the Arm v8.2 dot product instruction (i.e Cortex-A55 / Cortex-A75 and above)
Cortex-A72 and Cortex-A53 CPUs implement v8.0 and therefore don't have the dot product instruction


fix translator handle position and segment

Closes: https://github.com/napari-threedee/napari-threedee/issues/179
Alternative to: https://github.com/napari-threedee/napari-threedee/pull/180
So in this PR I eliminate the small gap and put the handle at the end of the extra segment.
Here's what it looks like with a bit of zoom -- when zoomed out and the handle Marker covers much of the extra segment.

Hey @psobolewskiPhD ! I am sorry, but I've lost track of where we are with the translator handle updates. How does this interact with #174? Do we merge this first and then you merge these changes into #174?

@kevinyamauchi Exactly what I was thinking.
This fixes the visualization of the manipulator.
Then, i think for #174 to work properly, the little line segment also needs to be adjusted, so if the user wants a radius 5 manipulator the line segment would get shorter as well.
something like floor(radius/7)+1 (the ratio of length to radius before was 7)


Add license information

Hello!
I found link to this project from https://habr.com/ru/post/534964/
Could you please add information about license of this repository — is it allowed to copy, change and use the code in any purpose?
It would be great to see any popular open source license.

Thanks for the note. I added MIT license.


fix validation bug in wrw group conv

Fix validation bug in wrw group convolution.
length_filter = ngroups * (k / ngroups) * (c / ngroups) * y * x
Please check if smoke_test.sh produce right results.

pls fix conflict file


UI Response Update Incorrectly

I am able to successfully mint but the response says "minting failed! please try again!" And the mint count does not update.
Also, when minting with WL token, the mint completes but the WL token amount does not update, and the mint count also does not update.
Currently testing on devnet.

Which commit are you using ?

The latest one
On Wed, Jul 6, 2022 at 1:20 AM Andrew @.) <
@.> wrote:

Which commit are you using ?
—
Reply to this email directly, view it on GitHub
https://github.com/Fulgurus/candy-machine-v2-responsive-ui/issues/28#issuecomment-1175928817,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AZ52LYO4LTFLSEO3KFFO6H3VSU6VNANCNFSM52XRNOAQ
.
You are receiving this because you authored the thread.Message ID:
@.***>


Reconcile - component k8s service type can't be overridden in the env specific config file.

It looks like it's impossible to override the K8s service type for compose services auto-inferred as LoadBalancer.
To replicate get an example compose service spec, e.g.:
version: '3'
services:
  mongo:
    image: mongo:3.2
    volumes:
      - mongo-data:/data/db
    ports:
      - 27017:27017

volumes:
  mongo-data:

then override k8s service type in env specific override, e.g.:
version: "3"
services:
  mongo:
    labels:
      kev.service.type: clusterip

Reconciler will persist the kev.service.type label, however its value will revert to that originally inferred from the source compose i.e. LoadBalancer.

As discussed before, this is by design since we view the kev.service.type as specialised configuration better handled internally by Kev.
I propose re-working this as a new feature rather than a bug.
Here's a proposal that can allow more informed developers to force an override,

Introduce a new reconcile-exclude param in kev.yaml.
reconcile-exclude, enables a developer to exclude specific service labels from reconciliation - as they know best.
For now, it will only affect kev.service.type (its the only label that is affected by the base changes).
If the service is removed, reconciliation will also remove the reconcile-exclude.<service> from kev.yaml.

Here's a draft of how this would look:
compose:
  - docker-compose.yaml
environments:
  dev:
    source: docker-compose.kev.dev.yaml
    reconcile-exclude:
      db:
      - "kev.service.type"
  staging:
    source: docker-compose.kev.staging.yaml

If this is not surfaced to the end user (i.e. transparent) then we could go with the above. kev.service.type is a key element that user should be able to override. And this will be potentially true for other things.
I wasn't aware of such behaviour in the reconciler so assumed it was a bug, because it doesn't meet the functional requirements.

@marcinc Making this work as reported is simple, we just stop reconciling upstream updates to the K8s service type.
The reason it works as it is now, is that developers configure the service type implicitly. They simply change the ports config and we infer what that means.
IMO, I would personally like kev to take care of this for me. And then, allow power to users to wield their will per environment.
(happy to discuss some more)

But that precisely the point. Kev takes care of it at the moment so in most cases it should work, however, if for whatever reason you don't like that choice or have a particular use case you should be able to override it and have that choice persisted. Detail of what's stored in kev.yaml isn't end user's concern so am OK with the approach above.

I think we need 5 - 10 min brainstorm to think / work this through - including how it works internally.

How about we initially derive service type from the compose project (as we do currently) and make it visible in the env overrides, so that it's obvious to the user as to what to change?
Any consecutive changes to the source Compose could potentially result in different derived service type, which is fine - just this time the information will be immediately visible to the user as service type config parameter will be included in the reduced list.
Also, when service type change has been noticed it'd be good to communicate that to the user with notable changes section or something to highlight it better...

OK, so I’d approach that in the following way:

Init -> service type discovered and added to environment configs
Reconcile -> derives service types (as it does currently),

if derived type is the same as what’s in the environment:

Nothing do to here - no need to communicate anything to the user!

If derived type is different than current environment override value

Notify the difference to the user e.g. “- App component X appears to require LoadBalancer but it’ll use ClusterIP service as defined in dev environment config!”

This way, we basically say that first time we always derive the service type, and notify the user about the discrepancies in the configuration if they diverge over time.

Addressed by https://github.com/appvia/kev/issues/299