DataDEX open grants application

Grant Application Checklist

[ ] The application-template.md has been copied, renamed ( "project_name.md") and updated.
[ ] A BTC or Ethereum (DAI) address for the payment of the milestones is provided inside the application.
[ ] The software of the project will be released under the Apache license version 2.0 as specified in the terms and conditions.
[ ] The total funding amount of the project is below USD $30k for initial grant applications and $100k for follow-up grants.
[ ] The initial PR contains only one commit (squash if needed before submitting your PR).
[ ] The grant will only be announced once we've successfully delivered the first milestone.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

All committers have signed the CLA.

done.

Thanks for the additional information. Another issue I see is how do you prevent people from “stealing” data. For example, I buy someone else's data, I change a very small part of it in a way that the hash of data changes and I just sell the same data? Maybe you could explain the DataGraph a little bit more. Additionally how do you ensure the availability of the data. For example, I buy data on the exchange, but it’s actually no longer available and I can not download it.

Thanks for comment. DataGraph is designed with multi-properties schema. After register the data, the Data Owner could be verified the ownership from multiple dimensions, not only the userid. If the malicious data owner just modifies a small part, other dimensions will conflict to the real data, the registration cannot be successfully submitted and cannot be successfully verified.
We will also reward community members who voluntarily find malicious data or errors (we hope that Dataset Maker will play a leading role), based on data characteristics analysis and relevant in data technology. and then owners with data faults should be punished. We have rich experience in anti fake products for e-commerce platforms with this similar technology.
If the data owner could not guarantee the data availability, including the data non-exists or the data unregistered etc. The tasks scheduled by the computing node(Phala, Alita network etc.) to the device of data owner will fail,  DataDEX can not check the verification of task, so the DataOwner can not get the rewards.

on-chain mechanisms to identify “malicious data”,

Thanks for your advice. I have integrated specifics in application, pls check it.

Thanks for the update. I have a few follow-up questions: Is this your previous project: https://github.com/ALITANetwork? Why do you want to start using substrate now? Are the UIs part of the repo the ones, which you plan to develop? And are you familiar with burstcoin?

Are the UIs part of the repo the ones, which you plan to develop

Yes, AlitaNetwork is our previous project, which is a privacy-preserving edge computing network. One of the component accounting networks is developed based on burst. But afterwards, we met the situation that we have too much work in the development of the public chain. and found that the openness and friendship of substrate can greatly help us reduce the workload and invest our time in data and computing that we are more familiar with. In addition, polka has rich ecological resources, and the staking economic model is more fitted for us to expand the community, so we plan to migrate to substrate.
Since the new project will be developed based on substrate, we hope that the previous UIs need to be totally refactored.
Thanks.

Hi @Noc2 , thanks for your time. It's a nice conversation.
Would you please review the comment above? And I'm glad to answer in details if there are any other issues.

Sorry for the late reply. So the UI will be based on your previous work, correct? I would still be interested in learning more about your relationship with burstcoin.

Sorry for the late reply. So the UI will be based on your previous work, correct? I would still be interested in learning more about your relationship with burstcoin.
Thanks for your reply.
No. UI will be rebuilt because it integrates burstcoin wallet sdk, which is unusable for substrate.
About the relationship with burstcoin, let me introduce the stack of the previous project.
There are three main components:

Computing network, PC version container service based on k3s and Task Executor based on Android. We also developed the container orchestration service for the business clients.
Storage network, the data to process is stored in the private forked instance of IPFS network, which is extended to read and write row based flat files.
Accounting network, token mining, payment and smart contract(in Java and based on CIYAM), private forked from burstcoin. We plan to port to substrate chain and refactor the contract in Ink!. And also UIs will be redesigned.

Additionally, we have no cooperation with the burstcoin project or the community.

Hi @Noc2 What are your main concerns about the previous project? I would be very glad to hear your suggestions. Thanks.

Thanks for the additional information. In this case, I recommend to make sure that you properly point out in your repos which work was done by you and which was copied/cloned by burstcoin. I have another question: Are you planning to deliver: “Data Registeration Entry'' and “Data Graph DAO” as part of the grant? In the meantime I will share the application with the rest of the team.

Hi @gravity-link, a few questions from my side:

I don't understand this bit: If the malicious data owner just modifies a small part, other dimensions will conflict to the real data, the registration cannot be successfully submitted and cannot be successfully verified.. If I were to buy a dataset, then add a character somewhere and recalculate all hashes, the end result is a new dataset with a different hash. Also, I could combine two datasets in a random order and recalculate hashes, and it would be very hard -- even for a human observer -- to detect that the data was stolen. Can you expand on that?
Can you also explain this bit: dataset pools everyone’s data supply and demand liquidity together and makes markets? How do you calculate supply and demand for a dataset? Is this demand for this particular dataset, or similar data on the platform, or all data? Can there by an unlimited number of data owners?
What does the mobile app do? Mobile seems an odd platform for data-centric applications.
Do you have an English version of your lightpaper?
Do you have a specific target audience in mind, e.g. medical companies? Do you already have potential users?

In the meantime I will share the application with the rest of the team.

Thanks for the suggestions.
I have revised milestone including DAO and registeration entry.
and I will update the doc in repos of pervious project to point out the third party code reference.

Hi @gravity-link, a few questions from my side:

I don't understand this bit: If the malicious data owner just modifies a small part, other dimensions will conflict to the real data, the registration cannot be successfully submitted and cannot be successfully verified.. If I were to buy a dataset, then add a character somewhere and recalculate all hashes, the end result is a new dataset with a different hash. Also, I could combine two datasets in a random order and recalculate hashes, and it would be very hard -- even for a human observer -- to detect that the data was stolen. Can you expand on that?
Can you also explain this bit: dataset pools everyone’s data supply and demand liquidity together and makes markets? How do you calculate supply and demand for a dataset? Is this demand for this particular dataset, or similar data on the platform, or all data? Can there by an unlimited number of data owners?
What does the mobile app do? Mobile seems an odd platform for data-centric applications.
Do you have an English version of your lightpaper?
Do you have a specific target audience in mind, e.g. medical companies? Do you already have potential users?

Thanks for the comment.

Malicious data owner could not successfully register the data to data graph because registration tool would check out the conflicts to the real data. So the consumer could never to buy unregister data.  Additionally, the verification for conflicts of data registration  would also be multiple checked in DAO  mechanism by other verifiers.
Dataset maker should firstly create new data token(deploy a token contract) and config the quantity of data token. After this maker could initial offer data token to collect registered data from personal owners. Then maker would create data token and main token pairs as a dataset pool and initially liquidation. Data consumers would exchange data token on demand by main token in DataDEX. and the price would be recalculated with constant function mechanism. So It's for particular dataset, not all dataset. But owners could surely contribute to different pools to maximized the data value.
I will translate the light paper into english ASAP.
Yes. We already have business clients in the fields of Mar-tech, online finance and Bio-bigdata, and helping them to find flexible and compliant data source.

In the meantime I will share the application with the rest of the team.

Thanks for the suggestions.
I have revised milestone including DAO and registeration entry.
and I will update the doc in repos of pervious project to point out the third party code reference.

Thanks for the update. I’m happy to go ahead with it, once you have updated the repos. Feel free to ping me here. One additional suggestion from my side: It might make sense to split the deliveries into two milestones. We only pay you once you successfully delivered a milestone and currently you would need to deliver a lot before you get paid.

In the meantime I will share the application with the rest of the team.

Thanks for the suggestions.
I have revised milestone including DAO and registeration entry.
and I will update the doc in repos of pervious project to point out the third party code reference.

Thanks for the update. I’m happy to go ahead with it, once you have updated the repos. Feel free to ping me here. One additional suggestion from my side: It might make sense to split the deliveries into two milestones. We only pay you once you successfully delivered a milestone and currently you would need to deliver a lot before you get paid.

Hi @Noc2 Thanks for your advice. I have split the deliveries into two milestones.
And the repos is also updated, pls check commit1 and commit2.

Hi @gravity-link, thanks for your reply.
I have decided not to approve your application because (a) I think creating a new token contract for every dataset being sold seems inefficient, (b) linking a dataset to a limited amount of tokens sounds like artificial shortage, and (c) if I were to sell my personal data to the highest bidder, I would at least like to know who I'm selling to. I'd rather not have them bound to a token that might get passed around.
I also wouldn't want to encourage people to sell their personal data, although I do appreciate the idea of at least making it a transparent marketplace!

Hi @gravity-link, thanks for your reply.
I have decided not to approve your application because (a) I think creating a new token contract for every dataset being sold seems inefficient, (b) linking a dataset to a limited amount of tokens sounds like artificial shortage, and (c) if I were to sell my personal data to the highest bidder, I would at least like to know who I'm selling to. I'd rather not have them bound to a token that might get passed around.
I also wouldn't want to encourage people to sell their personal data, although I do appreciate the idea of at least making it a transparent marketplace!

Hi @semuelle  I am very appreciated that you gave us such an in-depth and professional review opinions of the application.
For your concerns, I would like to explain some details:
a) Creating a token for each Dataset is mainly due to data pricing issue. Because the value of the data set is related to the data processing algorithm, scenario, sales scale, and even region and crowd, Dataset Maker will have capability to operate its own data supply and demand market. In our experience, if data pricing is too unified, the data market transaction volume would be very limited.
b) I would like to further explain that limited tokens do not mean limited data volume. Dataset Maker can continuously invite new Data Owners to contribute data(permissions), but according to the price of Token, the incentives for later data Owners are different. Therefore, the limited Token actually provides a control capability of token circulation for the Dataset Maker.
c) We not only hope that the Data Owner can gain data revenue, but also can trace the data usage, including who uses the data and how to use the data. Additionally, What tokenized is data readable privileges, not raw data. I think the mentioned above would be why the personal data should be tokenized.
As we know that have been already a fact that Internet providers used personal data on a large scale. We just hope to help Data Owners get back their benefits they lost.
I know that there is a huge difference between the Economic Model for Personal Data and Enterprise Confidential Data, and also hardworking on that, but I still believe that this is a matter of very social significance and commercial value, and I believe that we are one of the most experienced team to push it forward in progress. So if possible, please consider the feasibility of this application again, thank you very much!
BTW. We will upload the revised english version of Light-Paper tomorrow, which will add specifics on pricing etc. and will post it here ASAP, please refer to it.

Thanks for your honest and professional opinions. I would like to explain following:

Hi @gravity-link. After some consideration, I'm sorry to inform that I will not support this proposal either due to the following reasons:

The application lacks significant details and fails to answer important questions related to your approach, such as:

How you will handle encryption and computation within the TEE.

DataDEX is a marketplace separate from the computing network. Its main functions are data token exchange and data ownership registration. Therefore, there is no need for TEE to encrypt data, which should rely on other private computing networks such as Phala or Alita.

How you will calculate the computing costs of a task.

    Computing costs is calculated with concurrency scaling per minute. For example: Costs=(task1*t1+task2*t2+taskn*tn)*pt

How you will integrate this into the pricing if the data can be bought through an AMM.

   We will leverage Task Oracle to submit tasks and use DataToken to pay for the cost of accessing data. Task Oralce has a pallets communicates with other computing networks across the chain through XCMP. I will add rest components design details.

In addition, cost calculation and data price measurement are already common pricing strategies. I added reference about AWS data exchange pricing in the bottom of application.

How you will guarantee the legality and correctness of the data (simply claiming this will be solved through DAO is not enough).

 There is a Checker Node in Task Oracle to check Task read permissions. For correctness, we currently use the local pin of ipfs to ensure that the data is not collected locally, and to check the hash wether match with registered in DataGraph.

How the registration tool could prevent conflicts with existing data as per Sebastian's comment.

 DataGraph would be a well designed catalog for personal data. Register tool could check for conflict to other data with data properties in meta and the data hash.

...and a long list of further inconsistencies and inaccuracies.
sorry for the readable experience. I will recheck and be very grateful to let us know if there is any inconsistency.
See the Ruby Protocol application for a very good example of a proposal for a project with similar aim.

Awsome, it seems be a privacy computing project. But I am not sure why it aims on personal data, and it seems to be suitable for non-personal data too. I hope it would be a compute node of DataDEX. I will follow its progress and would like to learn from its scheme.

Your answers to previous comments are generally vague and do not provide concrete answers to the mentioned challenges.

I will improve this.

I also think the idea of creating a separate token for each dataset is too convoluted and even unnecessary. I don't see why it wouldn't be enough to charge per computation since this would also lead to larger returns for datasets in higher demand.

DataDEX designed for high quality and high volume of dataset, not only the number of dataset. I have added a reference that Google built one high quality dataset distributed to millions users mobile phones for Next Word model training.So I believe creating a token for a dataset of great value would be make sense.

The Alita repos have been dead for a while and only contain significant commits by one person. I do not think this is a strong reference.

There are 3~5 engineers working for Alita project. Some components have not open source but soon.

Your future plans are requirements rather than plans and lack an appropriate strategy to achieve those.

Thanks for your advice. I will continuously add specifics in application.

Thank you for your clarifications @gravity-link. Your first point in specific is valid and I had misunderstood this aspect of your application. However, I don't see how any of your updates or other answers address my concerns and I stand by my decision. Others might be convinced though, let's give the application a bit more time.

Hi @alxs , @semuelle ,
About the issue of creating an unique token for each dataset, I want to share a news. Google Chrome create new tracking method called FLoC, which means that everyone’s browsing history will be added to the same dataset, which is very large volume and valuable. We just would like invite such great dataset makers to operate high-quality and high-value-added data, not dataset flea markets. From this perspective, the token of each dataset is make sense.

Closing since there seems to be no interest from other members of the committee either. As previously stated, there are a number of issues you haven't addressed yet and the proposal lacks technical details, neither of which has improved in your last update.
Feel free to reopen an application when you're further along with your project and are able to address these issues.


Remove "debugger;" statements as there is no easy way to turn these off; instead devs can opt-in to setting breakpoints where they want

Removes "debugger;" statements from our asserts.
I've heard support for this in the office, but want to see if there's support from everyone:
@mmoskal @pelikhan @abchatra @shakao @riknoll
The problem is that the debugger statement is hard to opt-out of. Manually set breakpoints can be toggled on-off in the Chrome debugger or VSCode. If there's a failed assert, we'll see it in the console and it's trivial to set a breakpoint then.
We have some occasional assert fails (especially when working with multiple tabs) that for better or worse haven't been fixed for many months. I don't see us taking the stance that we must fix every assert failure always, so let's not pretend every dev will jump in the debugger and derail their other work.

I like the debugger statements. The source locations of asserts keep changing so you have to keep moving your breakpoints.

Maybe guard it with pxt.options.debug ?

The only one that's been particularly annoying for me has been trying to access outdated session, which I hit multiple times a day; could we just make that one fail without debuggering first, and see if there are any remaining problematic ones after that?

+1
If asserts keep failing then they should be removed or fixed. Don’t we report these in AI?

Alright, I'll see about fixing or changing that one assert.
So looks like going forward we should fix asserts that fire proactively, otherwise we end up in the situation again where we're constantly thrown into the debugger without actually fixing anything.

Looking at the code, it seems the assumption of single tab ownership is pretty ingrained. I filed this issue: https://github.com/microsoft/pxt/issues/6276
but I'm not going to fix it now. I think that will take some serious thought. Instead I'm demoting the assert to a warning since most of the time things seem ok: https://github.com/microsoft/pxt/pull/6277

I don’t think demoting the assert is the right thing to do. What happens when 2 tabs are opened on the same project?

I don’t think demoting the assert is the right thing to do. What happens when 2 tabs are opened on the same project?

Bad things. I think it's a likely culprit to the bug where they loose all their code. We should absolutely fix it. That's why I filed the issue.
But we aren't. At least not yet. We've explicitly decided not to fix this right now so asserting it every day isn't helpful.

If you remove the assert, they will loose the oldest code. It will still have weird consequences. If we remove the assert, it will stay broken forever.

Alright well either someone should fix it or we should remove the debugger statement on that particular assert because it steals focus on my dev tools like ten times a day. All it's doing right now is annoying everyone.


Adding Spanish Language

Hello there! nice simple package!
I was needing something similar but on Spanish, that why I decided to make a PR to you!
hope like the idea!
regards

@frani It's released new version!
https://www.npmjs.com/package/random-fruits-name


Fix stage shorthand from st to g

:wave:  Hi Xander,
Cool project. I took a peek around and ran into a problem while running kept login. Looks like for Cobra a shorthand flag cannot be more than one ASCII character. This is the response I got when running kept login.
panic: "st" shorthand is more than one ASCII character

goroutine 1 [running]:
github.com/spf13/pflag.(*FlagSet).AddFlag(0xc0001ba200, 0xc0001d4b40)
        /Users/thomaseckert/go/pkg/mod/github.com/spf13/pflag@v1.0.5/flag.go:864 +0x765
github.com/spf13/pflag.(*FlagSet).VarPF(0xc0001ba200, 0x1632470, 0x18e5210, 0x157ec6e, 0x5, 0x157dc84, 0x2, 0x15934c9, 0x2c, 0xc0001d4aa0)
        /Users/thomaseckert/go/pkg/mod/github.com/spf13/pflag@v1.0.5/flag.go:831 +0x10b
github.com/spf13/pflag.(*FlagSet).VarP(...)
        /Users/thomaseckert/go/pkg/mod/github.com/spf13/pflag@v1.0.5/flag.go:837
github.com/spf13/pflag.(*FlagSet).StringVarP(0xc0001ba200, 0x18e5210, 0x157ec6e, 0x5, 0x157dc84, 0x2, 0x0, 0x0, 0x15934c9, 0x2c)
        /Users/thomaseckert/go/pkg/mod/github.com/spf13/pflag@v1.0.5/string.go:42 +0xad
github.com/salaxander/kept/cmd.init.1()
        /Users/thomaseckert/go/src/github.com/t-eckert/kept/cmd/list.go:50 +0x1b8
exit status 2

I took a look into it and saw that the shorthand flag fails if it is more than a single ASCII character. So I changed it from "st" to "g". I thought this made sense as the "g" sound in stage is very prominent and the "t" flag was already taken.

Excellent! Thanks!


Use one elasticsearch server of rails application in another rails application

My rails application is running using four ec2 instances. When user hit rails application using url, rails application will be serve to the user using any one of four ec2 instance using ELB.
Elasticsearch server is installed on one of the rails server. How i can use same elasticsearch server which is installed on one server for rest of three rails servers also for searching?
Example:
I have one server(<IP_ADDRESS>) on which ES server installed. I have ssh into it and when i run 'curl 'localhost:9200/?pretty';, it shows me {.....(some text)}. It means ES server is working. I am able to search in my rails application which is running on (<IP_ADDRESS>) server. I have other 3 servers of rails application with ips(<IP_ADDRESS>,<IP_ADDRESS> and <IP_ADDRESS>). Now what i should do that rest of three server can use ES server of (<IP_ADDRESS>) on which ES installed?

So first, you should use a dedicated server for Elasticsearch by all means.
Otherwise, it's just a matter of properly configuring the client host, see https://github.com/elastic/elasticsearch-ruby/tree/master/elasticsearch-transport#setting-hosts. You need to make sure that the IP used is accessible from within your AWS environment, ie. you can ping or curl that server from your application servers.

Yes. when i executed curl 'http://<IP_ADDRESS>:9200/?pretty' its showing me  {.....(some text)} that means ES server is running. But when i do 'http://<IP_ADDRESS>:9200/?pretty', its showing 'curl: (7) couldn't connect to host'. So how i can run it on <IP_ADDRESS>?

This is not a good forum for this question, because it's about basic networking aspects of AWS. You should consult the AWS documentation about how to access a server from another one, about the VPC aspect of AWS, and so on. And when all that fails, contact AWS support.


[DRAFT] Use gitleaks to scrub more credentials

Experiment with using gitleaks for secret scrubbing.

What does this PR do?

Motivation

Additional Notes

Possible Drawbacks / Trade-offs

Describe how to test/QA your changes

Reviewer's Checklist

[ ] If known, an appropriate milestone has been selected; otherwise the Triage milestone is set.
[ ] Use the major_change label if your change either has a major impact on the code base, is impacting multiple teams or is changing important well-established internals of the Agent. This label will be use during QA to make sure each team pay extra attention to the changed behavior. For any customer facing change use a releasenote.
[ ] A release note has been added or the changelog/no-changelog label has been applied.
[ ] Changed code has automated tests for its functionality.
[ ] Adequate QA/testing plan information is provided if the qa/skip-qa label is not applied.
[ ] At least one team/.. label has been applied, indicating the team(s) that should QA this change.
[ ] If applicable, docs team has been notified or an issue has been opened on the documentation repo.
[ ] If applicable, the need-change/operator and need-change/helm labels have been applied.
[ ] If applicable, the config template has been updated.

OK, new draft is up, but I think this may be a bad idea.  See the comment in pkg/util/scrubber/gitleaks/scrubber_test.go.
I think gitleaks is mostly a command-line utility for analyzing git repos and diffs, and is either doing the right thing for those inputs, or has off-by-one bugs that don't hurt for those inputs.  Using it to scrub arbitrary data is just a little too unusual a purpose.
Even if we could make sense of these off-by-one errors and reverse them, I still wouldn't trust this to obfuscate the right stuff.  I don't think it's worth the cost of a new, buggy dependency to mayyyyybe obfuscate some new secrets (or may**********cate the wrong text, like "hunter2").


Modify test transpiler

Summary
This PR is a followup of #10266.
This is a simple PR, in this PR a few tests from test/python/compiler/test_transpiler.py has been changed to use FakeGeneric
Details and comments

https://github.com/Qiskit/qiskit/pull/10266


when the source codes can be released?

I'm trying to reproduce the results: https://github.com/bryandlee/Tune-A-Video


NEW YEAR 2018

I wish you all, an happy new year 2018..
See you in next year..
Vincent

I, too, wish you all a happy New Year! I'm thankful for this library because it enables me to do interesting things, and I'm sure that all the ZeroPhone users&developers feel the same when using software powered by luma.oled =)

I didn't know ZeroPhone used luma.oled - awesome !

And it goes without saying, but huge thanks to everyone involved (especially @thijstriemstra) for making luma.oled and all the other sub-projects what they are.

Thanks, you too people!


Experiencing the same issue

How can this be resolved?
`Aug 14, 2017 11:28:50 AM com.amazonaws.services.iot.client.mqtt.AwsIotMqttConnectionListener onFailure
WARNING: Connect request failure
MqttException (0) - java.lang.NullPointerException
at org.eclipse.paho.client.mqttv3.internal.ExceptionHelper.createMqttException(ExceptionHelper.java:38)
at org.eclipse.paho.client.mqttv3.internal.ClientComms$ConnectBG.run(ClientComms.java:690)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NullPointerException
at org.eclipse.paho.client.mqttv3.internal.websocket.WebSocketHandshake.receiveHandshakeResponse(WebSocketHandshake.java:149)
at org.eclipse.paho.client.mqttv3.internal.websocket.WebSocketHandshake.execute(WebSocketHandshake.java:74)
at org.eclipse.paho.client.mqttv3.internal.websocket.WebSocketSecureNetworkModule.start(WebSocketSecureNetworkModule.java:77)
at org.eclipse.paho.client.mqttv3.internal.ClientComms$ConnectBG.run(ClientComms.java:676)
... 1 more
Aug 14, 2017 11:28:50 AM com.amazonaws.services.iot.client.core.AwsIotConnection onConnectionFailure
INFO: Connection temporarily lost`

Hi @bschupbach ,
Could you elaborate more of your problems so that we can reproduce the issue?
What version of paho client you are using and how did you config your IoT policy? Are you using websocket or cert file?
Thanks

Hello,
You can replicate this by using a java lamda function and the latest version of the IoT hub SDK to send a MQTT message. I had to update my Pom.xml file and override the version of Paho to the previous in order for it to work.
Brian Schupbach
402-770-0035
<EMAIL_ADDRESS>
On Aug 29, 2017, at 10:20 PM, fengyi<EMAIL_ADDRESS>wrote:
Hi @bschupbach ,
Could you elaborate more of your problems so that we can reproduce the issue?
What version of paho client you are using and how did you config your IoT policy? Are you using websocket or cert file?
Thanks
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.

Hi @bschupbach ,
Can you confirm that with Paho MQTT Java client v1.1.0 as the dependency, the issue has been fixed? Also, what is the IoT hub SDK you are using in this case?
Thanks,
Liusu

Using the java SDK. I had to revert to 110. 111 does not work
Brian Schupbach
402-770-0035
<EMAIL_ADDRESS>
On Sep 6, 2017, at 4:50 PM, Liusu Zeng<EMAIL_ADDRESS>wrote:
Hi @bschupbach ,
Can you confirm that with Paho MQTT Java client v1.1.0 as the dependency, the issue has been fixed? Also, what is the IoT hub SDK you are using in this case?
Thanks,
Liusu
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.

Hi @bschupbach ,
Thanks for your confirmation. Glad to know that downgrading the Paho version works for you.
Liusu


Lex refactor branch ("last big breaking lexicon changes")

Working towards #83 mostly
bigsky and laputa compile, havent tested them yet. Still a fair emount left to do

I guess I spoke too soon: the tests pass locally for me (including in a fresh checkout), but not in CI. It is possible that golang 1.19 vs. 1.20 is the issue (I've updated on my laptop; this PR hasn't landed: https://github.com/bluesky-social/indigo/pull/91). But more likely some timing issue.

Some more progress, all tests are passing now. BGS interop with typescript lex-refactor branch is not working yet.
I hacked in the subscription changes pretty quickly, I suspect that more refactoring might be needed in BGS, repomgr, etc. The previous RepoAppend object could be both a repo_append or a rebase, based on the Event field value; now the different event types are different structs. Maybe we should pass around entire XRPCStreamEvent structs? This is just a vague impression, I just "got things to compile" without digging in to how the rebase vs. commit code paths work.
Tweaked a couple lexgen things relating to required-but-nullable fields. This is only implemented on structs for now, not handler function signatures or query params.
Created an issue to track post-refactor follow-ups: https://github.com/bluesky-social/indigo/issues/95
I have hit a couple different errors trying to do BGS interop with typescript implementation. One error looks like:
2023-03-29T21:16:33.850-0700	ERROR	indexer	indexer/crawler.go:160	failed to perform repo crawl of "did:plc:lzkaig7u5entvhqgr4cgabwm": importing fetched repo (curHead: bafyreia7y77ta5i3sazxkkpfmjl5j2adznebxjbps4odgmryrl2v3qffji): process new repo (current head: bafyreia7y77ta5i3sazxkkpfmjl5j2adznebxjbps4odgmryrl2v3qffji): walkTree: can only handle dag-cbor objects in repos (bafkreif6df2wrudglcyzdcx5qcjvv6e6lmipfzghvdzxscl5klgbu4lu6y is 85):

I think that is the indexer code breaking on the new CID links in records, which in the case of blobs are "raw" CID pointers to file bytes (not dag-cbor multicodec). The only other current use of the cid-link datatype is in repo subscription objects, but in the future there might be more CIDs in records pointing to either dag-cbor (in local or remote repos), or raw CIDs (pointing to arbitrary content).
Another error is:
2023-03-29T21:50:03.697-0700	ERROR	bgs	bgs/fedmgr.go:168	failed handling event from "localhost:2583" (252): handle user event failed: signature check failed: invalid signature

I'm not sure what the deal is with that. We have an existing test in testing/sig_test.go for basic signature validation.
New users don't seem to get picked up (or at least logged) by BGS; labelmaker event consumers sees them and ignores.

Ah, as a hint, also seeing the signature failure against typescript when using 'main' branch on both.

Got the embed/union issue figured out. That test still isnt passing yet but its better.


Add dbg_optnone and dbg_extend_lifetimes flags

Adds dbg_optnone to disable optimization on specific functions for better debugging experience.
Adds dbg_extend_lifetimes to extend value lifetimes for better debugging.

from numba import njit

@njit(debug=True, dbg_optnone=True)
def foo(x):
    c = 0
    for i in range(10):
        c+= i
    y = x + c
    print(y)
    return y

r = foo(123)

without optnone, most of the code will be optimized out:
(numba_dev) [root@cd000bcd2aef numba]# gdb -q --args python test_gdb.py
Reading symbols from python...
(gdb) b __main__::foo_241
Function "__main__::foo_241" not defined.
Make breakpoint pending on future shared library load? (y or [n]) y
Breakpoint 1 (__main__::foo_241) pending.
(gdb) r
Starting program: /root/miniconda3/envs/numba_dev/bin/python test_gdb.py

Breakpoint 1, 0x00007ffff6e5d140 in cpython::__main__::foo_241[abi:c8tJTC_2fWwKbcFpQAdBTgEQrlo6UyVFGMNAWVBgYHmKUJAA_3d_3d](long long) ()
(gdb) n
Single stepping until exit from function _ZN7cpython8__main__7foo_241B54c8tJTC_2fWwKbcFpQAdBTgEQrlo6UyVFGMNAWVBgYHmKUJAA_3d_3dEx,
which has no line number information.

Breakpoint 1, __main__::foo_241[abi:c8tJTC_2fWwKbcFpQAdBTgEQrlo6UyVFGMNAWVBgYHmKUJAA_3d_3d](long long) (x=0) at test_gdb.py:10
10	    print(y)

with optnone, gdb will stop at the first line when breaking on the function:
(gdb) b __main__::foo_241
Function "__main__::foo_241" not defined.
Make breakpoint pending on future shared library load? (y or [n]) y
Breakpoint 1 (__main__::foo_241) pending.
(gdb) r
Starting program: /root/miniconda3/envs/numba_dev/bin/python test_gdb.py

Breakpoint 1, 0x00007ffff6e5d930 in cpython::__main__::foo_241[abi:c8tJTC_2fWwKbcFpQAdBSQNMBEYFEM5aOlO1RRjFQGlQYGEJilCQA_3d](long long) ()
(gdb) n
Single stepping until exit from function _ZN7cpython8__main__7foo_241B56c8tJTC_2fWwKbcFpQAdBSQNMBEYFEM5aOlO1RRjFQGlQYGEJilCQA_3dEx,
which has no line number information.

Breakpoint 1, __main__::foo_241[abi:c8tJTC_2fWwKbcFpQAdBSQNMBEYFEM5aOlO1RRjFQGlQYGEJilCQA_3d](long long) (x=123) at test_gdb.py:6
6	    c = 0
(gdb) n
7	    for i in range(10):
(gdb) n
8	        c+= i

Thanks for the patch. Looks like the typeguard tests are failing, expects a bool found an int (failing build is Linux py38_np120_typeguard):
TypeError: type of argument "extend_lifetimes" must be bool; got int instead

This is currently failing CI: https://dev.azure.com/numba/ff1fe4d0-ed73-4f1c-b894-1d50a27e048f/_apis/build/builds/10901/logs/66

Details:
2022-01-26T02:33:08.8964499Z ======================================================================
2022-01-26T02:33:08.8966094Z FAIL: test_array (numba.tests.test_gdb_dwarf.TestGDBDwarf)
2022-01-26T02:33:08.8968458Z ----------------------------------------------------------------------
2022-01-26T02:33:08.8969919Z Traceback (most recent call last):
2022-01-26T02:33:08.8975643Z   File "/home/vsts/work/1/s/numba/tests/test_gdb_dwarf.py", line 30, in test_array
2022-01-26T02:33:08.8977678Z     self._subprocess_test_runner('test_array_arg')
2022-01-26T02:33:08.8979199Z   File "/home/vsts/work/1/s/numba/tests/test_gdb_dwarf.py", line 24, in _subprocess_test_runner
2022-01-26T02:33:08.8980569Z     envvars=self._NUMBA_OPT_0_ENV)
2022-01-26T02:33:08.8981879Z   File "/home/vsts/work/1/s/numba/tests/support.py", line 564, in subprocess_test_runner
2022-01-26T02:33:08.8983399Z     self.assertEqual(status.returncode, 0, streams)
2022-01-26T02:33:08.8987270Z AssertionError: 1 != 0 :
2022-01-26T02:33:08.8988513Z captured stdout:
2022-01-26T02:33:08.8989660Z captured stderr: F
2022-01-26T02:33:08.8990802Z ======================================================================
2022-01-26T02:33:08.8991563Z FAIL: test (numba.tests.gdb.test_array_arg.Test)
2022-01-26T02:33:08.8992684Z ----------------------------------------------------------------------
2022-01-26T02:33:08.8993490Z Traceback (most recent call last):
2022-01-26T02:33:08.8994768Z   File "/home/vsts/work/1/s/numba/tests/gdb/test_array_arg.py", line 40, in test
2022-01-26T02:33:08.8995510Z     driver.check_hit_breakpoint(2)
2022-01-26T02:33:08.8996261Z   File "/home/vsts/work/1/s/numba/tests/gdb_support.py", line 127, in check_hit_breakpoint
2022-01-26T02:33:08.8997301Z     self.assert_output(f'bkptno="{number}"')
2022-01-26T02:33:08.8998093Z   File "/home/vsts/work/1/s/numba/tests/gdb_support.py", line 71, in assert_output
2022-01-26T02:33:08.8999125Z     assert expected in decoded, f'decoded={decoded}\nexpected={expected})'
2022-01-26T02:33:08.9001320Z AssertionError: decoded=*stopped,reason="breakpoint-hit",disp="keep",bkptno="1",frame={addr="0x00007ffff6922047",func="_3cdynamic_3e::__numba_array_expr_0x7fffdfbd4090_242[abi:c8tJTC_2fWwKbcFpQAdBTgEQrlo6UyVFGMNAWTRnjbFhyiwIBFi2OoSkRyQhJATSIwiSKI6ZoA](double)",args=[{name="x_1",value="1"}],file="test_array_arg.py",fullname="/home/vsts/work/1/s/numba/tests/gdb/test_array_arg.py",line="15",arch="i386:x86-64"},thread-id="1",stopped-threads="all",core="1"
2022-01-26T02:33:08.9006892Z (gdb)
2022-01-26T02:33:08.9007835Z
2022-01-26T02:33:08.9008655Z expected=bkptno="2")
2022-01-26T02:33:08.9009174Z
2022-01-26T02:33:08.9010289Z ----------------------------------------------------------------------
2022-01-26T02:33:08.9011027Z Ran 1 test in 8.923s
2022-01-26T02:33:08.9011405Z
2022-01-26T02:33:08.9011905Z FAILED (failures=1)
2022-01-26T02:33:08.9012281Z
2022-01-26T02:33:08.9012620Z
2022-01-26T02:33:08.9013433Z ----------------------------------------------------------------------
2022-01-26T02:33:08.9014090Z Ran 539 tests in 188.147s
2022-01-26T02:33:08.9014499Z
2022-01-26T02:33:08.9015030Z FAILED (failures=1, skipped=57, expected failures=1)
2022-01-26T02:33:09.5174775Z ##[error]Bash exited with code '1'.
2022-01-26T02:33:09.5217046Z ##[section]Finishing: Test

Cannot reproduce yet locally, would guess at the cause being: https://github.com/numba/numba/pull/7752, looks like the first breakpoint is being hit twice in succession, but the reported func for the second hit is _3cdynamic_3e::__numba_array_expr_0x7fffdfbd4090_242, i.e. something dynamically generated that should perhaps not be associated with this file/line.

Cannot reproduce yet locally,

Reproduction occurs on at least Python 3.7.

Python 3.7 gdb session sees the same:
$ cat test_7764.py
from numba import njit
import numpy as np

@njit(debug=True) # Declare here to match location in `test_array_arg.py`
def foo(x):
    z = 7 + x # break here
    return x, z

tmp = np.ones(5)
foo(tmp)

$ NUMBA_OPT=0 gdb -q -ex 'b test_7764.py:15' -ex 'r' --args python test_7764.py
<snip>

Breakpoint 1, __main__::foo_241[abi:c8tJTC_2fWwKbcFpQAdBTgEQrlo6UyVFGMNAWVBgYHmKUJAA_3d_3d](Array<double, 1, C, mutable, aligned>) (x=...) at test_7764.py:15
15          z = 7 + x # break here

(gdb) b 16
Breakpoint 2 at 0x7fffdaf589f5: file test_7764.py, line 16.
(gdb) c
Continuing.

Breakpoint 1, _3cdynamic_3e::__numba_array_expr_0x7fffdb2fa1d0_242[abi:c8tJTC_2fWwKbcFpQAdBTgEQrlo6UyVFGMNAWTRnjbFhyiwIBFi2OoSkRyQhJATSIwiSKI6ZoA](double) (x_1=1) at test_7764.py:15
15          z = 7 + x # break here
(gdb) c
Continuing.

Breakpoint 1, _3cdynamic_3e::__numba_array_expr_0x7fffdb2fa1d0_242[abi:c8tJTC_2fWwKbcFpQAdBTgEQrlo6UyVFGMNAWTRnjbFhyiwIBFi2OoSkRyQhJATSIwiSKI6ZoA](double) (x_1=1) at test_7764.py:15
15          z = 7 + x # break here
(gdb) c
Continuing.

Breakpoint 1, _3cdynamic_3e::__numba_array_expr_0x7fffdb2fa1d0_242[abi:c8tJTC_2fWwKbcFpQAdBTgEQrlo6UyVFGMNAWTRnjbFhyiwIBFi2OoSkRyQhJATSIwiSKI6ZoA](double) (x_1=1) at test_7764.py:15
15          z = 7 + x # break here
(gdb) c
Continuing.

Breakpoint 1, _3cdynamic_3e::__numba_array_expr_0x7fffdb2fa1d0_242[abi:c8tJTC_2fWwKbcFpQAdBTgEQrlo6UyVFGMNAWTRnjbFhyiwIBFi2OoSkRyQhJATSIwiSKI6ZoA](double) (x_1=1) at test_7764.py:15
15          z = 7 + x # break here
(gdb) c
Continuing.

Breakpoint 1, _3cdynamic_3e::__numba_array_expr_0x7fffdb2fa1d0_242[abi:c8tJTC_2fWwKbcFpQAdBTgEQrlo6UyVFGMNAWTRnjbFhyiwIBFi2OoSkRyQhJATSIwiSKI6ZoA](double) (x_1=1) at test_7764.py:15
15          z = 7 + x # break here
(gdb) c
Continuing.

Breakpoint 2, __main__::foo_241[abi:c8tJTC_2fWwKbcFpQAdBTgEQrlo6UyVFGMNAWVBgYHmKUJAA_3d_3d](Array<double, 1, C, mutable, aligned>) (x=...) at test_7764.py:16
16          return x, z

Reverting https://github.com/numba/numba/pull/7752 seems to fix it.

Suggest changing the test as follows:
diff --git a/numba/tests/gdb/test_array_arg.py b/numba/tests/gdb/test_array_arg.py
index f4b4b88..e4a969b 100644
--- a/numba/tests/gdb/test_array_arg.py
+++ b/numba/tests/gdb/test_array_arg.py
@@ -12,7 +12,7 @@ class Test(TestCase):
     def test(self):
         @njit(debug=True)
         def foo(x):
-            z = 7 + x # break here
+            z = np.ones_like(x) # break here
             return x, z

         tmp = np.ones(5)

this retains the testing of the break points and array update, but avoids the use of an arrayexpr.

https://github.com/numba/numba/pull/7788 fixes.


'Ritual of Rectangling' - CloudRip Mountain missing comment string values [Python]

The comments in this one are showing the comment's name, not value:

Thanks! Fixed. You need to click "Reload" button in the top right corner of the editor.


Folder structure - Review + Recommendation needed

This is a diagram I drew that represents the basic folder structure of our current codebase. Let me know what you think.
Link to diagram: https://www.autodraw.com/share/GE9913USMGPH
Trello link: https://trello.com/c/oYu5WzzF

I think this is nice and concise - from a glance I can see (and wonder( why is Partner page a separate node
Also, given that the diagram has text mostly - is that website (autodraw) editable when shared?
If not, we can use draw.io or MS Word type stuff too :p

@harshvchawla Yeah I believe it is editable. Once you click on the link and press "start drawing", that should trigger a drawing panel for you to start editing.
The reason I chose it is because it's the first thing it came up on my Google search hahaha. Happy to switch it to other tools if you guys think it makes life easier for us.

I think this is nice and concise - from a glance I can see (and wonder( why is Partner page a separate node
Also, given that the diagram has text mostly - is that website (autodraw) editable when shared?
If not, we can use draw.io or MS Word type stuff too :p

When i click on start drawing, it opens a new sheet of paper for me :/
Even a simple tree with description might help e.g
Windows Powershell> tree
├───client
├───contact
├───partners
├───sponsors
└───volunteer

(tree is a linux cmd but I couldnt locate my cygwin install)
in that output, labelling what the significance is ok too (abstracting information, using color coding for labels, etc)
or just have the diagram u created in an editable form
Do whatever is easiest bcos this information will be consumed at a low frequency (but with a high impact :))

Hmm that is weird because it is editable on my end.
Does this work ? @harshvchawla
** Folder structure**
src
|--> components (contains folder that contain all the components that make up each page,
|--> images (contains folder that contain image file (SVG) for each pages)
|--> layout (contains the navbar, the page (children component) and the footer) -> This component is shared across the site
|--> pages (contains the folder that has a index.js file that has a Main layout and the page body of each page)
|--> styles (contain css style file for the entire app)
|--> utils (@rishFilet  Can you add here?)
** If you are looking for the layout of the website **
|--> Mainlayout.js (in layout/index.js)
|-----> NavBar  (components/NavBar)
|-----> Children (This is the page body) -> in (components/{Page_Name}) => {Page_Name} is like Home, Partner,
|-----> Footer (components/Footer)

This is great @gh0stl0nely !
Presentation carries its brownie points always :p!
Acc to me, this piece of information can be moved from "issue" to "wiki" in github even
And looking at ur details, I could understand and reason/ponder - how come navbar and footer- part of layout, belong to components folder (being nitpicky, not that its in any manner incorrect as the way it is now)

Hmm that is weird because it is editable on my end.
Does this work ? @harshvchawla
** Folder structure**
src
|--> components (contains folder that contain all the components that make up each page,
|--> images (contains folder that contain image file (SVG) for each pages)
|--> layout (contains the navbar, the page (children component) and the footer) -> This component is shared across the site
|--> pages (contains the folder that has a index.js file that has a Main layout and the page body of each page)
|--> styles (contain css style file for the entire app)
|--> utils (@rishFilet Can you add here?)
** If you are looking for the layout of the website **
|--> Mainlayout.js (in layout/index.js)
|-----> NavBar (components/NavBar)
|-----> Children (This is the page body) -> in (components/{Page_Name}) => {Page_Name} is like Home, Partner,
|-----> Footer (components/Footer)

Yup i'll have a look at the diagram shortly and add to it but this is an awesome start! Thanks for also joining the convo on it @harshvchawla . I like what you said about it being low frequency but high impact, true statement in designing this. It helps any newbie or vet see what the structure is visually saving time sifting through the code.
I found some some other diagram programs in github (i like experimenting with open source first so we can contribute if we find bugs :).
Def move to wiki.

You can also keep the diagram with the folders name only and put the presentation in paragraphs on the bottom.

Closing this as an issue. See https://trello.com/c/reB70nqJ for the architecture and how to edit further


Add HMR support for Aurelia Template

It's seems to me that work done  in latest aurelia official templates ( see  this ) will make HMR support in Aurelia JavascripServices possible. (maybe server side rendering also)

Sounds great. Pull requests welcome!
I'll close this because it's not something we'll implement any time soon on our own, but if someone in the community offers a sufficiently clean and simple pull request, we can definitely try to include it.

@SteveSandersonMS Can you reopen this issue to indicate Aurelia hot module reload is not supported yet and add the up-for-grabs label so it is visible to community that this needs to be worked on?


jaegeroperator to support nodeSelector

On CRD kind Jaeger
kind: Jaeger

when we enter nodeSelector: to some specific components it is not applied. For example:
  collector:
    config: {}
    nodeSelector:
      agentpool: service

so we request this to be supported so created components (collector/ingester/query) to support nodeSelector.

@frzifus If this issue is still relevant, can I work on it?

Sure, that would be great :)

@frzifus Should we add the nodeSelector field only for collector, ingester, and query?

@frzifus Should we add the nodeSelector field only for collector, ingester, and query?

Sounds like a good idea :)


Mapping an array of PostgreSQL type?

Hi! Is it possible to map an array of a PostgreSQL type to a java List? I have something like this in mind:
CREATE TYPE localized_description AS (
    language varchar(2),
    description varchar(5000)
);
ALTER TABLE foobar ADD COLUMN descriptions localized_description[] NOT NULL DEFAULT '{}';

Thanks!

Anything is possible. That's the beauty of OSS. It's just Java code.

:laughing: ok, so nothing out of the box that I would have missed. I'll see if I get a chance to dive deeper into this, thanks!

It supports ENUM arrays, which are also defined using TYPE. But I'm not sure what would be the Object type on the Java side.
If it worked, what would be the Java type that maps the localized_description?

There would probably need to be a mechanism for defining it on a case by case, but I'm no Hibernate guru so I don't. Maybe it's easier to map it as a json collection

Yes, you can map it to a JSON column, and it will work fine.

You must be a Transylvanian vampire

Well, yeah 🧛


Settings store and Text Editor option pages

SVsSettingsPersistenceManager is used to persist settings.

Option pages can be created in XAML or in code.
I added some XAML controls and styles to one of existing C# projects, to get proper editor and build support. This probably should finally be in a separate project.
As an example some options are wired up with CompletionProvider and QuickInfo.
No localization has been done so far.

@majocha No tooltips on Some, None, Choice1Of2, etc.:

I saw this when tried to provide non-standard text tags (like one for our "disposable types" or "methods"). So tagged text may be wrong or something else.
This bug is not reproduced on current master.

I've tested the settings pages - everything works great. Fantastic work :)

@vasily-kirichenko I'll look into the tooltips problem as soon as the debug works again. No tooltip means something probably throws an exception.

@majocha we on slack come to a common opinion that debugging will be fixed just after moving to CPS, around July, 2019.

@vasily-kirichenko I can reproduce the tooltip bug on my currently installed version, I just can't remember what did I install. Building from master now.
.....Yep, the bug is on master, not in this PR. Probably recent changes broke something. I'll take a look in the morning.

@majocha I've just git cleanup, rebuilt, installed from master - no bug.

@majocha is this ready for review?

@KevinRansom Yes.
The question of localization remains, because I don't know what the story is with localizing XAML.

Doesn't XAML allow us to read values from an assembly, it should be possible I think to localize using our existing localization tools.
@ReedCopsey you are a XAML guru, can you advise us here?
Kevin

Yes, we can simply bind to values in resources.
OTOH I'm reading about marking text to be localized directly in XAML with x:Uid but I'm not sure if your tooling support this.

@KevinRansom Localization done the simple way.
There was some hair-pulling because internal properties bind in XAML designer fine but fail at runtime. So unfortunately I had to make one class public. It should go to a separate project along with all the XAML, but that's too tricky for me.

@majoch
Make it public and put the deprecated attribute on it with a comment that it is for F# project system use only, and turn off the deprecated warning.  Perhaps we can figure out something better eventually, but for now we need LOC and this feature is great.

@KevinRansom the problem is that it's designer generated class for .resx (using PublicResXFileCodeGenerator), I changed the public surface area in test from 0 to 1. Not sure if that's enough.

XAML is now in a new C# project, together with string resources it uses.
I was careful to do it properly, i.e. proper paths and variables in project files, guids are not copy-pasted, signing etc. It builds, tests, installs and works fine.
It is ready when green.

@majocha do you mind updating to mention the new project: https://github.com/Microsoft/visualfsharp/blob/master/vsintegration/readme.md

There is one nasty problem with this implementation:
Settings schema evolution.
In case when updating the VSIX adds new properties to settings, SVsSettingsPersistenceManager (which uses json under the hood) will initialize all newly added properties basically to Unchecked.defaultof, disregarding any default settings we provide. This is not optimal for simple values and fatal for DUs and tuples which will be set to null.
I can see two solutions for this. One is to rewrite everything and store settings "per property", not "per type" as it is now. Much work and more complex to use, but probably more proper and correct.
The other is simple and very little work: use Newtonsoft.Json's PopulateObject. This would keep all the user's customizations intact and still provide the defaults we want for any newly added properties.
I tried to do the second solution, but I don't know how to include Newtonsoft.Json in the VSIX. I also don't know if such solution is acceptable at all.

@majocha yes it's okay to include third party libraries in the VSIX.  I have some admin to do, however, Newtonsoft json is already approved, so, if you need it, add it.  And I think you just need to ensure that the assemblies and any support files are included.
Kevin

OK It works and is ready to use.
The project I added probably requires some clean-up, but I need a better grasp of our build process to do it.

@dotnet-bot test, please

@dotnet-bot test this, please.

@KevinRansom I think this should be good to merge for now

@majocha is this ready for review ?

@KevinRansom Yes, please.

Thanks for this, it's awesome work.
Kevin

🎉


Fixed missing compression.

US/TX/statewide missing: https://github.com/openaddresses/openaddresses/issues/6009

:tada:

Closes #6009


Scaffold-DbContext throwing System.IO.FileNotFoundException error.

Updated my Visual Studio with RC 2 and created a Web API project.
Followed documentation guidelines for new application with existing database.
The following error was thrown hitting Scaffold-DbContext.
System.IO.FileNotFoundException: Could not load file or assembly 'Newtonsoft.Json, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=30ad4fe6b2a6aeed' or one of its dependencies. The system cannot find the file specified. File name: 'Newtonsoft.Json, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=30ad4fe6b2a6aeed'
    at Microsoft.DotNet.ProjectModel.ProjectReader.ReadProject(Stream stream, String projectName, String projectPath, ProjectReaderSettings settings)
   at Microsoft.DotNet.ProjectModel.ProjectReader.GetProject(String projectPath, ProjectReaderSettings settings)
    at Microsoft.EntityFrameworkCore.Tools.DispatchCommand.<>c__DisplayClass2_0.<Create>b__0()
    at Microsoft.Extensions.CommandLineUtils.CommandLineApplication.Execute(String[] args)
   at Microsoft.EntityFrameworkCore.Tools.Program.Main(String[] args)
 Could not load file or assembly 'Newtonsoft.Json, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=30ad4fe6b2a6aeed' or one of its dependencies. The system cannot find the file specified.

Got a similiar Newtonsoft related error using CLI dotnet ef.

Can you include your project.json please?

I posted a question on Stack Overflow. It's not the complete project.json file, but all the relevant parts should be there. If you would like to see the complete file posted here I can do that too.

Can you try adding "Newtonsoft.Json": "7.0.1" to your dependencies and let me know if that works?

I tried adding Newtonsoft.Json: 7.0.1. I got errors with other dependencies were looking for version 8.03. I got messages about some things looking for 8.03, "and got 7.01 instead."

What happens if you add both?

When adding 7.0.1, or both 8.0.3 and 7.0.1 I get the following warnings:
Dependency conflict. Microsoft.AspNetCore.JsonPatch 1.0.0-rc2-final expected Newtonsoft.Json >= 8.0.3 but got 7.0.1
Dependency conflict. Microsoft.AspNetCore.Mvc.ViewFeatures 1.0.0-rc2-final expected Newtonsoft.Json >= 8.0.3 but got 7.0.1
Dependency conflict. Microsoft.Extensions.Configuration.Json 1.0.0-rc2-final expected Newtonsoft.Json >= 8.0.3 but got 7.0.1
The project builds with warnings, but errors when trying to use dotnet ef or Scaffold-DbContext.

Sorry - I forgot. You have to include "dncore50" inside the imports section for Microsoft.EntityFrameworkCore.Tools inside the tools section. This is a workaround for a problem with CLI in RC2 and should go away in RTM.

Bummer. Thought I had a remedy.
Still getting the errors with the following:
  "tools": {
    "Microsoft.EntityFrameworkCore.Tools": {
      "version": "1.0.0-preview1-final",
      "imports": [
        "portable-net45+win8+dnxcore50",
        "portable-net45+win8",
        "dnxcore50"
      ]
    }

I have tried variations of the above, but have not solved this riddle.

@mhenderson442 just in case it helps, what NuGet feed are you using? Do you have a project.lock.json file?

I am using nuget.org(https://api.nuget.org/v3/index.json).
I do have a project.lock.json.
There are two references to Newtonsoft.Json 7.0.1. Excerpted below.
      "Microsoft.DotNet.ProjectModel/1.0.0-rc2-002702": {
        "type": "package",
        "dependencies": {
          "Microsoft.CSharp": "4.0.1-rc2-24027",
          "Microsoft.Extensions.DependencyModel": "1.0.0-rc2-002702",
          "Newtonsoft.Json": "7.0.1",
          "NuGet.Packaging": "3.5.0-beta-final",
          "NuGet.RuntimeModel": "3.5.0-beta-final",
          "System.Dynamic.Runtime": "4.0.11-rc2-24027",
          "System.Reflection.Metadata": "1.3.0-rc2-24027",
          "System.Runtime.Loader": "4.0.0-rc2-24027",
          "System.Runtime.Serialization.Primitives": "4.1.1-rc2-24027",
          "System.Security.Cryptography.Algorithms": "4.1.0-rc2-24027",
          "System.Threading.Thread": "4.0.0-rc2-24027",
          "System.Xml.XDocument": "4.0.11-rc2-24027"
        },

      "Microsoft.Extensions.DependencyModel/1.0.0-rc2-final": {
        "type": "package",
        "dependencies": {
          "Microsoft.DotNet.InternalAbstractions": "1.0.0-rc2-002702",
          "Newtonsoft.Json": "7.0.1",
          "System.Diagnostics.Debug": "4.0.11-rc2-24027",
          "System.Dynamic.Runtime": "4.0.11-rc2-24027",
          "System.Linq": "4.1.0-rc2-24027"
        },

If it's useful, here are some the steps I follow trying to solve the issue:

Make a change to project.json and save
Go to cmd prompt and hit dotnet restore
If there are no errors or warnings, I hit dotnet ef

At this point I get the error you see at the start of this thread.

Unfortunately I think we are hitting #5320.

#5320 does look quite similar. I used the Web Api template to create the project. I even tried a Web Application template to see if something was not right with the template.

@natemcmaster do you think this in fact may be a dupe of #5320?

Depends. Is emitEntryPoint set to true?  Also, what is the output when adding --verbose?

@natemcmaster
emitEntryPoint is set to true.
  "buildOptions": {
    "emitEntryPoint": true,
    "preserveCompilationContext": true
  },

Here is the output when running Scaffold-DbContext with verbose:
Working directory: C:\Source\Repos\MercurySchool\MercurySchool\MercurySchoolApi
Executing command: dotnet ef --configuration Debug --build-base-path .\bin\ dbcontext scaffold 'Server=[Server named omitted];Data Source=[Data source omitted];Initial Catalog=MercurySchool;Persist Security Info=False;User ID=[User ID omitted];Password=[Password omitted];Pooling=False;MultipleActiveResultSets=False;Encrypt=True;TrustServerCertificate=False;Connection Timeout=30;' Microsoft.EntityFrameworkCore.SqlServer --context DbMercurySchool --output-dir DataModel --verbose
System.IO.FileNotFoundException: Could not load file or assembly 'Newtonsoft.Json, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=30ad4fe6b2a6aeed' or one of its dependencies. The system cannot find the file specified. File name: 'Newtonsoft.Json, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=30ad4fe6b2a6aeed'
    at Microsoft.DotNet.ProjectModel.ProjectReader.ReadProject(Stream stream, String projectName, String projectPath, ProjectReaderSettings settings)
   at Microsoft.DotNet.ProjectModel.ProjectReader.GetProject(String projectPath, ProjectReaderSettings settings)
   at Microsoft.EntityFrameworkCore.Tools.DispatchCommand.<>c__DisplayClass2_0.<Create>b__0()
   at Microsoft.Extensions.CommandLineUtils.CommandLineApplication.Execute(String[] args)
    at Microsoft.EntityFrameworkCore.Tools.Program.Main(String[] args)
 Could not load file or assembly 'Newtonsoft.Json, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=30ad4fe6b2a6aeed' or one of its dependencies. The system cannot find the file specified.

@mhenderson442 thanks for that. I suspect this is related to imports. Try this to fix it

Delete %USERPROFILE%\.nuget\packages\.tools\Microsoft.EntityFrameworkCore.Tools and %USERPROFILE%\.nuget\packages\Microsoft.EntityFrameworkCore.Tools.
Make sure your "tools" section matches this:

  "tools": {
    "Microsoft.EntityFrameworkCore.Tools": {
      "version": "1.0.0-preview1-final",
      "imports": "portable-net451+win8"
    }

cref https://docs.efproject.net/en/latest/cli/dotnet.html
3. Re run dotnet restore and look in the output for errors. VS will trigger this automatically when you save project.json and spits output to "Output > Package Manager".
4. If commands still fail, can you share the files in %USERPROFILE%\.nuget\packages\.tools\Microsoft.EntityFrameworkCore.Tools?

@natemcmaster Following you instructions, dotnet ef worked.
Using Package Manager Console I got the following error:
Scaffold-DbContext : The term 'Scaffold-DbContext' is not recognized as the name of a cmdlet, function, script file, or operable program. Check the spelling of the name, or if a
path was included, verify that the path is correct and try again.
At line:1 char:1
+ Scaffold-DbContext -Provider "Microsoft.EntityFrameworkCore.SqlServer ...
+ ~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : ObjectNotFound: (Scaffold-DbContext:String) [], CommandNotFoundException
    + FullyQualifiedErrorId : CommandNotFoundException

command otnet ef dbcontext scaffold executed with errors, but I think that's unrelated to this issue.
Got the following error: One for more errors ocurred. (Invalid object name 'sys.sequences'.).
I am connecting to a SQL Azure database. Is this supported?

:+1: glad we got the first error out of the way.

dotnet ef dbcontext scaffold executed with errors, but I think that's unrelated to this issue.

Yes, can you open another issue? We support querying from SQL Azure, but I don't think we have ever testing scaffolding from a SQL Azure database. cc @lajones
This can probably be closed now. For anyone else who encounters this (cc @Kurira), the "Newtonsoft.Json" error is likely due to NuGet caching issues. Clear your caches as instructed above  https://github.com/aspnet/EntityFramework/issues/5458#issuecomment-221912806

From perspective I think this issue is closed. I will tinker some more to make sure the other errors warrant a new issue.
@lajones @divega @natemcmaster Thanks for the guidance.

Hello,
I came to a similar problem after fixing Could not load file or assembly 'Newtonsoft.Json issue.
Now I get: Could not load file or assembly 'System, Version=<IP_ADDRESS> [...]
My project.json
{
  "dependencies": {
    "Microsoft.AspNetCore.Diagnostics": "1.0.0-rc2-final",
    "Microsoft.AspNetCore.Mvc": "1.0.0-rc2-final",
    "Microsoft.EntityFrameworkCore.SqlServer": "1.0.0-rc2-final",
    "Microsoft.EntityFrameworkCore.Tools": {
      "version": "1.0.0-preview1-final",
      "type": "build"
    },
    "Microsoft.AspNetCore.Razor.Tools": {
      "version": "1.0.0-preview1-final",
      "type": "build"
    },
    "Microsoft.AspNetCore.Server.IISIntegration": "1.0.0-rc2-final",
    "Microsoft.AspNetCore.Server.Kestrel": "1.0.0-rc2-final",
    "Microsoft.AspNetCore.StaticFiles": "1.0.0-rc2-final",
    "Microsoft.Extensions.Configuration.EnvironmentVariables": "1.0.0-rc2-final",
    "Microsoft.Extensions.Configuration.Json": "1.0.0-rc2-final",
    "Microsoft.Extensions.Logging": "1.0.0-rc2-final",
    "Microsoft.Extensions.Logging.Console": "1.0.0-rc2-final",
    "Microsoft.Extensions.Logging.Debug": "1.0.0-rc2-final",
    "Microsoft.AspNetCore.Authentication.Cookies": "1.0.0-rc2-final",
    "Microsoft.AspNetCore.Authentication": "1.0.0-rc2-final",
    "Microsoft.AspNetCore.Identity": "1.0.0-rc2-final",
    "Microsoft.AspNetCore.Identity.EntityFrameworkCore": "1.0.0-rc2-final"
  },

  "tools": {
    "Microsoft.EntityFrameworkCore.Tools": {
      "version": "1.0.0-preview1-final",
      "imports": "portable-net45+win8"
    },
    "Microsoft.AspNetCore.Razor.Tools": {
      "version": "1.0.0-preview1-final",
      "imports": "portable-net45+win8+dnxcore50"
    },
    "Microsoft.AspNetCore.Server.IISIntegration.Tools": {
      "version": "1.0.0-preview1-final",
      "imports": "portable-net45+win8+dnxcore50"
    }
  },

  "frameworks": {
    "net461": {
      "frameworkAssemblies": {
      }
    }
  },

  "buildOptions": {
    "emitEntryPoint": true,
    "preserveCompilationContext": true
  },

  "publishOptions": {
    "include": [
      "wwwroot",
      "Views",
      "appsettings.json",
      "web.config"
    ]
  },

  "scripts": {
    "prepublish": [ "npm install", "bower install", "gulp clean", "gulp min" ],
    "postpublish": [ "dotnet publish-iis --publish-folder %publish:OutputPath% --framework %publish:FullTargetFramework%" ]
  }
}

Any ideas?

@ole1986 as the issue describes, your imports are incorrect. For preview1, use "portable-net451+win8" See https://github.com/aspnet/EntityFramework/issues/5458#issuecomment-221912806


Weapon Components for Spawning Projectiles

added weapon component for spawning projectiles
move values to describe projectile spawning into weapon component
projectiles now spawn rotated in the direction they were spawned
fix fire rate scaling with money to work with both characters and account for base reload time of character
nerf the megablast ability to fire multiplier/2 blasts

The one thing I would like before merging this is resolving the question "can a player/mob have more than 1 weapon/attack?" rather than handling them separately. What if we want to let you pick up ~5 attacks (a freeze, mind control, chain/lightning etc.) that could be toggled or all selected (like those games where you press 1-9 to take actions)?
Maybe you can only have 1 weapon but that weapon can have separate attacks? Idk


fixed imgui opengl 2 and 3 backend linking on Linux

The cimgui binding was not linking to GL properly on linux, and not linking for GLEW for gl3

I'm also just generally interested in how you ran into this, since the GL stuff shouldn't be required for inochi. These paths were added when we were using the OpenGL3 backend for Inochi, but we aren't currently doing that anymore because initialization is cumbersome and Luna didn't like the extra DLL we needed to ship (maybe I could have gotten around this in D, but I'm not sure).
If we found a cleanly way to do it, or if maintaining our own OpenGL backend becomes to cumbersome (which certainly could happen), we might have to go back to using these, but that doesn't change the fact that this shouldn't be getting compiled by the Imgui bindings right now.


Use new Filesystem Watcher API

The Atom 1.21 supported Filesystem Watcher API. Currently, the chokidar package is in use, it needs to be replaced to Atom Watcher API solution.
This will be the second major version, dropping old version support. (>=1.21)
It's a major issue #839

I'd be interested in picking this up for hacktoberfest

The API docs.

I'm not sure my pr should be merged until https://github.com/atom/atom/issues/15642 has been resolved. I ran into this issue during development and had to develop on 1.22 beta. Merging before then would break the file watching functionality for users on linux.

I close the issue, pull request soon.


Don't fetch a submodule if the commit is already known

This allows rebuilding without an internet connection and avoids random build failures on flaky connections.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


[feature]: MPP compatibility for single hop blined paths

Right now when we send to a blinded route with only 1 hop after the intropoint we immediatly fail the payment and won't retry. The main reason for this was that we did not want to penalize the introduction node pair to the final hop because it could be gamed potentially.
However I think in combination of making the MC data for blinded paths volatile (not persisting the data) we can also get rid of this check as well:
https://github.com/lightningnetwork/lnd/blob/e30e43e6448719265589bcc69c01e54df68f8b14/routing/result_interpretation.go#L514-L518

Should be done after https://github.com/lightningnetwork/lnd/issues/9321


Added temporary fix for PocketMine 1.5

Thanks. I won't create a release until I can test it, but I can merge now.


Switched from Array of Arrays to Named Values JSON

Depends on https://github.com/covid-projections/covid-data-model/issues/168
Once data is being served with Named JSON, we will need to be able to parse the data as such.
Please see the dependent ticket for the structure.

Done.


Screen Burn in Reduction

Description of the new feature / enhancement
As an alternative to a screensaver, which doesn't work with transparency or special effects within Windows, you can have a screen burn-in reduction utility that can dim the screen when there is no interactivity with the desktop. The idle time and darkness can be configurable. For example, the screen can be set to be 80% dark after the system is idle for 5 minutes.
Scenario when this would be used?
Suppose a user works in an environment where they need to keep their computer monitor on for extended periods, such as a 24/7 control room or a security monitoring environment.
For an always-on display used to show production reporting numbers.
For these cases, using a screensaver may not be effective in reducing energy consumption or preventing screen burn-in. Instead, a screen burn-in reduction utility can be configured to dim the screen when there is no activity on the desktop, reducing energy consumption while also preventing burn-in. The user can set the amount of time that the screen is idle before the dimming effect kicks in, as well as the level of dimming they prefer. Ideally, this should be implemented in the OS, which is currently not the case.
Overall, a screen burn-in reduction utility is a more effective and efficient way to prevent screen burn-in and reduce energy consumption in scenarios where screensavers may not be practical or effective.
Supporting information
No response

/feedbackhub


 Also add sections on this in CONTRIBUTING.md and README
Additional context/Links:
We want to add static and dynamic code analysis to projects according to the CII: https://bestpractices.coreinfrastructure.org/en/projects/4287#analysis

[ ] review https://github.com/devlinjunker/template.hapi.rest/issues/51
[x] Dynamic vs static?

https://blog.overops.com/static-vs-dynamic-code-analysis-how-to-choose-between-them/
static is before, dynamic is in production

[ ] add wiki about code analysis

Notes from https://blog.logrocket.com/static-analysis-in-javascript-11-tools-to-help-you-catch-errors-before-users-do/
Todo:

[ ] PMD
[ ] Wiki with paid options?

SonarCloud
LGTM

[ ] Dependabot?

Other:

ESLint
FlowJS
JSHint/Prettier
Typescript
StandardJS
npm audit

Seems like we won’t be able to do code analysis on this repo, so we’ll need to add a line to the README and contributing file (maybe?)
Also want to add a wiki page with links to available code analysis tools

Added Wiki and Link in README in 4e140190bf81a96ebc5bb2f1c2c9e8b0bfb46978


unable to run npm start on Arch.

electron .

npm ERR! code ELIFECYCLE
npm ERR! errno 1
npm ERR<EMAIL_ADDRESS>start: electron .
npm ERR! Exit status 1
npm ERR!
npm ERR! Failed at the<EMAIL_ADDRESS>start script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.
npm ERR! A complete log of this run can be found in:
npm ERR!     /root/.npm/_logs/2019-05-05T11_27_51_694Z-debug.log

you need to cd into desktop

It was run inside the desktop
On Sun, May 5, 2019 at 5:47 PM Лu Лinveгa<EMAIL_ADDRESS>wrote:

Closed #97 https://github.com/hundredrabbits/Orca/issues/97.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/hundredrabbits/Orca/issues/97#event-2319552239, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ALEWFOF2HHO2OMC3X3EAHX3PT3EF5ANCNFSM4HK3BA7A
.

I had this same problem on mac.  npm start gave the same error where 'electron .' worked just fine.

The itch build is giving you this error?

Are you launching it through the client?


Drilldown with different chart type

Hi @rockie-yang,
Does spark-highcharts have feature to drilldown into different chart type and different data source/dataframe?
I had seen the drilldown example but i didn't find any yet, further does this api has Zoom feature of highcharts?
Or is there any way to add such features?

Thanks very much for trying spark-highcharts. It support zoom and drilldown on different types.
For zoom please check
https://github.com/knockdata/spark-highcharts/blob/b30da28624ad22c612bb647efa4999c847f28cd6/docs/DemoLineChart.md#line-chart-zoomable
For drilldown, check the following example
    val chart: Highcharts = highcharts(
          bank.series(
            "name" -> "marital",
            "y" -> avg(col("balance")))
              .drilldown("name" -> "job",
            "y" -> avg(col("balance"))).set("type", "column")
              .drilldown("name" -> "education",
            "y" -> avg(col("balance"))))
    chart.plot

Thanks @rockie-yang excellent work.


bug: logger logs ERROR: foundation:retry [object Object] on v0.66.0

For another reason I have a problem initializing the PXE. But I get this log, probably an easy fix.
ERROR: foundation:retry [object Object]
    msg: {}

On 0.67.0 it's the same except for a newline:
ERROR: foundation:retry [object Object] {"msg":{}}


Is it possible to load two subroute of an application in two different section of same page?

Question:
Is it possible to load two subroute of an application in two different section of same page?
Note: I'm using Angular 8
Additional context
I have a single-spa root app and a sub application.
In the root app is it possible to load one sub-route(app/subroute1) in one  element and another sub-route(app1/subroute2) in another  element?

       // app1/subroute2 goes here

Is this possible to achieve this way?

Thanks for sharing some light. I will go through the documentation provided.
Also, my root application doesn't have anything except a index.html and a package.json to serve it.


Disable image feature at index page

Hey @mmistakes,
Thanks for your Jekyll theme, I decided to use it on my site. I'd like to disable (or remove) image feature at index page, but I couldn't find how to do it. Each time i was at index, image feature is shown. Can you help me how to fix it?

You have to remove the feature image YAML from the post or pages you don't an image on. For example if you don't want a feature image on the home page, remove the following from index.md
image:
  feature: sample-image-1.jpg
  credit: WeGraphics
  creditlink: http://wegraphics.net/downloads/free-ultimate-blurred-background-pack/

This is all documented in the Theme Setup.

@mmistakes Oops, I've missed index.md at root. Thanks for help!


Add GCSFile Storage

Need to add tests.
Tests for external resources can be a bit tricky, but gcsfs (and original google-cloud-storage lib) support a STORAGE_EMULATOR_HOST env var that we could point to something like https://gitlab.com/potato-oss/google-cloud/gcloud-storage-emulator with --no-store-on-disk (in-mem) during test runs. gcsfs CI uses a different mechanism with docker but I think that will be more troublesome.

Codecov Report

Merging #149 (853b86a) into golden (cdc3c72) will decrease coverage by 0.72%.
The diff coverage is 65.21%.

@@             Coverage Diff             @@
##            golden     #149      +/-   ##
===========================================
- Coverage   100.00%   99.27%   -0.73%
===========================================
  Files           35       37       +2
  Lines         2173     2219      +46
  Branches       477      461      -16
===========================================
+ Hits          2173     2203      +30
- Misses           0       16      +16

Impacted Files
Coverage Δ

src/arti/io/json_gcsfile_python.py
65.21% <65.21%> (ø)

src/arti/storage/google/cloud/storage.py
65.21% <65.21%> (ø)

:mega: Codecov can now indicate which changes are the most critical in Pull Requests. Learn more

Development on https://gitlab.com/potato-oss/google-cloud/gcloud-storage-emulator seems slowed so I tried the  https://github.com/oittaa/gcp-storage-emulator fork, which supports a bit more. However, I still had a couple issues (eg: https://github.com/oittaa/gcp-storage-emulator/issues/147). A quick test with https://github.com/fsouza/fake-gcs-server (as GCSFS uses) seemed to work, so I'll use that. Unfortunately, it's not available as a python lib so will shell out.


Minor design/sizing improvements

Partially addresses #24

Responsive sizing (especially behavior for minimum width and height)
Font style and sizing

#19

Demos (b823bf6)
MBA 13"
Before

After

iPhone 12 Pro
Before

After

Favicon is great! And for responsive design you should do whatever you think best.

Here are the right colors finally!
ritu #bebada
indu #fcaea4
vasu	#81b2d2
rudra #fcbc73
veda #b3dd69
aditya #fdd8eb
dishi #d9d9d9
bana #bc80bd
bhrama #d5eecf
netra #ffed6f
agni #93d6ca
rishi #ffd9b3

On Mar 14, 2024, at 10:07 AM, Quinn Ouyang @.***> wrote:
Reminder to self: redo favicon once new colors are in:)
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because your review was requested.Message ID: @.***>

I basically combine the new features in main (pop up window, viola, etc) and the design in this branch (favicon, responsive). So although it still shows conflict, it's technically the latest and full version? lmk if there's any details I forget

@SallyXue-0114 Done! See staging site for commit https://github.com/staylor7/rare-diseases/pull/27/commits/7f111414016da73731b35476e5ffbcef15c41656 (note playback is broken, pending fixes in #32)

@SallyXue-0114 Done! See staging site for commit 7f11141 (note playback is broken, pending fixes in #32)

looks cool! I'm experiencing this error even after I refresh: "The AudioContext was not allowed to start. It must be resumed (or created) after a user gesture on the page. https://goo.gl/7K7WLu". Is this the issue in #32?

Yah (though I haven't merged the two branches so I can't be certain, but pretty sure #32 handles that). UI should be untouched by this issue


Make non_null compatible with unique_ptr & more consistent Ptr APIs ;

Formal Notes

This PR fixes:

RN:
RN:
RN:

Description, Motivation and Context

Link to issue: Fixes ?
Link to reference doc: ?

How Has This Been Tested?

Command line to run all the tests that I run locally:
ham Run_ci

Types of changes

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that cause existing functionality to change)
[ ] Documentation (code docs, comments, or changes to the doc systems)
[ ] Testing/Build (test coverage or the test/build subsystems themselves)
[ ] Packaging (adds examples or modifies a release package)

Current dependencies on/for this PR:

main

PR #35   👈

This comment was auto-generated by Graphite.


Bluetooth: Shell: Guard HRS adv calls with broadcaster

There is no requirement that HRS shall be on a peripheral device as far as I can tell, and as such the device with HRS may not be a GAP Broadcaster. Guards the cmd_hrs_simulate with CONFIG_BT_BROADCASTER as that only does advertising.

Hmm, good point. Let me try with something else for this

I guess this will work, if we connect manually using the shell and the peer/peripheral subscribes.


fix wasm support

This is a rebased version of #270 that I needed to get proptest working in wasm environments.

This got closed when i switched branch from master to main. I'll re-open against the main branch.


Multi-target the various platforms in one .csproj

Type of issue
[ ] Bug
[ ] Question (e.g. about handling/usage)
[X] Request for new feature/improvement
Expected Behavior
Build QRCoder project against multiple target frameworks in one .csproj/.sln
Current Behavior
There are multiple .csproj and .sln files for the various target frameworks. The impact of changes made to files in one .csproj/.sln with respect to other framework specific .csproj/.sln may not be immediately known at build time in VS (#154). I believe some scripts are in place to help with this, but I believe building for all target frameworks with one gesture is preferable.
Possible Solution
Use the new .csproj file format to target multiple frameworks from a single .csproj (extend the existing QRCoder.NETCore20.csproj and remove the other framework specific .csproj files). Consolidate the Demo/Test .csproj's into a solution with the updated csproj.
The current target frameworks (from .csproj):

NET35
NET40
PCL (Profile 111)
NETSTANDARD2.0

Note: PCL Profile 111 maps to NETSTANDARD1.1
Proposed <TargetFrameworks>:
<PropertyGroup>
    <TargetFrameworks>net35;net40;netstandard1.1;netstandard2.0</TargetFrameworks>
    <PackageRequireLicenseAcceptance>false</PackageRequireLicenseAcceptance>
  </PropertyGroup>

Note: Other targets could be easily added and tested in the one .csproj.
The value in such a change is F5 building all target frameworks at once. One build error for any target fails the build. Also, it is less confusing for prospective contributors if there is only one solution/main project ;-) .
Another positive side effect is that NuGet packaging is made easy with the dotnet pack command (I don't believe it even requires a manual .nuspec file #57).
Other somewhat related issues: #44 #66

Hi @csturm83 ,
thanks for the stunning work. Some comments and thoughts before merging your PR. You wrote:

There is likely some followup cleanup of .bat and .nuspec files needed if this PR is accepted.

That's correct. CheckBinaries.bat, Compile.bat and Compile_Single.bat can be removed. The only relevant .bat-file is the MyGet.bat. This one is used to build the project and create the Nuget.package. (I use https://www.myget.org/ as build service.) Every time a commit is made to this repository, MyGet will be informed via Webhook and automatically build the project. So if I would merge your changes I there probably will follow a row of commits until I figured out what changes in MyGet.bat are necessary to get the automatically build up and running with the new .sln-file. But that's just effort, not a blocker.
One more thing - can you tell me the downsides of your PR? (I want to understand the side effects of this PR, before merging.) The only downside I can imagine is that you can't use/compile the project with VS2015 or older any longer. So people, which stick to on an old VS (for example professionals which aren't allowed to use Community Editions and don't want to buy a new version only for QRCoder) have to use Nuget package and won't be able to work with the sources. Correct? (Can you imagine more side effects?)

The only potential downside that I can think of would be that somehow netstandard1.1 doesn't cover an old version of a PCL type of target outside of Profile111?? I'm not well versed in NuGet targets or how nuspecs work, but the current nuspec seems like it might be a little off. I generally rely on dotnet pack for packaging.
As for development environments (IDEs), I understand where you're coming from. You're correct that it would likely only impact working with sources from work places. My current work supports VSCode, so it might not be that huge of a deal.

In particular, this target doesn't map cleanly to a netstandard version. I'm not sure netstandard 1.1 covers Windows Phone Silverlight (not sure it matters). I wonder if it even works currently, since it is including a Profile 111 binary in that target folder..
I'm also not sure the 1.6 target works if you put a netstandard2.0 assembly in the 1.6 target folder. Also, I'm not even entirely sure that System.Drawing.Common NuGet supports netstandard1.6..


Hyperparameter files

Hello Authors,
I'd be grateful if you would also upload the hyperparameters files for each dataset / case. I wanted to check the value of your validation MAE and also the hyperparameter values.
Thanks!

Hi @mcvageesh,
We have the updated version of the NBEATSx paper with a summary of our findings of hyperparameter exploration in Appendix A.5. Hope it helps.

Hi @kdgutier ,
Thanks :), I did go through the section A.5 before. The main reason I requested for the hyperparameter files was to avoid running the hyperparameter search all over again, and also to compare the validation MAE of the best model found by the search against some other model I am trying to use.  The authors Lago et al. (https://github.com/jeslago/epftoolbox) provided this in their toolbox and it was really helpful, so if you still are working on this and have time, please upload the files - it will be really helpful!

@mcvageesh
I would advice to run again hyperparameter selection on an informed/restricted space based on the A.5 appendix suggestions here.
As we mention in Appendix A.3 of the paper you can achieve even better results with a fraction of the hyperparameter exploration steps.
The most expensive part of the forecasting pipeline is the rolled windows evaluation, because of the model recalibration.
We did it sequentially, but If you have the computational resources I would suggest you to try to parallelize the test evaluation.

Okay, thank you!

Hi again!
I am a bit confused about the data shuffling operation used for splitting the train-validation sets.
Let us take the function train_val_split(len_series, offset, window_sampling_limit, n_val_weeks, ds_per_day) in src/utils/experiment/utils_experiment.py
Let len_series = 4 * 365 * 24
offset = 0
window_sampling_limit = 4 * 365 * 24
n_val_weeks = 42
ds_per_day = 24
Then, on running the function, we obtain len(train_days) = 1096 and len(validation_days) = 364.
Let us take the day 70, which was picked as a validation day (for example, and hence the days 70, 71, 72, 73, 74, 75, 76 are selected as validation days). Let day 77 not be picked for the validation set, and hence remains part of the training set.
If the day 77 remains in the training set, wouldn't that cause data contamination in the sense that the lagged values (day 70, 71, 72, 73, 74, 75, 76) used to predict day 77 in the training set are part of the validation set?
Is this problem avoided in some way in the code? Or would you say that this is a necessary evil, and cannot be avoided without incurring significant computational time (rolling validation) or significant reduction in training samples (blocked validation)?
Thank you!


undeclared CUDA_VISIBLE_DEVICES breaks MEMOS

CUDA_VISIBLE_DEVICES environmental variable has been card coded to MEMOS script. While expecting this environmental variable to be set of computers with multiGPU is a reasonable expectation, it doesn't make sense to have it declared for single GPU enviornments like MorphoCloud.
The script needs to be improved such that if the variable is not set, the default (first) GPU device is used. If it is set, it needs to check whether it is correctly set (i.e., that device exists), and if it does, it needs to honor that setting.

I see there is now a fix, which seems not to factor in this variable at all. How does that work in our own system?