Help ! Dont work in my case.

Hi !
I have the following structure :
├── app/
│   └──  scripts/
│       ├── modules/
│       │      └── foo/
│       │         └── index.js
│       └── app.js
└── test/
    ├── spec/
    │  └── modules/
    │       └── foo/
    │           └── index.js
    └── karma.conf.js

And my config looks like this :
module.exports = function (config) {
  config.set({
    // basePath, frameworks ....
    plugins: [
      'karma-phantomjs-launcher',
      'karma-jasmine',
      'karma-coverage',
      'karma-tap-reporter'
    ],
    files: [
      // Dependencies
      'test/spec/*.js',
      'test/spec/modules/**/*.js',
    ],
    preprocessors: {
      'app/scripts/app.js': ['webpack', 'sourcemap', 'coverage'],
      'app/scripts/modules/**/*': ['coverage'],
      'test/spec/*.js': ['babel'],
      'test/spec/modules/**/*.js': ['babel']
    },
    plugins: [
      'karma-phantomjs-launcher',
      'karma-jasmine',
      'karma-coverage',
      'karma-sinon-chai',
      'karma-tap-reporter',
      'karma-babel-preprocessor',
      'karma-coffee-preprocessor',
      'karma-sourcemap-loader',
      require("karma-webpack")
    ],
    webpack: {
      module: {
        postLoaders: [
          { test: /\.js$/, loader: 'istanbul-instrumenter' }
        ],

        loaders: [
          // JS
          { test: /\.js?$/, exclude: /node_modules/, loader: 'babel-loader' }
        ]
      }
    },
    // Coverage reporters, babel preprocessor ...
  });
}

I tried to put istanbul-instrumenter as preLoader and postLoader but it never works for me.
In preLoader, my tests fail, and in postLoader, I have the following error.
FATAL ERROR: CALL_AND_RETRY_LAST Allocation failed - process out of memory

Any idea ?
PS : My coverage worked good before webpack migration and all of my tests pass without preLoader istanbul instrumenter.
Thanks

could you please try setup described in readme? it's difficult to understand what is wrong without example repo.

please comment here if you have more details and I'll reopen the issue.


Delete Pods with Zero Grace Period

Delete remaining test pods with zero grace.
Avoid the object is being deleted: pods far-pod-test-1 already exists error.

/lgtm

/retest


Change github release version

[ ] Before the publication update the release version to 0.1.0

Closed by https://github.com/primitivefinance/arbiter/releases/tag/v0.1.0


Support keyid -> public key resolution for intoto::verify-envelope

Currently, the attesters entries can contain a name and a public-key (or a certificate) which should match one of the signature entries in the attestation. But some attestations only contain a keyid. For example, the following attestation envelope was created by Tekton Chains:
{
  "payloadType": "application/vnd.in-toto+json",
  "payload": "eyJfdHlwZSI6Imh0dHBzOi8vaW4tdG90by5pby9TdGF0ZW1lbnQvdjAuMSIsInByZWRpY2F0ZVR5cGUiOiJodHRwczovL3Nsc2EuZGV2L3Byb3ZlbmFuY2UvdjAuMiIsInN1YmplY3QiOm51bGwsInByZWRpY2F0ZSI6eyJidWlsZGVyIjp7ImlkIjoiaHR0cHM6Ly90ZWt0b24uZGV2L2NoYWlucy92MiJ9LCJidWlsZFR5cGUiOiJ0ZWt0b24uZGV2L3YxYmV0YTEvVGFza1J1biIsImludm9jYXRpb24iOnsiY29uZmlnU291cmNlIjp7fSwicGFyYW1ldGVycyI6e319LCJidWlsZENvbmZpZyI6eyJzdGVwcyI6W3siZW50cnlQb2ludCI6IiMhL3Vzci9iaW4vZW52IHNoXG5lY2hvICdnY3IuaW8vZm9vL2JhcicgfCB0ZWUgL3Rla3Rvbi9yZXN1bHRzL1RFU1RfVVJMXG5lY2hvIFwiZGFuYmV2LXRla3Rvbi1jaGFpbnMtZXhhbXBsZVwiIHwgc2hhMjU2c3VtIHwgdHIgLWQgJy0nIHwgdGVlIC90ZWt0b24vcmVzdWx0cy9URVNUX0RJR0VTVCIsImFyZ3VtZW50cyI6bnVsbCwiZW52aXJvbm1lbnQiOnsiY29udGFpbmVyIjoiY3JlYXRlLWltYWdlIiwiaW1hZ2UiOiJkb2NrZXIuaW8vbGlicmFyeS9idXN5Ym94QHNoYTI1NjpiNWQ2ZmUwNzEyNjM2Y2ViNzQzMDE4OWRlMjg4MTllMTk1ZTg5NjYzNzJlZGZjMmQ5NDA5ZDc5NDAyYTBkYzE2In0sImFubm90YXRpb25zIjpudWxsfV19LCJtZXRhZGF0YSI6eyJidWlsZFN0YXJ0ZWRPbiI6IjIwMjMtMDMtMjJUMDk6NTc6MTVaIiwiYnVpbGRGaW5pc2hlZE9uIjoiMjAyMy0wMy0yMlQwOTo1NzoxOVoiLCJjb21wbGV0ZW5lc3MiOnsicGFyYW1ldGVycyI6ZmFsc2UsImVudmlyb25tZW50IjpmYWxzZSwibWF0ZXJpYWxzIjpmYWxzZX0sInJlcHJvZHVjaWJsZSI6ZmFsc2V9fX0=",
  "signatures": [
    {
      "keyid": "SHA256:caEJWYJSxy1SVF2KObm5Rr3Yt6xIb4T2w56FHtCg8WI",
      "sig": "MEQCIASjypkm8V/uVJQTn/ttOIYr0Ck50CLfSagQkS11eyR/AiA3eHPYVYrGmcFhly6X9f15bDilUBeXuPj8g2x4SFCADQ=="
    }
  ]
}

To verify this attestation this attestation the user would need to figure out how to get the public key that matches this keyid and specify it as the . At least for Tekton Chains this keyid is a fingerprint of  the public key. Some more background on this can be found here.
We have discussed having an additional field for the attesters entries which would be keyid. ~If this is specified we would hash the payload of the attestation, and use the hash to perform a lookup against Rekor. This would allow us to get access to the public key which we could then generate a fingerprint for, and then compare it with the keyid. And then we could use the public key for verification. This will not be great for performance ant it would not be a recommended way, but this might be a nice feature to have to allow someone with only an attestation (which only contains a keyid) to write rules and have them evaluated without having to go find the public key somewhere~.
One thing to note is that the keyid is something that the Signer creates and there is not guarantee that it is a fingerprint of the public key.  This is mentioned in the DSSE protocol specification:
KEYID: Optional, unauthenticated hint indicating what key and algorithm was used to sign the message. As with
Sign(), details are agreed upon out-of-band by the signer and verifier. It MUST NOT be used for security
decisions; it may only be used to narrow the selection of possible keys to try.

So perhaps we need a specific field or something that identifies that this keyid is from Tekton Chains in this case.

I was wrong about the payload has which can be used to look up against Rekor and it is the Rekor record payload which is what can be used to get the Rekor entry. I'll need to rethink this...


Fixing AzureEndpointConfig for AzureUSGovernment Cloud

Fixing AzureEndpointConfig for AzureUSGovernment Cloud as per https://docs.microsoft.com/azure/azure-government/documentation-government-developer-guide#endpoint-mapping

What this PR does / why we need it:
Which issue this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close that issue when PR gets merged): fixes #
Special notes for your reviewer:
Release note:

Thanks @gsacavdm !


MSI token cache not work as expected with millions reqeusts to the IMDS

Customer statement below:
We are using azure service bus java sdk: com.microsoft.azure:azure-servicebus:3.6.6 and recently enabled user managed identity in our azure spring apps to connect and read/write messages to service bus. we noticed that in 24 hours, the sdk makes more than 1 million calls to the IMDS service to get token and this results in slow performance of message consumption and causes issues in our application due to the slowness.
Below is how we create the client to service bus.
Code:
var tokenProvider = TokenProvider.createManagedIdentityTokenProvider();
var clientSettings = new ClientSettings(tokenProvider);
return MessagingFactory.createFromNamespaceName(
serviceBusNamespace,
clientSettings);
The connection is established once during startup but we see that when we use managed identity, the sdk makes a lot of calls to the internal IMDS service of the compute which results in throttling and slows down the overall processing of messaged.
We do not do management operations like getEntity, deleteEntity etc from our application. The application only reads and writes messages to service bus, nothing else.
We have about 16 spring apps and we are using managed identity for various other azure resource which do not seem to have a problem, nor make so many calls to the backend IMDS. We are using it for  azure keyvault, storage blob, we insert and query millions of rows daily in to the database and are using managed identity everywhere without any issues.
Only for service bus, we see so many calls to the backend IMDS. From what we know, tokens returned by the IMDS are valid for 24 hours, so why does the sdk even make so many calls to IMDS ? we don’t see a similar behavior with a high number of calls to IMDS  in other sdks like storage-blob or mssql-jdbc for example.

@billwert could you follow up on this issue reported by @wejian?

@wejian Hello! Can you share some information about what version of the Identity library you are using?

The com.microsoft.azure:azure-servicebus library is a deprecated version. The first step here is to migrate to the new package, com.azure.azure-messaging-servicebus. There is a migration guide available.

But I had a quick look at the Track1 Service Bus library; I think the issue is - Track1 Service Bus Library is not sharing the MSI Credential object; instead, it creates a new MSI Credential object each time it needs to get the token. Because of this, the cache is not being used. This is likely the case, but I would let the owners of Track1 Service Bus Library have a look and confirm.
Here is the code reference  showing the recreation of the Credential object per token retrieval in Track1 Service Bus
If you look at the Track1 Event Hubs, it shares the Credential Object, here is the reference .

Resolved and released in SDK version 3.6.7.


Notifications Preferences Setting for Channels and Group Messages.

It would be useful to enable notifications for certain channels and group messages. Currently, I only receive notifications from direct messages or mentions within channels. However, there are certain channels I need to attend to frequently and others I only look into infrequently. It would be great to be able to set notification preferences for individual channels.
I apologize in advance if this feature is already implemented but I haven't been able to find it.

Hi @jboboyle, please find docs here for channel notification settings https://docs.mattermost.com/channels/set-channel-preferences.html#channel-notification-preferences.


Problems with multiple same IDs

I have layout that is using databinding and has multiple same components, that include EditText with same id (R.id.edit_value).
When recording the test, this ID is used in ViewMatcher, but then the test fails, because there are multiple view with same id in window.
Shouldn't recorder check, if the recorded ID is unique inside the window and if not, at least throw some warning? Best way would be switching to identifing by multiple IDs from parents (my current workaround)

@lhoracek Thanks a lot. I think this is very good idea. I will implement this, but maybe you can send me an example of your code to make sure that I will cover your use case (if this is possible)?

Of course ;-)
I would love to have output like this:
     onView(withId(R.id.username)).perform(scrollTo());         onView(allOf(withParent(withId(R.id.username)), withId(R.id.edit_value))).perform(replaceText("test_username"));         // set password to test         onView(withId(R.id.password)).perform(scrollTo());         onView(allOf(withParent(withId(R.id.password)), withId(R.id.edit_value))).perform(replaceText("test_password"));
You can see the edits have same ID, but different parent. They are just one xml included twice in different places. Databinding alows that component-like use.

@lhoracek is it possible for you to send me example of this Android activity with all those XMLs to save time for me to reproducing this?

I will create sample code for you.

Here is the example use-case https://github.com/lhoracek/databinding_includes

Thanks a lot!

I will update the example with more use-cases. I came up with similar problem when using TabLayout with tabs that contain same IDs.

Thank you very much, this is helping me a lot.

@lhoracek I've uploaded new version 0.9.3 to the repository and to the site. Issue that you've reported should be fixed. Also I am using the generic approach so issue with TabLayout should be also fixed.
Can you please check this when you will have time? And thanks a lot for your idea and your help with this feature.

Checking the 0.9.3 now and replace text generates the matcher perfectly
onView(allOf(withParent(withId(R.id.password)), withId(R.id.edit_value))).perform(replaceText("test"));
but the same thing should be done for the scrollTo statement, generated to make members of scrollView visible.

Yes, you are right. I've missed scroll to part. I've uploaded new version to site - http://droidtestlab.com/AndroidTestsRecorder.zip with this scrollTo fix. I will upload this fix to plugins repository at next release. So you can install plugin from file (site).
Also let me reopen issue because of ViewPager problems. If you will have ability to provide a sample I will try to resolve this somehow (in worse case I will create special Matcher). Thank you for your help.

Will test later today and add ViepagerExample. The ViewPager is working for me with the isDisplayed matcher:
     // Select page 2 in ViewPagerEx with id R.id.container
        onView(withId(R.id.container)).perform(selectViewPagerPage(2));

        // Click at LinearLayout with child index 1 of parent with id R.id.list
        onView(allOf(isDisplayed(),withId(R.id.list))).perform(scrollToPosition(1));
        onView(nthChildOf(allOf(isDisplayed(),withId(R.id.list)), 1)).perform(click());

@vpedak Can confirm, that scroll to is correctly generated with parent path as well.
Viewpager stil causes problem, try utilising the above mentioned method with visibility.

@lhoracek ok, I will prepare a fix for Viewpager soon.

@lhoracek I've uploaded new version to the site http://droidtestlab.com/AndroidTestsRecorder.zip, it contains the fix for ViewPager. Can you please check it at your environment when you will have time?
And I will upload this version to Plugins Repository.
Thanks a lot for all your help with the project.

closing the issue, I've uploaded version 0.9.4 to the repository with all fixes related to this issue


sessionStorage is not defined when using webpack & server side pre-rendering

Does someone have any guidance/examples on how to configure this library when using webpack and server side pre-rendering?  I follow the samples provided in the readme and receive the following error.
NodeInvocationException: sessionStorage is not defined
I'm assuming this is because the server doesn't know about sessionStorage.  Then I move the importing of OAuthModule to only app.module.browser.ts, and I get
NodeInvocationException: No provider for OAuthService!
Should I mock OAuthService server side?  Any input would be appreciated.  I using the Visual Studio 2017 Angular Spa Template from https://github.com/aspnet/JavaScriptServices.
Thanks!

Thanks for pointing this out. This error should now be gone. Please fetch the latest version and retry it.
To support server side rendering, you also need a custom implementation of the interface OAuthStorage. Perhaps one, that saves the token in a cookie. And then you need to create this cookie on client side after login or refresh.
I will provide a sample for this in the course of the next weeks. If you are faster, don't hesitate to send me the link to your repo.

Thanks, for the quick response.  Got another one for you now.
NodeInvocationException: window is not defined
ReferenceError: window is not defined
at OAuthService.setupTimer (~\ClientApp\dist\main-server.js:10725:14)

Oh, I see. To be honst, I've build it with server side rendering in mind but I haven't used it with SSR so far.
Can you retry it now with the latest version?
Btw: Pls don't call tryLogin or initImplicitFlow at server side. They implement implicit flow which is indented for the client side, as it uses the hash fragment for instance.

btw: I'm very interested into your findings. So pls keep me in the role and don't hesitate if you have a question.

Okay, so after your changes for checking whether sessionStorage/window were undefined, I can inject OAuthService both browser and server side with no issues.  However, using the OAuthService server side could still cause possible errors.  The private field OAuthService._storage is never set server side since sessionStorage is undefined, and it's used in multiple function calls resulting in null reference exceptions thrown.  I looked at injecting a mock of OAuthStorage on the server side and this does help, but it seems like it doesn't make much sense to run any of the OAuthService configuration/calls on the server anyway?  The solution I settled on was wrapping an isBrowser check around all OAuthService calls.  Here's an example from my two components.
export class AppComponent implements OnInit {
    constructor(private oauthService: OAuthService, @Inject('IS_BROWSER') private isBrowser: boolean) {
    }

    ngOnInit(): void {
        if (this.isBrowser) {
            this.oauthService.redirectUri = window.location.origin + "/index";

            this.oauthService.clientId = "MyClient";

            this.oauthService.scope = "openid profile";

            this.oauthService.issuer = "https://myIdP.com";

            this.oauthService.requestAccessToken = false;

            this.oauthService.tokenValidationHandler = new JwksValidationHandler();

            this.oauthService.loadDiscoveryDocument()
                .then(() => {
                    this.oauthService.tryLogin();
                });
        }
    }
}

export class NavMenuComponent {
    constructor(private oauthService: OAuthService, @Inject('IS_BROWSER') private isBrowser: boolean) {
    }
    public get userName() {
        if (!this.isBrowser)
            return null;

        var claims = this.oauthService.getIdentityClaims() as any;

        if (!claims)
            return null;

        return claims.sub;
    }

    logIn(): void {
        if (this.isBrowser) {
            this.oauthService.initImplicitFlow();
        }
    }

    logOut(): void {
        if (this.isBrowser) {
            this.oauthService.logOut();
        }
    }
}

I feel I'm still an Angular noobie, so if you have any suggestions you'd like me to try, I'd be happy to.

I think this is a good first step. Esp. when it comes to calling initImplicitFlow, logOut and tryLogin.
Would it be interesting for you, to access the claims on server side?
In this case, we could write a Storage that uses cookies.
Is your example available online, e. g. here in GitHub?

I believe I would only be interested in accessing the claims server side when I'm calling my api.  However, I plan on doing this with the access token passed via an authorization header.  When you say "server side", do you mean traditional api calls or do you mean the pre-rendering angular universal functionality?  Would there be benefit to being able to access the claims during pre-rendering?  I'm sorry but my example isn't online.

Yes, I mean the latter one. For instance, you could hide or show menu items with respect to the claims in the id_token.

Closing this as discussion came to an end.


Dockerize

try to run chiitiler on debian11
debian11 needs some dependencies - https://github.com/maplibre/maplibre-native/tree/main/platform/linux
linux/arm is difficult to build

I can take care of it

solved by df55c2c


Generate Random Whole Numbers within a Range

"randomRange should use use both myMax and myMin, and return a random number in your range."
"use" is used two times :)

I can confirm this:


Buff out Type annotations for runtime/-dom- files that use Xen

@sjmiles Can I close this issue?

Yup, thanks!


[RayWenderlich]: Unable to extract video id

Checklist

[X] I'm reporting a broken site
[X] I've verified that I'm running yt-dlp version 2021.12.27. (update instructions)
[X] I've checked that all provided URLs are alive and playable in a browser
[X] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[X] I've searched the bugtracker for similar issues including closed ones. DO NOT post duplicates
[X] I've read the guidelines for opening an issue
[x] I've read about sharing account credentials and I'm willing to share it if required

Region
No response
Description
Hello everyone!
I'm getting an error when trying to download from raywenderlich.com
What can be done?
Verbose log
C:\ytdl>yt-dlp --cookies-from-browser chrome https://www.raywenderlich.com/22246944-cloud-firestore-on-android-getting-started
[Cookies] Extracting cookies from chrome
[Cookies] Extracted 4401 cookies from chrome
[RayWenderlichCourse] 22246944-cloud-firestore-on-android-getting-started: Downloading webpage
[download] Downloading playlist: Cloud Firestore on Android - Getting Started
[RayWenderlichCourse] playlist Cloud Firestore on Android - Getting Started: Collected 10 videos; downloading 10 of them[download] Downloading video 1 of 10
[RayWenderlich] 22246944-cloud-firestore-on-android-getting-started/1: Downloading webpage
ERROR: [RayWenderlich] 1: Unable to extract video id; please report this issue on  https://github.com/yt-dlp/yt-dlp . Make sure you are using the latest version; type  yt-dlp -U  to update. Be sure to call yt-dlp with the --verbose flag and include its complete output.; please report this issue on  https://github.com/yt-dlp/yt-dlp . Make sure you are using the latest version; type  yt-dlp -U  to update. Be sure to call yt-dlp with the --verbose flag and include its complete output.
[download] Downloading video 2 of 10
[RayWenderlich] 22246944-cloud-firestore-on-android-getting-started/2: Downloading webpage
ERROR: [RayWenderlich] 2: Unable to extract video id; please report this issue on  https://github.com/yt-dlp/yt-dlp . Make sure you are using the latest version; type  yt-dlp -U  to update. Be sure to call yt-dlp with the --verbose flag and include its complete output.; please report this issue on  https://github.com/yt-dlp/yt-dlp . Make sure you are using the latest version; type  yt-dlp -U  to update. Be sure to call yt-dlp with the --verbose flag and include its complete output.
[download] Downloading video 3 of 10
[RayWenderlich] 22246944-cloud-firestore-on-android-getting-started/3: Downloading webpage
ERROR: [RayWenderlich] 3: Unable to extract video id; please report this issue on  https://github.com/yt-dlp/yt-dlp . Make sure you are using the latest version; type  yt-dlp -U  to update. Be sure to call yt-dlp with the --verbose flag and include its complete output.; please report this issue on  https://github.com/yt-dlp/yt-dlp . Make sure you are using the latest version; type  yt-dlp -U  to update. Be sure to call yt-dlp with the --verbose flag and include its complete output.
[download] Downloading video 4 of 10
[RayWenderlich] 22246944-cloud-firestore-on-android-getting-started/4: Downloading webpage
ERROR: [RayWenderlich] 4: Unable to extract video id; please report this issue on  https://github.com/yt-dlp/yt-dlp . Make sure you are using the latest version; type  yt-dlp -U  to update. Be sure to call yt-dlp with the --verbose flag and include its complete output.; please report this issue on  https://github.com/yt-dlp/yt-dlp . Make sure you are using the latest version; type  yt-dlp -U  to update. Be sure to call yt-dlp with the --verbose flag and include its complete output.
[download] Downloading video 5 of 10
[RayWenderlich] 22246944-cloud-firestore-on-android-getting-started/5: Downloading webpage
ERROR: [RayWenderlich] 5: Unable to extract video id; please report this issue on  https://github.com/yt-dlp/yt-dlp . Make sure you are using the latest version; type  yt-dlp -U  to update. Be sure to call yt-dlp with the --verbose flag and include its complete output.; please report this issue on  https://github.com/yt-dlp/yt-dlp . Make sure you are using the latest version; type  yt-dlp -U  to update. Be sure to call yt-dlp with the --verbose flag and include its complete output.
[download] Downloading video 6 of 10
[RayWenderlich] 22246944-cloud-firestore-on-android-getting-started/6: Downloading webpage
ERROR: [RayWenderlich] 6: Unable to extract video id; please report this issue on  https://github.com/yt-dlp/yt-dlp . Make sure you are using the latest version; type  yt-dlp -U  to update. Be sure to call yt-dlp with the --verbose flag and include its complete output.; please report this issue on  https://github.com/yt-dlp/yt-dlp . Make sure you are using the latest version; type  yt-dlp -U  to update. Be sure to call yt-dlp with the --verbose flag and include its complete output.
[download] Downloading video 7 of 10
[RayWenderlich] 22246944-cloud-firestore-on-android-getting-started/7: Downloading webpage
ERROR: [RayWenderlich] 7: Unable to extract video id; please report this issue on  https://github.com/yt-dlp/yt-dlp . Make sure you are using the latest version; type  yt-dlp -U  to update. Be sure to call yt-dlp with the --verbose flag and include its complete output.; please report this issue on  https://github.com/yt-dlp/yt-dlp . Make sure you are using the latest version; type  yt-dlp -U  to update. Be sure to call yt-dlp with the --verbose flag and include its complete output.
[download] Downloading video 8 of 10
[RayWenderlich] 22246944-cloud-firestore-on-android-getting-started/8: Downloading webpage
ERROR: [RayWenderlich] 8: Unable to extract video id; please report this issue on  https://github.com/yt-dlp/yt-dlp . Make sure you are using the latest version; type  yt-dlp -U  to update. Be sure to call yt-dlp with the --verbose flag and include its complete output.; please report this issue on  https://github.com/yt-dlp/yt-dlp . Make sure you are using the latest version; type  yt-dlp -U  to update. Be sure to call yt-dlp with the --verbose flag and include its complete output.
[download] Downloading video 9 of 10
[RayWenderlich] 22246944-cloud-firestore-on-android-getting-started/9: Downloading webpage
ERROR: [RayWenderlich] 9: Unable to extract video id; please report this issue on  https://github.com/yt-dlp/yt-dlp . Make sure you are using the latest version; type  yt-dlp -U  to update. Be sure to call yt-dlp with the --verbose flag and include its complete output.; please report this issue on  https://github.com/yt-dlp/yt-dlp . Make sure you are using the latest version; type  yt-dlp -U  to update. Be sure to call yt-dlp with the --verbose flag and include its complete output.
[download] Downloading video 10 of 10
[RayWenderlich] 22246944-cloud-firestore-on-android-getting-started/10: Downloading webpage
ERROR: [RayWenderlich] 10: Unable to extract video id; please report this issue on  https://github.com/yt-dlp/yt-dlp . Make sure you are using the latest version; type  yt-dlp -U  to update. Be sure to call yt-dlp with the --verbose flag and include its complete output.; please report this issue on  https://github.com/yt-dlp/yt-dlp . Make sure you are using the latest version; type  yt-dlp -U  to update. Be sure to call yt-dlp with the --verbose flag and include its complete output.
[download] Finished downloading playlist: Cloud Firestore on Android - Getting Started

After applying this patch it became possible to download free videos, but when downloading videos by subscription, I get the same error :(

Also I found a fix for this error for another extractor, but I don't know how it can help me

help :|
C:\Program Files\_ytdl>yt-dlp -U
Latest version: 2022.05.18, Current version: 2022.05.18
yt-dlp is up to date (2022.05.18)

C:\Program Files\_ytdl>yt-dlp --cookies-from-browser chrome https://www.raywenderlich.com/20656790-units-measurement-in-ios -v
[debug] Command-line config: ['--cookies-from-browser', 'chrome', 'https://www.raywenderlich.com/20656790-units-measurement-in-ios', '-v']
[debug] Encodings: locale cp1251, fs utf-8, pref cp1251, out utf-8, error utf-8, screen utf-8
[debug] yt-dlp version 2022.05.18 [b14d523] (win_exe)
[debug] Python version 3.8.10 (CPython 64bit) - Windows-10-10.0.19044-SP0
[debug] Checking exe version: ffprobe -bsfs
[debug] Checking exe version: ffmpeg -bsfs
[debug] exe versions: ffmpeg 2021-12-12-git-996b13fac4-full_build-www.gyan.dev (setts), ffprobe 2021-12-12-git-996b13fac4-full_build-www.gyan.dev
[debug] Optional libraries: Cryptodome-3.14.1, brotli-1.0.9, certifi-2021.10.08, mutagen-1.45.1, sqlite3-2.6.0, websockets-10.3
[Cookies] Extracting cookies from chrome
[debug] Extracting cookies from: "C:\Users\User\AppData\Local\Google\Chrome\User Data\Default\Network\Cookies"
[debug] Found local state file at "C:\Users\User\AppData\Local\Google\Chrome\User Data\Local State"
[Cookies] Extracted 3242 cookies from chrome
[debug] cookie version breakdown: {'v10': 3242, 'other': 0, 'unencrypted': 0}
[debug] Proxy map: {}
[debug] [RayWenderlichCourse] Extracting URL: https://www.raywenderlich.com/20656790-units-measurement-in-ios
[RayWenderlichCourse] 20656790-units-measurement-in-ios: Downloading webpage
[download] Downloading playlist: Units & Measurement in iOS
[RayWenderlichCourse] playlist Units & Measurement in iOS: Collected 3 videos; downloading 3 of them
[download] Downloading video 1 of 3
[debug] [RayWenderlich] Extracting URL: https://www.raywenderlich.com/20656790-units-measurement-in-ios/lessons/1
[RayWenderlich] 20656790-units-measurement-in-ios/1: Downloading webpage
ERROR: [RayWenderlich] 1: Unable to extract video id; please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U
  File "yt_dlp\extractor\common.py", line 642, in extract
  File "yt_dlp\extractor\raywenderlich.py", line 102, in _real_extract
  File "yt_dlp\extractor\common.py", line 1226, in _search_regex

[download] Downloading video 2 of 3
[debug] [RayWenderlich] Extracting URL: https://www.raywenderlich.com/20656790-units-measurement-in-ios/lessons/2
[RayWenderlich] 20656790-units-measurement-in-ios/2: Downloading webpage
ERROR: [RayWenderlich] 2: Unable to extract video id; please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U
  File "yt_dlp\extractor\common.py", line 642, in extract
  File "yt_dlp\extractor\raywenderlich.py", line 102, in _real_extract
  File "yt_dlp\extractor\common.py", line 1226, in _search_regex

[download] Downloading video 3 of 3
[debug] [RayWenderlich] Extracting URL: https://www.raywenderlich.com/20656790-units-measurement-in-ios/lessons/3
[RayWenderlich] 20656790-units-measurement-in-ios/3: Downloading webpage
ERROR: [RayWenderlich] 3: Unable to extract video id; please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U
  File "yt_dlp\extractor\common.py", line 642, in extract
  File "yt_dlp\extractor\raywenderlich.py", line 102, in _real_extract
  File "yt_dlp\extractor\common.py", line 1226, in _search_regex

[download] Finished downloading playlist: Units & Measurement in iOS


No support for secure (TLS) broker connections

Version: v1.2.0
The latest version of device-mqtt doesn't allow for broker connections (command, incoming, and response) to be configured for secure (TLS) connections. Each broker configuration does allow for username and password to be specified, however without TLS support, these are passed in cleartext to the broker on connection establishment.
Here's a link to a good article describing how (and why) TLS can be used to secure MQTT connections:
https://www.hivemq.com/blog/mqtt-security-fundamentals-tls-ssl/
It looks like the Paho MQTT client allows basic TLS (i.e. server-side) and two-way TLS. At minimum we should allow for configuration of server-side TLS. The Paho python client documentation has a bit more documentation on TLS usage:
https://www.eclipse.org/paho/clients/python/docs/
Note - it might be possible that our existing implementation already supports server-side TLS by simply setting the connection ResponseSchema to "tls", and changing the ResponsePort to 8883.
A related issue is that right now the username and password for connections are supported via configuration values. A separate issue should be filed to get rid of these from the configuration.toml files.

It turns out I was wrong, and that the current implementation does support connection to a broker using TLS. This is done by configuring the correct Port and setting the Schema for the broker to "tls".
Note - I did open a new issue (issue #161) for lack of support for broker/server self-signed TLS certificates when running in a docker container or snap.


chore: merge master into develop

Issue #, if available:
N/A
Description of changes:
Merges master back into develop after v1.21.0 release
Description of how you validated changes:
Checklist:

[ ] Write/update tests
[ ] make pr passes
[ ] Update documentation
[ ] Verify transformed template deploys and application functions as expected
[ ] Add/update example to examples/2016-10-31

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Codecov Report

Merging #1463 into develop will increase coverage by 0.27%.
The diff coverage is n/a.

@@             Coverage Diff             @@
##           develop    #1463      +/-   ##
===========================================
+ Coverage    94.40%   94.67%   +0.27%
===========================================
  Files           78       78
  Lines         4556     5056     +500
  Branches       911     1100     +189
===========================================
+ Hits          4301     4787     +486
- Misses         120      124       +4
- Partials       135      145      +10

Impacted Files
Coverage Δ

samtranslator/swagger/swagger.py
92.43% <0.00%> (-0.46%)
:arrow_down:

samtranslator/model/api/api_generator.py
95.09% <0.00%> (-0.04%)
:arrow_down:

samtranslator/model/apigateway.py
97.64% <0.00%> (-0.32%)
:arrow_down:

samtranslator/model/eventsources/push.py
91.34% <0.00%> (+1.04%)
:arrow_up:

samtranslator/model/api/http_api_generator.py
99.40% <0.00%> (+1.29%)
:arrow_up:

samtranslator/open_api/open_api.py
95.87% <0.00%> (+1.98%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 9de1f6a...6a278ff. Read the comment docs.


Forward slash '/' cannot be used in object names

The character forward slash '/' cannot be used in object names, for example:
address_subnet:
  - name: 'test-<IP_ADDRESS>/32'
    subnet: '<IP_ADDRESS> <IP_ADDRESS>'

When using the literal '/' this is regarded as an URL separator which makes the API PUT request fail with HTTP 400. See also httpsd debug log and packet capture:
slash-literal.txt
slash-literal.zip
When encoding the '/' as '%2F' the API PUT and POST requests actually go through, but the object is created with '%2F' in its name instead of '/'. See also httpsd debug log and packet capture:
slash-encoded.txt
slash-encoded.zip
Potentially this may be a bug at fortiosapi-level, I may raise there if you can confirm that this lies with that project.

Hi @cbachert We reproduced the bug you submitted and will discuss the solution with the fortiapi developers. Thank you!

This looks like a duplication of issue: https://github.com/fortinet-solutions-cse/ansible_fgt_modules/issues/14
I made a fix from ansible side with which you don't have to encode your name yourself, ansible will do it for you. https://github.com/ansible/ansible/pull/66050
from the log slash-encoded.txt, test-<IP_ADDRESS>%2F32 is resolved back to test-<IP_ADDRESS>/32 correctly. @cbachert can you help verify the fix with latest fortigate build? if this issue persists, could you share your build number and ansible version?
thanks,
Link

This looks like a duplication of issue: fortinet-solutions-cse/ansible_fgt_modules#14
I made a fix from ansible side with which you don't have to encode your name yourself, ansible will do it for you. ansible/ansible#66050
from the log slash-encoded.txt, test-<IP_ADDRESS>%2F32 is resolved back to test-<IP_ADDRESS>/32 correctly. @cbachert can you help verify the fix with latest fortigate build? if this issue persists, could you share your build number and ansible version?
thanks,
Link

I realized this project call fortiosapi library, there is no url encoding for mkey in fortiosapi now, the fix in last comment is httpapi only.
the fix is not for this.


Update file FileViewFinder.php add function prependLocation

Update file FileViewFinder.php add function prependLocation

Looks like you targeted a branch based on 5.4 to 5.3. Please cherry-pick your commit onto a 5.3 based branch.


Standardize IAM Policies to Use aws_iam_policy_document Format

Community Note

Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
Please do not leave "+1" or other comments that do not add relevant new information or questions, they generate extra noise for issue followers and do not help prioritize the request
If you are interested in working on this issue or have submitted a pull request, please leave a comment

What is the outcome that you are trying to reach?
To ensure consistency and maintainability, I suggest having all IAM policies within the module use the data "aws_iam_policy_document" format instead of directly embedding the JSON policy within the aws_iam_policy resource.

Describe the solution you would like
Adjust the policies from this to this format and then pass it to the source_policy_documents parameter like this.
Describe alternatives you have considered
N/A
Additional context

I would like to work on this issue

Thank you @rogerlima95 , seems @edgarsilva948 already addressed it in this PR: https://github.com/aws-ia/terraform-aws-eks-ack-addons/pull/74


sqlite3 for Windows 10 Universal apps

Hi,
I'm migrating my app to run on Windows 10 and I'm having issues with sqlite3.dll.
I've downloaded the latest libraries from the official website and replace it and it's working now, at least on x86.
Any change you could update this libraries for x86 and x64 on NuGet?
Thanks

Yeah, it sounds like I need to make a change here.
But I haven't even looked at building for Windows 10 yet.  I suspect that just getting the tooling setup will take me some time.
For now, can you tell me anything more specific about the issues you were having?
Thanks!

Unable to load DLL 'sqlite3': The specified module could not be found.
An exception of type 'System.TypeInitializationException' occurred in mscorlib.dll but was not handled in user code
Additional information: The type initializer for 'SQLitePCL.raw' threw an exception.
{"The type initializer for 'SQLitePCL.raw' threw an exception."}
{"Unable to load DLL 'sqlite3': The specified module could not be found. (Exception from HRESULT: 0x8007007E)"}
The type initializer for 'SQLitePCL.raw' threw an exception.
at SQLitePCL.raw.sqlite3_open_v2(String filename, sqlite3& db, Int32 flags, String vfs)

Thanks!

That error message looks exactly like the one that people get when they use SQLitePCL.raw without adding a reference to the Visual C++ runtime extension SDK.  With any of the RT flavors of Windows (Windows Store, WP81, etc), this happens all the time.
I'm not sure which nuget platform from SQLitePCL.raw got included by your Windows 10 app.  Plain net45?  One of the RT flavors?
When you say that you "downloaded the latest libraries from the official website", I assume you are referring to sqlite.org?  Can you tell me exactly which library you downloaded?
I suspect that you just needed to add a C++ runtime reference.  I further suspect that the reason that using a build from sqlite.org worked is because that build had the C runtime lib statically linked.  Which AFAIK is impossible for any of the RT flavors.
But all this conjecture comes from a position of ignorance about how all these issues might be changing with Windows 10.

Eric, sorry for the lack of context!
I'm using Akavache in my project, which uses SQLitePCL.raw.
In fact, the Visual C++ runtime extension SDK is actually missing from the project. MSFT Technical Evangelist told me that the package isn't ready yet. Do you think this will solve the issue once they have it?
The library I've downloaded is "sqlite-dll-win32-x86-3080900.zip" from https://www.sqlite.org/download.html
I've replaced sqlite3.dll  in "packages\SQLitePCL.raw_basic.0.7.0\build\native\sqlite3_dynamic\winrt81" with the new one and it worked.

I'm pretty sure the sqlite DLL you grabbed from sqlite.org was probably compiled for plain old win32, not with the newer toolchain.  I would not expect that to work.  But it did.  That's interesting.
I'll need to dig into this further.
And since you're on Akavache, I'll just tag @paulcbetts here to make sure he sees this.

So while I've got you here, why don't we statically link the CRT? You mentioned it fails on RT - why?

I would prefer to statically link it, but I think it's just not a supported
operation.
I can't find an authoritative link at the moment, but here's a stack
overflow post that says the kind of things I tend to see on this topic:
http://stackoverflow.com/questions/24727423/how-to-statically-link-to-msvcp120-dll-in-vs2013
IIRC, the last time I tried to make this work by directly manipulating the
command line flags, it gave me a compiler error.
--
E
On Friday, April 10, 2015, Paul Betts<EMAIL_ADDRESS>wrote:

So while I've got you here, why don't we statically link the CRT? You
mentioned it fails on RT - why?
—
Reply to this email directly or view it on GitHub
https://github.com/ericsink/SQLitePCL.raw/issues/44#issuecomment-91712099
.

This whole SO post is like one big "Citation Needed" :P

Yeah.  This is a bit more authoritative, although written in a confusing manner:
https://msdn.microsoft.com/en-us/library/hh972425.aspx

I can confirm that using the dll from http://www.sqlite.org/2015/sqlite-dll-win32-x86-3081002.zip works for my WPF app using Akavache.

Any updates on this issue so far? What I found out:

Running on Windows 10 Desktop seems to work fine if a reference to VC++ 2013 libs is added
Running on Windows 10 Mobile emulator breaks

I narrowed the problem down to the provided sqlite3.dll, build\native\sqlite3_dynamic\winrt81\x86\sqlite3.dll
If I remove this dll and add a reference to the sqlite3.dll provided by Visual Studio the app runs fine. So one solution (at least a temporary one, but easy to implement ;) ) would be make the automatic adding of the included sqlite3.dll optional. If I recall correctly there was a build definition for this in the past?
This way a developer targeting Windows 10 (or maybe other platforms in the future) could opt-out of the bundled .dll and use their own.

Could you provide more detail about "the sqlite3.dll provided by Visual Studio"?  Exactly where does this come from?  What version of Visual Studio are you using?  etc.
There are two issues here:
(1)  If I can build my sqlite3.dll differently (better), then I want to figure out how.
(2)  I need to re-look at adding a flag so that Windows users can skip using the bundled sqlite3.dll.
--
E

Hi Eric,
I'm using VS 2015. The dll comes from the Visual Studio Gallery: https://visualstudiogallery.msdn.microsoft.com/4913e7d5-96c9-4dde-a1a1-69820d615936
On this page you can also find versions for Win8, 8.1, Windows Phone etc. They are maintained by the SQLite developers directly (I think)
https://visualstudiogallery.msdn.microsoft.com/site/search?f[0].Type=User&f[0].Value=SQLite Development Team
The ones without OS version numbers are for Windows(Phone) 8.0. The .vsix downloads can be renamed to .zip for extraction.
I'm not too firm on licensing and such but maybe you can just include the prebuilt dlls from these projects?
Anyhow I think adding a skip-bundled-dll flag would be really useful, for example if someone needs a custom built sqlite.dll.

Btw. I just realized you can also download the .vsix files directly from the sqlite website https://www.sqlite.org/download.html

Since migrating to Visual Studio 2015, I'm having this issue again as @dominik-weber.
To fix it, I needed to add this two references:

I just tested it on a desktop, but I'm not sure yet if it will work cross all platforms.

did you already have time to look at the prebuilt assemblies?

Not exactly sure what you mean by "the prebuilt assemblies", but I was looking at stuff related to this issue this week.  More to come, hopefully.

I'm sorry, I meant the prebuilt sqlite3.dll files you can download from the sqlite website: https://www.sqlite.org/download.html (download .vsix files, open them with zip program)

Ah, yes.
There are two issues here:
(1)  Something about the sqlite3.dll I'm including isn't working in some situations, none of which I have reproduced or understand completely yet.
(2)  Regardless of how I resolve (1), I want (and thought I already had) better support for use cases where the sqlite3.dll for Windows is being provided from Somewhere Else.
And there are two ways to resolve (1):
(a)  Fix the way I build SQLite for whatever environments it's not working in.
(b)  Don't build SQLite.  Just ship the dll Richard and his team builds.
And there are a couple of possible ways to do (a):
(x)  Fix my build scripts.
(y)  Use the exact build script from the sqlite source tree.
I could expound further on (x) and (y), but I'll stop here.  Suffice it to say that lots of possibilities are in play.
But among them, (b) is my very last resort.  It is the option I plan to avoid unless I fail at everything else.

Hmm, I don't really see why building the sqlite3.dll yourself would improve anything apart from being more consistent with other platforms where you might not have access to a prebuilt library. In my mind using the one from sqlite.org would reduce the maintenance required to keep the dll up to date, but i guess that just comes down to personal preference.
Regarding (2): Did you add any means of using external sqlite3.dll builds? Currently when adding a reference to sqlitepcl_raw AND the prebuilt vsix/dll i'm unable to build the project: "Payload contains two or more files with the same destination path 'sqlite3.dll'."
What I'm doing to work around this issue is removing the file build\netcore451\SQLitePCL.raw_basic.targets from the nuget cache directory. However this is not a clean solution at all since it has to be done manually on every development machine and also affects other projects (at least if you have a shared nuget cache). One solution to this would be to simply add a compile variable which prevents the bundled sqlite3.dll from being injected.

Sorry, I should have explained a bit more.
Yes, I want to build sqlite myself so that all of the ones I ship are built with the same options.  Also, I want to understand why the one I'm building is having problems, and once I do, there will be no need to use the one from sqlite.org.  In other words, I don't want to ship the ones from sqlite.org just to avoid figuring out what's wrong.
Regarding (2):  Not yet.  Should be simple.  I tried, and ran into a glitch and didn't push through it yet.  Soon.

Could you try version 0.8.5-pre1 (from nuget.org)?
In your project file, set the msbuild property UseSQLiteFrom to the value "elsewhere":
<UseSQLiteFrom>elsewhere</UseSQLiteFrom>

Hopefully this works, although it only resolves (2).

works perfectly, thanks! :)

Might be relevant here but the latest Win10 SDK now seems to include SQLite too:
https://blogs.windows.com/buildingapps/2015/12/03/windows-10-build-10586-sdk-breakdown/
https://msdn.microsoft.com/en-us/library/windows/apps/xaml/mt592864.aspx
Not yet sure how it interacts with this project.

@onovotny Thanks for the heads-up.

Any news on this for uwp apps ? is the new recommended way to use your nugget package but for uwp, use external libraries though the vsix ?

"is the new recommended way to use your nugget package but for uwp, use external libraries though the vsix ?"
Yes, that is the current workaround, with:
<UseSQLiteFrom>elsewhere</UseSQLiteFrom>

The bundled sqlite3.dll in SQLitePCL.raw is still broken for UWP, but I am now pretty sure I know how to fix it.  I hope to get this done next week.  Our company is moving to new office space this week, and that has caused me a variety of delays.  :-)

Clarification:  Using the sqlite3.dll from the vsix (or the Windows SDK) is more than just "the current workaround".  For some people, it is the preferred way of working, and I will continue to support this going forward.

Great news ! since I am using xamarin, I would prefer to have just "one way" of using sqlite hence your package, with the fix for uwp... I will be waiting :)
Let me know i can help test it out !
Regards, Erik.

in the second link from @onovotny there is actually a section on how to build sqlite yourself, maybe this helps.

TLDR:  Please try SQLitePCL.raw 0.8.5-pre2
I am about 95% certain that all the problems described in the thread above are caused by the inability to find the Visual C++ 2013 runtime DLL.  I just pushed up 0.8.5-pre2, which contains an attempted fix.
In a nutshell, the "fix" is an SDKReference item in the .targets file.  I've tried this before and never quite gotten the magic incantation to work.  This time it would seem that I've got it.  Furthermore, if this fix is correct, then I am a bonehead because I could and should have figured it out a long time ago.
Another way of saying the above is that I am 95% certain there was nothing wrong with the way I was building sqlite3.dll.  It was simply failing because it needed a reference to the Visual C++ runtime DLL.  The SQLite vsix was succeeding because it was automatically adding that reference.  As of 0.8.5-pre2, the nuget package should be doing so as well.
Note that I am not (yet) building specifically for UWP.  This change is simply relying on the ability of a UWP app/library to consume a nuget package targeted at netcore451.  Since I am not using any UWP-specific APIs, building specifically for UWP should not be necessary.  I do have some of the groundwork laid for later supporting the "dotnet" TFM and for building with the v140 PlatformToolset, but none of that is used or necessary yet.  I am also going to be exploring the possibilities of using the "runtimes" folder in nuget 3.x, but probably not until that functionality is supported by Xamarin.
Currently, 0.8.5-pre2 works for me when using Windows 8 Universal and when using Windows 10 Universal in Visual Studio 2015.  Feedback from others would be welcomed.

Hi Eric, just a FYI Microsoft is ending support for .Net 4.5.1 in January and the new base standard is .Net 4.5.2 moving forward.  Can you adjust this in your next release?
http://blogs.msdn.com/b/dotnet/archive/2014/08/07/moving-to-the-net-framework-4-5-2.aspx
Also, please explain why we need to have an external dependency on the old 2013 Visual C++ run-time libraries being installed on every machine (we are using your code with .Net 4.5.2 WPF C# on Windows 10 64 bit). SQLite3.dll should be compiled to statically link the C++ libs under windows or at a minimum use the better/newer VS2015 compiler correct?
Thanks for all the amazing work - we all really enjoy using your code in our .Net apps under Windows.

(1)  Yeah, good point.  I do need to change that to netcore452
(2)  I am still working on a VC 2015 build.  The build itself is easy.  I just haven't figured out all the new NuGet 3.x issues of getting that build into the nupkg.
(2a)  I wish I could statically link the C++ runtime lib, but all information I have found seems to say that Microsoft does not support this anymore.  There is some mention of this further up in this thread.

Slight and ultra-pedantic correction to (1) above:  netcore451 does not precisely refer to .NET 4.5.1.  Rather, it is equivalent to the TFM for Win81.
That said, I do have some updates that should be done w.r.t. the end of support for certain .NET framework versions as mentioned above.

Hi Eric, just tried SQLitePCL.raw 0.8.5-pre2 with my uwp app, it works on windows 10 desktop but not when i deploy to windows 10 mobile (x86 using hyper-v emulator)... any ideas ?

Hmmm.  Any error messages or other diagnostic info?

nope... just the same "could not load sqlite3.dll"

I'm seeing the same issue.  I have a UWP project that I can run locally (i.e. on a desktop) but if run on a Windows 10 mobile simulator or device (i.e. Lumia 640) it throws a runtime error:
"Unable to load DLL 'sqlite3': The specified module could not be found."
I've reproduced this with v0.8.2 and 0.8.5-pre2.  I'm happy to do further testing or send additional details.

I've been continuing to work on this area.
Current conjecture:  UWP claims to be able to handle stuff compiled for win81 TFM, but maybe this is not necessarily true for native code.  Like maybe it works fine for desktop stuff, but it fails for a device or simulator because it can't just drop the VS 2013 C runtime into that environment and expect it to work.
So maybe, because my nupkg has a mixture of managed code and native code, I need to be more specifically targeted for UWP.  Maybe I need the native code to be compiled against the VC 2015 runtime instead of the 2013 runtime.  Maybe I need to use the uap10 TFM or the dotnet TFM.
So this is the path I'm currently on.  The actual compile steps have been pretty simple.  Getting stuff into a nupkg that UWP can consume (without breaking older use cases) has been the tough part.  Most days I feel like maybe I'm the first person on the planet trying to create a cross-platform bait and switch PCL nuget package with support for UWP as well as older platforms  and bundling both native and manage code.

I think if you use the new \ref\uap10.0 and \runtimes\uap10.0\ support, it'll work because only UWP will read those. Existing NuGet v2 will ignore it and just use \lib\foo

@onovotny Thanks for chiming in here.  I thought about using \ref\ and \runtimes\, but my package uses a .targets file to allow different builds of the native code to be selected based on an msbuild property.  So I've been trying to put the assembly in \lib\uap10.0\SQLitePCL.raw.dll and the targets file in \build\uap10.0\SQLitePCL.raw.targets, on the belief that this mechanism would still work as long as I also include the appropriate dependencies/group targetFramework="uap10.0" stuff.  Am I on the wrong track?

I think that if you go down the route of using ref/runtimes for UWP then I'd skip the targets. The targets mechanism was a workaround for NuGet v2 for not supporting those runtime pivots. You could have a \build\uap10.0\_._ folder to explicitly not include the targets for uap10.0 as each top level folder evaluates independently. Having a blank uap10.0 build folder would override that for just that TFM.

I'm (currently) using the targets file for more than just choosing CPU arch.  The UseSQLiteFrom msbuild property can be used to say "don't provide me with sqlite3.dll at all, since I want to use the one from the vsix built by the sqlite team".  OR, that same msbuild property can be used to say "instead of regular sqlite3.dll, provide me with SQLCipher".
Originally, my plan was to separate these use cases into separate nuget packages.  So for example I would have one form of the SQLitePCL.raw nupkg which bundled plain SQLite, one which bundled SQLCipher, and one which bundled nothing.
This approach caused big problems for library packages like Akavache, which build on SQLitePCL.raw.  The decision of whether to include the encryption features (SQLCipher) or not should be left up to the app developer, but Akavache doesn't want to maintain N versions simply because I have N versions.
At the time, introducing the msbuild property was the easy choice because I already had to swallow the pain of that darn targets file anyway just to get CPU arch selection.  As of NuGet v3, the CPU arch stuff could be done far more elegantly by the ref and runtimes folders, but AFAICT, a targets file is still the only way to people to use msbuild properties to customize which things are provided.
(Furthermore, I remind myself here that I couldn't really switch everything to the more elegant ref and runtimes folders until they are supported by Xamarin anyway.)
Typically this line of reasoning ends with me wishing that NuGet had something like Debian's "virtual packages", so I could say "the essence of SQLitePCL.raw is provided by any of the following concrete packages..."  But of course, that would be a large and entirely new can of worms.

Fair enough - afaik, there's nothing that shouldn't continue to work with uap10.0 with the targets file. It'd be similar to what you've done with WP8...
For the dependencies, looking at your build process as you appear to generate the nuspec file, if you want to use my RefGen tool, you'll prob need to invoke it manually instead of relying on its targets.
https://github.com/onovotny/ReferenceGenerator#command-line
For arg 0, you'll need to find out the value of $(NuGetTargetMoniker);$(_NuGetTargetFallbackMoniker) from your UWP project and use that.

Update, FWIW:  I have reproduced the behavior others are seeing, where it works for desktop but not in the mobile simulator.
Still digging...

@onovotny Yeah, my gen_build.cs is probably unique.  I just hate maintaining dozens of XML files that are similar.  Generating them gives me a way to change something in just one place.  I borrowed the idea from CMake.
Anyway...
Looks like using NuSpec.ReferenceGenerator will be fairly painless.  I fixed gen_build.cs to add it to the appropriate project.json file(s), and on first glance it looks like it Just Works.  I've got a bit more work to do, but right now this seems like the way to go.  Thanks.

Awesome! I tried to have it do a lot via convention to find sensible defaults. The one parameter that might need updating, if any, is the NuSpecFile if it can't find it. By default it looks for a .nuspec file at or beneath the sln file that matches the project name. If the nuspec name differs, then it'd need to be specified. However, if you're seeing the uap10.0 dependencies group, then it's clearly working for you :)

Looking at the checkin comment, it looks like you need to update both _raw and _basic nuspecs? If that's the case, you could probably write/generate a target that's run after UpdateNuspecDependencies that calls RefGen again with another nuspec. Alternatively, I'd be happy to accept a PR that enables arg 2 to accept a semi-colon joined list of nuspecs and update all of them in one pass:
https://github.com/onovotny/ReferenceGenerator/blob/master/src/ReferenceGenerator/Program.cs#L37

Cool.  I'm not sure yet how I will deal with _basic.nuspec, but thanks for the tip.

OK.  Version 0.8.5-pre3 is in nuget and contains support for uap10.0.  Limited testing indicates that it works for a universal windows app in both desktop and mobile simulator.  Additional feedback and testing would be welcomed.  :-)

i'll test it right away !

Dumb question... can you/do you want to support .NET Core across platforms? The managed part would be essentially like the UWP version but you'd need to leverage the NuGet v3 runtimes bits to get the proper runtime/native pivoting across the various Unix flavors/archs (as well as compile SQLite for those)...of course a complex targets file might work too.

Yes, I do think I will want to add support for .NET Core across platforms, but not immediately.  So far I have only climbed just enough of the NuGet v3 learning curve to get UWP support working.

Gonna take much longer to test than I thought... nugget in uwp projects behaves differently, and since my app uses SQLite-net-pcl which is still binded to _rawbasic... it insists on restoring it and then I have a version conflict (0.7.1 and 0.8.4-pre3)...

ok, so I created a blog post with the description of my findings... http://www.modelon.net/2016/01/nuget-and-project-json/
basically I think I have three options :
1 - understand how to tell nuget for uwp to not restore dependencies of SQLite-net-pcl (which is SQLite-pcl.rawbasic)
2 - For this project, both packages (raw and rawbasic) keep on getting published so that the dependencies for SQLite-net-pcl keep on working
3 - SQLite-net-pcl is upgraded to have a dependency on "raw" and not "rawbasic"
I think option 3 is the one we are looking for ? will create an issue on the other site...

Hmmm.  I should probably continue keeping _basic up-to-date for now.  I should endeavor to get the consuming packages to switch to the new package ID before I stop updating the old one.  :-)

OK, I pushed 0.8.5-pre4 up to nuget.  In this one, the _basic form of the package was updated with the uap10.0 stuff as well.

Hi Eric, I just tried with the lastest raw_basic and it works perfectly in the emulator with a UWP app.
When I am a bit more advanced in development, will try to deploy on a real device (although this item is fixed, there are plenty bugs remaining in xamarin forms for uwp...)
Good job !

just verified, it also works great when deployed to a real device !

Yay.  After reviewing a bit further to make sure I didn't miss anything, I'll close this issue after my next push of a non-pre nuget package.

0.8.5, with uap10.0 support, has been pushed to nuget

Thanks Eric - fantastic

Thank-you Eric!

UWP + Akavache works, make sure you upgrade to latest SQLite from last nighjt and read this https://github.com/ghuntley/repros/tree/master/nuget/TransitiveRefs to work around a nuget resolution issue.

Eric great work!  Just wanted to be clear on the requirement for Microsoft C++ libraries and SQLitePCL.raw.  Can you please make clear here and in docs, 1: if SQLitePCL.raw 0.8.5 is compiled using the current Visual Studio 2015 and 2: are the C++ redist libraries statically linked or are we required to have to install the Microsoft 2013  - or hopefully the better 2015 32/64 bit libs on every machine that we intend to use SQLitePCL.raw on.  Sqlite.org does distribute the compiled form of sqlite.dll statically linked so all you need is the dll in your application running on Windows.
I know this applies mostly to Windows 8.X and 10 32/64bit machines but it is important to know to use SQLitePCL.raw correctly.  Also Win10 does not install or include most of the older redist libs and this must be done by the app dev to get things working.
I am sure others would like to know the answers to these two important questions so it might be good to add a line in the docs so people know when deploying using SQLitePCL.raw on Windows.

Yes, this belongs in "the docs", but for now, I'll answer here:
SQLitePCL.raw 0.8.5 contains several copies of the sqlite3 native code in
compiled form, each compiled with a different version of the Visual C++
platform toolset and linked against the corresponding C runtime libraries.
These include:
v110
v110_xp
v110_wp80
v120
v120_wp81
v140
thus supporting everything from Windows XP through Windows 10 and Windows
10 Mobile.
In general, this is setup so that you'll hopefully get what you want for a
given nuget platform without extra hassle.
For example, if you are building a UWP application, nuget should select
uap10.0, which will bring in the native code built with v140, which will be
linked against the Visual C++ 2015 C runtime libs.
As I've said before (read through this entire thread from the top), it is
my understanding that Microsoft no longer supports statically linking the C
runtime as of VS 2013 and 2015.  If I am wrong about this, I will be happy
to stand corrected and fix things.  Static linking against the C runtime
would be my preferred solution.
But on the assumption that I am correct, I believe you are incorrect when
you say "Sqlite.org does distribute the compiled form of sqlite.dll
statically linked so all you need is the dll in your application running on
Windows.".  Or rather, you may be correct for some versions of Windows, but
not all.  For example, maybe they are compiling with a v110 toolset, which
does support static linking against libcrt.  But this, as I understand it,
might work for any desktop version of Windows, but would never work for a
UWP app.
To be clear (and redundant):  I know you want me to statically link the C
runtime and have everything Just Work on every Windows platform without
needing to install a C runtime separately.  I want that too.  But it's
impossible.  If I'm wrong about that, show me.
Further detail:
For Windows 8.1, SQLitePCL.raw 0.8.5 injects an SDKReference for the Visual
C++ 2013 C runtime library, as long as the current build is not "Any CPU".
This helps prevent people from forgetting to add the VC++ extension SDK to
their build.
Currently, no such SDKReference is generated for the Visual C++ 2015
library, because testing indicates it to not be necessary.  I assume this
is because I haven't run across a Windows 10 platform (desktop or mobile)
which did not already have the necessary CRT DLL pre-installed.
Nothing I've written here specifically deals with issues of installation
and deployment.  I'm talking merely about what CRT I am linking against,
and I'm making hand-wavy remarks about whether that version of the CRT
might be expected to already be installed on certain versions of Windows.
Looking over what I have written here so far, I'm not sure this is the
"clear" answer you were hoping for.  :-)  But I think this is because
your question contains implicit assumptions that things are somewhat
simpler than they are.
Here's an attempt at a more concise answer:
If you reference the nuget package in such a manner that you get the
"win81" stuff, then you will get a version of the sqlite native bits that
are dynamically linked against the VC++ 2013 C runtime libraries, and if
those are not already on your target system, then you would need to install
them.
Same for "uap10.0" -- you'll need the VC++ 2015 C runtime libs.
Finally, let me say that I am currently working on some improvements in
this area, but I don't expect to find a magic bullet solution.
I hope this helps.  Feedback welcome.
--
E
On Mon, Jan 11, 2016 at 9:57 AM, ps30<EMAIL_ADDRESS>wrote:

Eric great work! Just wanted to be clear on the requirement for Microsoft
C++ libraries and SQLitePCL.raw. Can you please make clear here and in
docs, 1: if SQLitePCL.raw 0.8.5 is compiled using the current Visual Studio
2015 and 2: are the C++ redist libraries statically linked or are we
required to have to install the Microsoft 2013 - or hopefully the better
2015 32/64 bit libs on every machine that we intend to use SQLitePCL.raw
on. Sqlite.org does distribute the compiled form of sqlite.dll statically
linked so all you need is the dll in your application running on Windows.
I know this applies mostly to Windows 8.X and 10 32/64bit machines but it
is important to know to use SQLitePCL.raw correctly. Also Win10 does not
install or include most of the older redist libs and this must be done by
the app dev to get things working.
I am sure others would like to know the answers to these two important
questions so it might be good to add a line in the docs so people know when
deploying using SQLitePCL.raw on Windows.
—
Reply to this email directly or view it on GitHub
https://github.com/ericsink/SQLitePCL.raw/issues/44#issuecomment-170595599
.


printlns interfere with show during first time setup

Hi,
When calling ./mill show version for the very first time on a new machine mill will print on stdout:
Preparing Java <IP_ADDRESS> runtime; this may take a minute or two ...
"0.1.1"

Expected behavior
Stdout should only contain the result of the show command nothing besides that.
Actual behavior
Stdout contains information about preparing java together with results of the show command.
Reproduction steps
Use following docker file:
FROM ubuntu:22.04

# Install OpenJDK-8
RUN apt-get update && \
    apt-get install -y openjdk-17-jdk curl jq && \
    apt-get clean;

COPY . /src/
WORKDIR /src
RUN ./mill show version > output
RUN cat output

mill-version: 0.11.4
The offending line is here https://github.com/com-lihaoyi/mill/blob/7c2114e3895bac6f60e641e854906b2139e7ec84/runner/src/mill/runner/MillMain.scala#L193
Somehow related to #2680

Looks reasonable. Instead, we should use the logger in scope, as its using output streams that get properly redirected by show`.

@lefou any idea why it wasn't ultimately solved by #2689 ?

I wonder whether both lines come from STDOUT at all? mill show redirects all other output to STDERR, but if you don't pipe or redirect it, both output streams will still appear next to each other in the terminal.

The setting up of the Java runtime happens pretty early; it might possibly happen before we set up the stream redirection

@lefou any idea why it wasn't ultimately solved by #2689 ?

No, not really. The code location you linked is already inside a SystemStreams.withStreams block, so any configured redirections to System.{in,out,err} and Console.{in,out,err} should be in place. Some debugging might be necessary to better understand what's going on.


collect coverage with ts-jest gives exceeding retry limit

Describe the bug
this happens when i try to collect coverage from tsx files.
ui:test: PASS browser: chromium views/RegisterView/RegisterView.stories.tsx (7.776 s)
ui:test: PASS browser: chromium views/TemporaryRegisterView/TemporaryRegisterView/TemporaryRegisterView.stories.tsx (7.756 s)
ui:test: PASS browser: chromium views/RegisterMainView/RegisterMainView.stories.tsx
ui:test: Failed to collect coverage from /Users/***/workplace/***/packages/ui/atoms/Topbar/index.tsx
ui:test: ERROR: Jest worker encountered 3 child process exceptions, exceeding retry limit
ui:test: STACK: Error: Jest worker encountered 3 child process exceptions, exceeding retry limit
ui:test:     at ChildProcessWorker.initialize (/Users/***/workplace/***/packages/ui/node_modules/jest-worker/build/workers/ChildProcessWorker.js:185:21)
ui:test:     at ChildProcessWorker._onExit (/Users/***/workplace/***/packages/ui/node_modules/jest-worker/build/workers/ChildProcessWorker.js:269:12)
ui:test:     at ChildProcess.emit (node:events:520:28)
ui:test:     at Process.ChildProcess._handle.onexit (node:internal/child_process:291:12)

this is my config

working
error happens

error happens if I input collectCoverage: true, to test-runner-jest.config.js file
Environment

OS: OSX
Node.js version:16.14.0
NPM version: 8.3.1

Sorry. False alert.
this solved the problem
  transform: {
    '^.+\\.stories\\.[jt]sx?$': '@storybook/test-runner/playwright/transform',
    '^.+\\.[jt]sx?$': 'ts-jest',
    "\\.(jpg|ico|jpeg|png|gif|eot|otf|webp|svg|ttf|woff|woff2|mp4|webm|wav|mp3|m4a|aac|oga)$": "./mocks/fileMock.js",
    "\\.(css|less)$": "./mocks/fileMock.js"
    // '^.+\\.[jt]sx?$': 'babel-jest'
  },


https://epiforecasts.io/covid/ subnational pages down

E.g., https://epiforecasts.io/covid/posts/national/united-states/ gives a 404

Thanks for opening this @ashander and highlighting the issue.
This should now be resolved.
Sam


RFC: JSON-LD / Schema.org mapping

As part of my work on STAC Browser, I've just merged preliminary JSON-LD support intended to facilitate indexing, searching, and display by Google Dataset Search.
I've tried to follow their guidelines, mapping Catalogs and Collections to schema.org DataCatalogs and Items to Datasets.
Catalog / Collection → DataCatalog
{
  "@context": "https://schema.org/",
  "@type": "DataCatalog",

  // required
  name: catalog.title,
  description: catalog.description, // as HTML

  // recommended
  identifier: catalog.properties["sci:doi"] || catalog.id,
  citation: catalog.properties["sci:citation"], // if available
  keywords: catalog.keywords,
  isBasedOn: catalog.url, // canonical STAC catalog URL (JSON)
  version: catalog.version,
  url: <STAC Browser URL>,
  // if available
  workExample: this.properties["sci:publications"].map(p => ({
     identifier: p.doi,
     citation: p.citation
   })),

  // if license is "proprietary"
  license: catalog.links.find(x => x.rel === "license").href,
  // if license is SPDX-compatible
  license: `https://spdx.org/licenses/${catalog.license}.html`,

  // if a spatial extent is available
  spatialCoverage = {
    "@type": "Place",
    geo: {
      "@type": "GeoShape",
      box: catalog.extent.spatial.join(" ")
    }
  },

  // if a temporal extent is available
  temporalCoverage: catalog.extent.temporal.map(x => x || "..").join("/"),

  // if a parent catalog is defined:
  isPartOf: {
    "@type": "DataCatalog",
    name: parent.title || parent.id, // if available
    isBasedOn: parent.url,
    url: <STAC Browser URL>
  },

  // for each child catalog:
  hasPart: {
    "@type": "DataCatalog",
    name: child.title,
    isBasedOn: child.url,
    url: <STAC Browser URL>
  },

  // for each referenced item:
  dataset: {
    identifier: item.id, // if available; requires loading the Item
    name: item.properties.title || item.id, // if available; requires loading the Item
    isBasedOn: item.url,
    url: <STAC Browser URL>
  }
}

providers are mapped according to roles (when multiple roles are specified, the provider is duplicated):

licensor → copyrightHolder
producer → producer
processor → contributor
host → provider

and rendered as:
{
  // ...
  [mapped role]: {
    description: provider.description, // if available
    name: provider.name,
     url: provider.url // if available
  }
}

Item → Dataset
{
  "@context": "https://schema.org/",
  "@type": "Dataset",

  // required
  name: item.properties.title || item.id,
  description: this.properties.description, // if available

  // recommended
  identifier: item.properties["sci:doi"] || item.id,
  citation: catalog.properties["sci:citation"], // if available
  keywords: collection.keywords || rootCatalog.keywords, // inherit collection / root catalog keywords, if available
  // if license is "proprietary"
  license: [item.links, collection.links, rootCatalog.links].find(x => x.rel === "license").href,
  // if license is SPDX-compatible
  license: `https://spdx.org/licenses/${item.properties["item:license"] || collection.license || rootCatalog.license}.html`,
  isBasedOn: item.url, // canonical STAC item URL (JSON)
  url: <STAC Browser URL>,
  // if available
  workExample: this.properties["sci:publications"].map(p => ({
     identifier: p.doi,
     citation: p.citation
   })),
  image: item.assets.thumbnail,

  // for associated collections + parent catalogs
  includedInDataCatalog: {
    isBasedOn: c.href,
    url: <STAC Browser URL>
  },

  spatialCoverage: {
    "@type": "Place",
    geo: {
      "@type": "GeoShape",
      box: item.bbox.join(" ")
    }
  },

  temporalCoverage: this.properties["dtr:start_datetime"]
    ? [
        this.properties["dtr:start_datetime"],
        this.properties["dtr:end_datetime"]
      ]
        .map(x => x || "..")
        .join("/")
    : item.properties.datetime,

  // for each asset in item.assets
  distribution: {
    contentUrl: asset.href,
    fileFormat: asset.type,
    name: asset.title
  }
};

This implementation is live (with pre-rendered HTML) at https://planet.stac.cloud. Hopefully in the coming days it will be better indexed by Google (I've submitted the sitemap), including by Dataset Search, at which point we can see how well this mapping does at being rendered.
Meanwhile, the OpenLink Structured Data Sniffer extension for Chrome will extract JSON-LD to allow inspection.
Thoughts?
Refs #285

If we're interested in natively supporting json-ld in the STAC JSON output:
http://geojson.org/geojson-ld/

Is GeoJSON-LD compatible with what Google is asking for?

Good question.  Also, are they looking for JSON-LD only in HTML files?

Is GeoJSON-LD compatible with what Google is asking for?

I don't think so. The docs refer to https://schema.org/GeoShape. It'd be nice if they supported both though (and maybe they do).

Also, are they looking for JSON-LD only in HTML files?

Yes, in the body of <script type="application/ld+json"> tags. I don't think they crawl JSON at the moment.

Discussed on the call on April 22.
Status of this is that google doesn't actually use all the tags that it implies in their dataset search stuff. The consensus is just 'catalogs' should be exposed, as that's the level of 'search' they do there now.
It isn't clear exactly how to put this into the spec, as it is just one implementation for now.
Decision was made to keep this issue around, but to update the spec to talk at a more basic level about exposing one's data as HTML, etc. Likely in the catalog best practices document.

We always claim in presentations that "Portals > Google", so I feel this is quite an important point that we should add to the repo at some point and make it part of the releases. Maybe it could just start as an extension, maybe an NPM script, that just easily converts STAC repos or files to JSON-LD.

Apologies for cross-posting here from another related issue to keep track of this development too.
I have experience with ontologies and linked-data solutions, having worked with the ontology group at Stanford and the Stanford library on several linked-data projects.  However, there is a lot of work to be done on GIS ontologies and linked-data for catalog systems.  The technology that is most aligned with STAC is obviously JSON-LD, but defining the context for STAC needs some work.  I'm generally open to interests and discussions about EOS metadata standards (CF) and GIS metadata as ontologies and linked data.  Related projects:

http://geojson.org/geojson-ld/vocab.html
https://earthdata.nasa.gov/user-resources/standards-and-references/climate-and-forecast-cf-metadata-conventions
https://earthdata.nasa.gov/user-resources/standards-and-references
https://earthdata.nasa.gov/about/science-system-description/eosdis-components/common-metadata-repository/unified-metadata-model-umm

Also, with regard to linking data with publications:

https://www.loc.gov/bibframe/ (among other library LD systems)
https://www.oclc.org/en/worldcat/data-strategy.html
https://www.w3.org/2018/json-ld-wg/

https://ai.google/research/people/NatalyaNoy is the person to contact at Google for more insights and related research projects on dataset discovery.

Relevant search for any 'Geo' concepts in schema.org:

https://schema.org/docs/search_results.html?q=Geo

Note that GeoJSON-LD notes problems with JSON-LD 1.0 for representing coordinates which are defined using lists of lists, which is unsupported in JSON-LD 1.0. JSON-LD 1.1 does support lists of lists. But, JSON-LD 1.1 is not yet a recommendation, although the feature is widely implemented.

We should throw this in a best practice document for 1.0

I'll take this over and update the schema.org mapping as I'll want to make this available for each Collection on STAC Index.

scherma.org is implemented in STAC Browser, we can fruther discuss it there:

https://github.com/radiantearth/stac-browser
https://github.com/radiantearth/stac-browser/issues/78
https://github.com/radiantearth/stac-browser/issues/295

Thanks @m-mohr !
Just a note schema.org is consumed by many other tools than search engines, and it would be really desirable for these communities to have a simple utility that goes from stac JSON -> schema JSON without websites / HTML involved.  (e.g. see https://github.com/ESIPFed/science-on-schema.org).
happy to continue the discussion over on stac-browser if that's best, but don't want to be dragging in issues that are of little interest to the browser part of stac-browser....

Part of GeoDCAT work is defining JSON-LD in mappings from OGC API Records.  A logical extension would be be a GeoDCAT-STAC profile with context to map STAC elements to GeoDCAT.   We would seek to inform GeoDCAT design with the elements that are of general utility and cannot be mapped to DCAT already.


Testfiles at different locations

following a very specific file structure in my project, I'd like to add some test files from directories other than /tests/mocha/ .. is there a way to achieve this? adding a custom regex? maybe through an environment variable?

Sorry for the super late response. Currently there is not. Would you like to put them besides your application code or just somewhere else inside the test directory?


How can I make a huge land mass.

Hi there. I'm trying to generate a map that is mostly land and even when trying --ocean_level 0.01 or --ocean_level 50.0 i see no differences.
Thanks!

Hi @GAZ082,
the --ocean_level option seems to be broken. cf. #114 and #125
I'll try to look into it, once we are done merging my other changes.
Cheers
Alex

Cool. thanks.


Can we introduce some sliding effect while showing the images?

First of all I must say I love your app. I would love to add a feature, where while the images is getting displays if it pan or zoom a bit or slide left to right in slow motion it gives a life to it. I love the lock screen slide show which Windows 10 have. I have created a similar slide show for your reference with some of my clicked photographs. Please have a look at youtube https://youtu.be/CTTgkFb91l4
I tried incorporating the change by adding Vector2DFieldInterpolator in to the Animation tag. But I am unable to install it in developers mode in Roku. Getting error Install Failure: Error parsing multiple XML components. I am not very familiar with bright script, more of a Java guy, so thought of asking for help from the master. It will be awesome if you can add this feature. Thanks in advance.

@banerjeedeba  - Thanks for the recommendation. I'll add this as a feature request for consideration.


This is a very interesting job, is it possible to make the code public.

I'm curious and unsure about the specific implementation of the thesis part. For example: how to connect the POT library with pytorch without affecting backpropagation.

Hello @guangmingjian
I updated the readme to mention that we are currently working on a factorised implementation with a pipeline compatible with the user-defined GNN pre-processing architecture, which will be released in a few days. You can find an exemple with GIN pre-processing, as set by default in the paper, in the supplementary material shared during the reviewing process. Link: vanilla implementation. The code to reproduce experiments is there too, except those with GAT architectures.
We are also working on speeding up FGW solvers implemented in POT. This will allow a 20% to 50% gain in speed over graphs from 10 to 1000 nodes, compared to POT 0.8.2. These new solvers will be released soon in POT 0.8.3 . Basically, the FGW2 function of POT manually sets the gradients to allow back-propagation through the FGW loss.
Best regards :)


Update user-role-sync for MRPU

With the release of MRPU, the API endpoint to add users has changed. The toolkit utility task user-role-sync will need to be updated to reflect the updated API

Covered in PR 213.


Timeout waiting for response

İ Defined some events in state machine,
  During(WaitingForSaleRequest, When(GetOrderReceived).
                Respond(context => new GetOrderResult
                {
                    ReserveInfo = context.Instance.ReserveInfo,
                    MerchantCode = context.Instance.DealerCode
                }
                ));

            During(Completed, SaleSendingtoModel,SaleUpdateSendingtoModel, When(GetOrderReceived).
                Respond(context => new GetOrderResult
                {
                    ReserveInfo = "",
                    MerchantCode = ""
                }
                ));

When The Order Not Found in database, waiting four seconds and throwing exception "timeout waiting for response "
How can I return quickly "The Order not found" ?

You could add an initially and finalize it, but you need to be careful of timing.
    Initially(When(GetOrderReceived)
        .Respond(new OrderNotFound(...))
        .Finalize());

By going straight to finalize the order should not be stored in the database, but gives it a non-existence validation that can respond immediately.

Initially(When(GetOrderReceived).                  Respond(context => new GetOrderResult                  {                      ReserveInfo = "",                      MerchantCode = ""                  }                  ));.Finalize()
Thanks It Works. But it is executing two select.I want one query and respond.  Is there another way to do it?

  Event(() => GetOrderReceived,             x =>              {                 x.CorrelateById(context => context.Message.CorrelationId).SelectId(context => context.Message.CorrelationId);                 x.OnMissingInstance(m =>                  {                     return m.ExecuteAsync(context => context.RespondAsync(new GetOrderResult                     {                         ReserveInfo="",                         MerchantCode=""                     }));                 });               });
Solved. Thanks for Help


Automatically executing commands is too dangerous

I noticed in your readme that you had the idea of having the commands suggested by the AI be executed automatically. This seems too dangerous, and probably is not an ethical software to be putting out there. I can see how it sounds cool at first, but in reality this will probably hurt people by accident. Certain commands if they are given the wrong arguments may delete files or do other kinds of permanent damage. I cannot imagine a scenario where this could be used safely, given the unlimited power of shell commands.

I imagine the suggested command would be shown to the user first and they'd choose whether to execute it.

We can avoid the copy-paste step too and simply ask the user to press Y or N to execute or reject the suggested command.


Design the carousel in landing page

Work on creating an engaging, informative carousel for users
In the carousel, provide information such as the features, benefits, visualization, etc.

Working under branch #79
(I forgot to switch branches after acceptance testing and continued to work under #79. There's no conflicts.)


Provide sample documentation

Provide a sample api that was rendered using this package.
Maybe try to use it for the own documentation.

Used for own documentation.


Output Node.js No images created

I get the following, i know it is simple fix as everything is running. Just s hint of guidance would be appreciated.
creating NFT 9 of 10

rarity: rare
dna: 02-05-01-01-01-01
metadata: {"dna":"020501010101","name":"#9","description":"This is an NFT made by the coolest generative code.","image":"https://hashlips/nft/9","edition":9,"date":1631073164541,"attributes":[{"name":"green eye ball rare"},{"name":"purple small rare"},{"name":"medium rare"},{"name":"shapes rare"},{"name":"tilted bottom rare"},{"name":"low top rare"}]}
edition 9 created.

That does not appear to be an error

Okay perfect, this is good. I'm assuming to achieve created images is a completely separate. I was under impression the terminal would show images.

No they appear in the output folder

You my friend, have helped. Do you mind if I ask a few more questions here?
I am in config.js
If i edit the NFTs to lets say 100, what do i have to edit to ensure this goes through?

Probably the rarity weight values to go up to 100 and ensure there is enough possible combinations of layers to produce that

right, okay i have enough confidence now to fiddle around with this. I just didnt know how to get original to run and you helped thank you.

If you are going to fiddle i just duplicate the whole folder and go ham knowing i have a working one to refer to


Some renames

I think we should remove or reduce the methods with leading underscore; especially in the case when they are exported from the module.

Each individual commit does a different rename.

Codecov Report

Merging #390 (50f2bfb) into main (7904999) will decrease coverage by 0.05%.
The diff coverage is 95.83%.

:exclamation: Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the Github App Integration for your organization. Read more.
@@            Coverage Diff             @@
##             main     #390      +/-   ##
==========================================
- Coverage   86.92%   86.88%   -0.05%
==========================================
  Files          43       43
  Lines        1568     1563       -5
==========================================
- Hits         1363     1358       -5
  Misses        205      205

Impacted Files
Coverage Δ

src/StructuralSolvers/StructuralSolvers.jl
72.85% <66.66%> (-0.76%)
:arrow_down:

src/StructuralAnalyses/LinearStaticAnalyses.jl
84.84% <100.00%> (ø)

src/StructuralAnalyses/NonLinearStaticAnalyses.jl
86.84% <100.00%> (ø)

src/StructuralAnalyses/StaticAnalyses.jl
100.00% <100.00%> (ø)

src/StructuralAnalyses/StructuralAnalyses.jl
77.77% <100.00%> (ø)

src/StructuralSolvers/Assemblers.jl
100.00% <100.00%> (ø)

... and 2 files with indirect coverage changes
:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more

I think it's fair enough to think of each constituent module of ONSAS "first class" in the sense that whatever is exported should also be re-exporter in ONSAS proper.

I think it's fair enough to think of each constituent module of ONSAS "first class" in the sense that whatever is exported should also be re-exported in ONSAS proper.

Agree, will add this into an issue


[css mode] Support CSS4 #rrggbbaa and #rgba colors

Issue #3625

I guess this is minor enough to include even before widespread browser support shows up. Merged as 292a12a


Change shortcut to open/hide the app

Hello there, any plan on this ? :-)
Ctrl+Shift+D conflicts with one of my editor shortcut.

ah yeah, we just need to find a proper way to display those settings.

Looks perfect to me and would allow me to replace Zeal by devdocs :-)


Support configuration of typing vs typing_extensions

Describe your idea
I would like to enforce the library to use typing_extensions, regardless of my interpreter version.
The top level if clause in the stub files could maybe support some type of configuration, like an environment variable?
Code sample
if sys.version_info >= (3, 9) or not os.environ.get("BOTO_STUBS_USE_TYPING_EXTENSIONS"):
    from typing import TypedDict
else:
    from typing_extensions import TypedDict

Additional context
pydantic v2 requires TypedDict to be typing_extensions.TypedDict unless python is version 3.12 or higher. I cannot upgrade to this version of python, but I do want pydantics TypedDict support for parsing your generated TypedDicts.

Hello,
Thank you for the feature request. It makes sense. However, env variables are not supported in *.pyi files, so it will not work. The solution could be to use typing_extensions if available, and fallback to typing. Another solution would be always to use typing_extensions and make it a mandatory dependency.
I will check pydantic docs.

I was under the impression that there are both type_defs.py and type_defs.pyi? I think only the former matters for pydantic, as it is performing inspections at runtime.

https://docs.pydantic.dev/2.3/errors/usage_errors/#typed-dict-version is the cause for my request.

I just released mypy_boto3_builder 7.18.0 with new import logic. I am going to generate all packages later today.

@tobni I released all boto3-stubs packages built with the new builder version. Please test and let me know if it works as it should.


e2e: serial: fix rebase glitch

this was caused by a forced rushed merge.

/retest

/approve
/lgtm
Great! I already hit that


Finetune transaction-stuff

(re-)add new design 'confirm-sending'
finetune page 'transaction-processing'
add animation 'my wallet' > 'confirm-sending'
add animation 'confirm-sending' > 'transaction-processing'

@faffydee @kikipluche why is this an open issue but the epic is already closed?

@BvL13 @kikipluche With this issue, only the first bulletpoint is already done. I'm not sure under which epic this should be, they are mainly aesthethic things (the animation and the fintetuning).

Thank you @faffydee
We now have to decide if it is a critical issue or just nice to have. If critical we will move it to the sprint and if nice to have it can be picked up later, if we have less to do.


Debug Enable some vlog to troubleshooting

Proposed changes
Issue Number: close #xxx

Further comments
If this is a relatively large or complex change, kick off the discussion at<EMAIL_ADDRESS>by explaining why you chose the solution you did and what alternatives you considered, etc...

run buildall

run buildall


Use default readthedocs theme

Its better integrated with the site, its mobile friendly, etc.

There is a slight issue with badge size in mobile view, but their own page has same problem: http://read-the-docs.readthedocs.org/en/latest/badges.html. I tried hardcoding image height  in pixels, it did not help.

https://github.com/snide/sphinx_rtd_theme/issues/144


Missing unit GameNetworkingSockets in the repository

Hi there,
In Steam.pas you include the GameNetworkingSockets unit, but it's not in the repository.
Where can we find it please?
Cheers,
Gus

Hi there,
Nevermind, I found it deep inside your soldat's game source:
https://github.com/Soldat/soldat/blob/develop/shared/libs/GameNetworkingSockets/GameNetworkingSockets.pas
Cheers,
Gus


Refactor#3622

What do these changes do?
Working on Issue #3622
Move Tests for modin.pandas into directory modin/test/pandas and changing all references either in

imports
conftest.py
file readers
documentation
Github Actions

not resolving issue completely, as  same needs to be done for other tests (I will do, after this PR is accepted, or shall I work on the whole issue before openin PR?).
Not all tests where succesfull, but the same failed in master (so in upstream without modifications).

[ ] commit message follows format outlined here
[x] passes flake8 modin/ asv_bench/benchmarks scripts/doc_checker.py
[x] passes black --check modin/ asv_bench/benchmarks scripts/doc_checker.py
[x] signed commit with git commit -s
[ ] Resolves #?
[ ] tests added and passing
[ ] module layout described at docs/developer/architecture.rst is up-to-date

need to add colon (:) to commit messages, to follow guidelines..


#Mongo_tasks. Ivan Menshov

https://travis-ci.com/github/IvanMenshov/db-assignments

The PR is accepted! Thanks for the efforts


[bug]remove policy sub category from mobile newscout app.

steps to reproduce:
1.open an app
2.go to economics category
3.first subcategory is a policy that is not present in web application.
This subcategory is also not included in API.

@Shivani-Padhye You have to remove app from background and reopen it. It will show latest menu.


Eye tracking at all times.

Describe the feature
Can the eye tracking panel be set up to be fixed to the head so that you can always see where your eyes are even if you turn your head?
An example use-case
For training purposes if you want to show someone where you are looking.

Is this a request to change the behavior of DemoEyes.cs? Or is this something else?

it will be for That demo yes I'm using that as the base and just need a way to have the eye tracking follow my head so I can always see where my eyes are

Try using something like this to position an object in front of the user each frame:
Vec3 pos = Input.Head.position + Input.Head.Forward * 0.5f;
Quat rot = Quat.LookAt(pos, Input.Head.position);
Mesh.Quad.Draw(Material.Default, Matrix.TR(pos, rot));

should I add it to the Plane code?
Matrix quadPose = Matrix.S(0.4f) * Demo.contentPose; 		Plane  plane    = new Plane(quadPose * Vec3.Zero, quadPose.TransformNormal(Vec3.Forward));