Global Reader Limitation - MEM Portal - WIP Settings

https://docs.microsoft.com/en-us/azure/active-directory/roles/permissions-reference#global-reader
Global reader has a limitation in the Microsoft Endpoint Manager admin center portal when viewing the app protection policies for Windows.  Role does not allow view of the targeted apps or the advanced settings.
The API calls when viewing the properties for the WIP policy are the same and listed below:
https://graph.microsoft.com/beta/deviceAppManagement/mdmWindowsInformationProtectionPolicies('[PolicyID]')?$expand=protectedAppLockerFiles,exemptAppLockerFiles,assignments
The bearer token scopes are the same with both calls with the scopes listed below:
CloudPC.Read.All CloudPC.ReadWrite.All DeviceManagementApps.ReadWrite.All DeviceManagementConfiguration.ReadWrite.All DeviceManagementManagedDevices.PrivilegedOperations.All DeviceManagementManagedDevices.ReadWrite.All DeviceManagementRBAC.ReadWrite.All DeviceManagementServiceConfiguration.ReadWrite.All Directory.AccessAsUser.All email openid profile Sites.Read.All

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 0767aac4-fcd9-eaac-2c30-8f17d8eadd92
Version Independent ID: a380a828-03f9-e037-3a62-e4165fda7cb6
Content: Azure AD built-in roles - Azure Active Directory
Content Source: articles/active-directory/roles/permissions-reference.md
Service: active-directory
Sub-service: roles
GitHub Login: @rolyon
Microsoft Alias: rolyon

@the-cory-smith
Thanks for your feedback! We will investigate and update as appropriate.

Thank you! I made a pull request to add this limitation.
https://github.com/MicrosoftDocs/azure-docs-pr/pull/186359
@rolyon

Hi Marilee,
Just checking to see if there's been movement on this.  When opening the link I get a 404 error for the pull request.
Very Respectfully,
Cory Smith
Sr. Customer Engineer
Office:<PHONE_NUMBER>
<EMAIL_ADDRESS>[Microsoft]
From: Marilee Turscak - MSFT @.>
Sent: Wednesday, January 26, 2022 5:01 PM
To: MicrosoftDocs/azure-docs @.>
Cc: Cory Smith @.>; Mention @.>
Subject: Re: [MicrosoftDocs/azure-docs] Global Reader Limitation - MEM Portal - WIP Settings (Issue #87019)
Thank you! I made a pull request to add this limitation.
MicrosoftDocs/azure-docs-pr#186359https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FMicrosoftDocs%2Fazure-docs-pr%2Fpull%2F186359&data=04|01|cory.smith%40microsoft.com|053d696d7195439c4ff008d9e11754cf|72f988bf86f141af91ab2d7cd011db47|1|0|637788312597857331|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000&sdata=uLcmM704hBVo1gkOPUIyuoUZVZtLdmA5wsm7arBTWaM%3D&reserved=0
@rolyonhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Frolyon&data=04|01|cory.smith%40microsoft.com|053d696d7195439c4ff008d9e11754cf|72f988bf86f141af91ab2d7cd011db47|1|0|637788312597857331|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000&sdata=UvHgw%2BAH%2FSlzvy6S8uzORxZvs8jTy0jwMNUAN5Artk8%3D&reserved=0

Reply to this email directly, view it on GitHubhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FMicrosoftDocs%2Fazure-docs%2Fissues%2F87019%23issuecomment-1022642066&data=04|01|cory.smith%40microsoft.com|053d696d7195439c4ff008d9e11754cf|72f988bf86f141af91ab2d7cd011db47|1|0|637788312597857331|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000&sdata=6eza6IC2NPBm5KTeLFCdMoMoVpQWe6RePHANwxNxCo4%3D&reserved=0, or unsubscribehttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAWR7SOJQZILF6U64XQYD5BLUYBVJTANCNFSM5M4DB3SQ&data=04|01|cory.smith%40microsoft.com|053d696d7195439c4ff008d9e11754cf|72f988bf86f141af91ab2d7cd011db47|1|0|637788312597857331|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000&sdata=iGulS%2BjKw2urrImlcrCJoapsXYZo0YqQ%2BwLfP6nYueo%3D&reserved=0.
Triage notifications on the go with GitHub Mobile for iOShttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fapps.apple.com%2Fapp%2Fapple-store%2Fid1477376905%3Fct%3Dnotification-email%26mt%3D8%26pt%3D524675&data=04|01|cory.smith%40microsoft.com|053d696d7195439c4ff008d9e11754cf|72f988bf86f141af91ab2d7cd011db47|1|0|637788312597857331|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000&sdata=qdAZdrBzqDT1pgOhJIQmApwKdXN%2BfCZhNqiRf4BQP0s%3D&reserved=0 or Androidhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fplay.google.com%2Fstore%2Fapps%2Fdetails%3Fid%3Dcom.github.android%26referrer%3Dutm_campaign%253Dnotification-email%2526utm_medium%253Demail%2526utm_source%253Dgithub&data=04|01|cory.smith%40microsoft.com|053d696d7195439c4ff008d9e11754cf|72f988bf86f141af91ab2d7cd011db47|1|0|637788312597857331|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|3000&sdata=CTCyZ68nz7x8SKHVRzxj3WCYF5P6u9QstwWEwICF8%2FE%3D&reserved=0.
You are receiving this because you were mentioned.Message ID<EMAIL_ADDRESS>


Digitalocean provider creates challenge but stuck in pending state and cert never issued

Hello all, I have running into a lot of trouble this afternoon trying to create a tls certificate with the digital ocean provider:
Describe the bug:
The certificate is never issued with digitalocean dns01 provider:
I can see the challenge order resource is created and the request can be seen on letsencrypt.org api (url obtained from "kubectl describe order Ordername"), but is stuck on pending.
No TXT changes are made in on the domain on digital ocean.
Expected behaviour:
That the certificate issuing would either succeed or fail with an error message.
n.b: At first I thought it might be a namespace situation, so i played around with different scenarios and it turns out there are no error messages for when a digitalocean issuer is created without having the secret configured.
Steps to reproduce the bug:
apiVersion: certmanager.k8s.io/v1alpha1
kind: ClusterIssuer
metadata:
  name: letsencrypt-prod
spec:
  acme:
    server: https://acme-v02.api.letsencrypt.org/directory
    email<EMAIL_ADDRESS>    privateKeySecretRef:
      name: letsencrypt-prod
    dns01:
      providers:
        - name: digitalocean
          digitalocean:
            tokenSecretRef:
              name: do-token
              key: access-token
---
apiVersion: v1
kind: Secret
metadata:
  name: do-token
data:
  access-token: ****************

apiVersion: certmanager.k8s.io/v1alpha1
kind: Certificate
metadata:
  name: cert-prod
  namespace: default
spec:
  secretName: ambassador-certs
  issuerRef:
    name: letsencrypt-prod
    kind: ClusterIssuer
  commonName: ***.me
  dnsNames:
  - ***.me
  acme:
    config:
    - dns01:
        provider: digitalocean
      domains:
      - ***.me

Then running "kubectl describe orders cert-prod-3916739060" shows the resource created but nothing happens after that:

Events:
  Type    Reason   Age   From          Message
  ----    ------   ----  ----          -------
  Normal  Created  20m   cert-manager  Created Challenge resource "cert-prod-3916739060-0" for domain "****.me"

Anything else we need to know?:
Environment details::

Kubernetes version : v1.12.1
Cloud-provider/provisioner: self hosted on digital ocean
cert-manager version (e.g. v0.4.0): Master
Install method (e.g. helm or static manifests): static manifest with-rbac.yaml

/kind bug

cc @aslafy-z

I cleaned everything and reinstalled and managed to get it working so now I am unsure what went wrong...

I managed to get it working I'm not sure how, but there was indeed something wrong with my secret. Thank you for your assistance, note however that some validation and error messages should be implemented #feature-request

echo "" | base64 adds a newline
Use instead:
echo -n "" | base64


fix for recycled colors

length of color vectors (col1, col2) were truncated due to unique resulting in recycled colors

fix was already addressed on master, closing


Feature: Enter (newline) in stdin

Before proceeding, please make sure to follow these steps:

[x] I have checked for similar feature requests in the project's issue tracker
to avoid duplicates.
[x] I have searched existing issues to see if this feature has been discussed
before.

Feature Details
Can you make the stdin input accept enter, I think it's newline on mobile but I'm not sure
Is your feature request related to a problem? Please describe
I came across this program, but I have issues running it since it needs enter character.

Thanks for the suggestion! Definitely agree this needs adding. I'll aim to get it added this week and in the next release

Apologies for the delayon this one! It's next on my todo after my current task so I'm hoping to get it done this weekend all being well

Fixed in https://github.com/FredHappyface/Android.Brainf/releases/tag/20240330
Should be on google play and fdroid soon :)


Add badge to point to github issues -- Resolves dynod/nmk#137

Codecov Report
Base: 100.00% // Head: 100.00% // No change to project coverage :thumbsup:

Coverage data is based on head (1895e0e) compared to base (0127347).
Patch coverage: 100.00% of modified lines in pull request are covered.

Additional details and impacted files
@@            Coverage Diff            @@
##              main       #13   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files            2         3    +1
  Lines           30        56   +26
  Branches         2         4    +2
=========================================
+ Hits            30        56   +26

Impacted Files
Coverage Δ

src/nmk_github/info.py
100.00% <100.00%> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


pandoc: remove GHC & haskell deps from closure, 5.2G => 250M

Description of changes
The Haskell dependencies were leaking through a haskellPackages.pandoc stray references:
$ strings ./result/bin/pandoc | grep /nix/store
(...)
/nix/store/xk2acjd6587wyskg85xg54lj89mrvrv0-pandoc-3.1.8/etc /nix/store/xk2acjd6587wyskg85xg54lj89mrvrv0-pandoc-3.1.8/libexec/x86_64-linux-ghc-9.4.7/pandoc-3.1.8 /nix/store/l9mzh2nlq5qs50yfvb3ymphfpas0j7pd-pandoc-3.1.8-data/share/ghc-9.4.7/x86_64-linux-ghc-9.4.7/pandoc-3.1.8 /nix/store/xk2acjd6587wyskg85xg54lj89mrvrv0-pandoc-3.1.8/lib/ghc-9.4.7/x86_64-linux-ghc-9.4.7 /nix/store/xk2acjd6587wyskg85xg54lj89mrvrv0-pandoc-3.1.8/lib/ghc-9.4.7/x86_64-linux-ghc-9.4.7/pandoc-3.1.8-DUwbvTsa4nj3Hikhs5AQGF /nix/store/xk2acjd6587wyskg85xg54lj89mrvrv0-pandoc-3.1.8/bin
Removing these references using "remove-reference-to".
Before:
$ nix path-info --closure-size -h $(nix-build -A pandoc)
/nix/store/np2f5g1x25fgkp6q10n5p14352899km7-pandoc-cli-<IP_ADDRESS>     5.2G
After:
$ nix path-info --closure-size -h $(nix-build -A pandoc)
/nix/store/fpl2h3qs6vm0vb5cibb7cswzm90hc4yx-pandoc-cli-<IP_ADDRESS>   250.5M
Fixes https://github.com/NixOS/nixpkgs/issues/264399
Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Tested basic functionality of all binary files (usually in ./result/bin/)
23.11 Release Notes (or backporting 23.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

@maralorn : We'll have to be super careful when updating the pandoc pinned in the pandoc-cli-overlay https://github.com/NixOS/nixpkgs/blob/329b5329e262f487237f9f4ebd028dc634caa703/pkgs/development/haskell-modules/configuration-common.nix#L1850 and update this reference removal as well.
It'd be better to programatically retrieve the overlay reference from the pandoc-cli derivation, but I did not find a way to do it. Maybe I'm missing something obvious, in which case, feel free to push on that branch.

This pull request has been mentioned on NixOS Discourse. There might be relevant details there:
https://discourse.nixos.org/t/how-to-convert-md-to-pdf-most-efficently/34808/5

Thank you. Very helpful!
Can you direct the change to the haskell-updates branch?


web demo agree button does nothing.

It does eventually, but it's very slow. Popularity has its downsides!

@Tiiiger have you guys deployed the quantised version of the model on the web demo? if it hasn't been, quantising the model might help with speeding up the inference process.

Hi folks, we have improved our system's throughput. The site is back up and running much faster than before. Thanks for the patience!


New map: Warsaw

Map of the city centre of Warsaw, Poland
Based on https://dabreegster.github.io/abstreet/howto/new_city.html
Geojson of the area was created using https://geoman.io/geojson-editor: starting from circle centered in the city centre and then by drawing polygon on it.
In "trips between home and work" scenario traffic jams seem to be in north-west corner of the map.

Geojson generated
{
    "type": "FeatureCollection",
    "features": [{
        "type": "Feature",
        "properties": {
            "shape": "Polygon",
            "name": "Warsaw",
            "category": "default"
        },
        "geometry": {
            "type": "Polygon",
            "coordinates": [
                [
                    [20.967, 52.257604],
                    [20.948298, 52.228544],
                    [20.959368, 52.207674],
                    [21.034009, 52.192783],
                    [21.075877, 52.22485],
                    [21.057654, 52.257604],
                    [20.967, 52.257604]
                ]
            ]
        },
        "id": "b4926547-a231-4328-ac22-df4c0b03ee1c"
    }]
}

Screenshot to showcase area chosen

Thanks for the PR! The import looks pretty good -- handling separately mapped sidewalks properly is a still a work in progress, but it looks reasonable here. The pedestrian plaza around Old Town also came out reasonably.

In "trips between home and work" scenario traffic jams seem to be in north-west corner of the map.

In debug mode, there's a tool to figure out why gridlock is forming. Looks like some kind of loop forms here because somebody attempts a U-turn around https://www.openstreetmap.org/node/4875534953. It'll likely take lots of work to get traffic flowing smoothly. Also, the scenario makes up guesses about the population size that could be very unrealistic.

Thanks for the PR! The import looks pretty good -- handling separately mapped sidewalks properly is a still a work in progress, but it looks reasonable here. The pedestrian plaza around Old Town also came out reasonably.

In "trips between home and work" scenario traffic jams seem to be in north-west corner of the map.

In debug mode, there's a tool to figure out why gridlock is forming. Looks like some kind of loop forms here because somebody attempts a U-turn around https://www.openstreetmap.org/node/4875534953. It'll likely take lots of work to get traffic flowing smoothly. Also, the scenario makes up guesses about the population size that could be very unrealistic.


chore: Add browser resolution to scan summary

Details
This pull request proposes two changes:

Replace hardcoded browserResolution with the value from scanMetadata.
Add the browser resolution to the scan summary.

Links to canary build: (in progress)
Motivation
Last year, the scan package experienced a regression where it was scanning at 800x600. Our tests did not catch this regression as the browser resolution value was hardcoded and the codebase didn't have a snapshot test to captures thevalue. Adding the browser resolution to the scan summary will allow us to track this value while also providing users with extra metadata about their scan.
Context

Pull request checklist

[n/a] Addresses an existing issue: Fixes #0000
[x] Added relevant unit test for your changes. (yarn test)
[x] Verified code coverage for the changes made. Check coverage report at: <rootDir>/test-results/unit/coverage
[x] Ran precheckin (yarn precheckin)

Codecov Report

Merging #1535 (dbc0c96) into main (0ad9d72) will not change coverage.
The diff coverage is 100.00%.

@@           Coverage Diff           @@
##             main    #1535   +/-   ##
=======================================
  Coverage   94.44%   94.44%
=======================================
  Files          38       38
  Lines        1044     1044
  Branches      135      135
=======================================
  Hits          986      986
  Misses         58       58

Impacted Files
Coverage Δ

packages/shared/src/scanner/scanner.ts
100.00% <ø> (ø)

...d/src/console-output/result-console-log-builder.ts
100.00% <100.00%> (ø)

...es/shared/src/mark-down/result-markdown-builder.ts
100.00% <100.00%> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


create-release:  Error: unknown release chart status subchart

Snippet from the workflow:
jobs:
  push-to-replicated:
    runs-on: ubuntu-22.04
    outputs:
      channel-slug: ${{ steps.create-release.outputs.channel-slug}}
    steps:
      - uses: actions/checkout@v3

      - name: Define App Version
        run: echo "APP_VERSION=0.0.1-${GITHUB_REF_NAME//[^a-zA-Z0-9]/}.${GITHUB_RUN_ID}${GITHUB_RUN_ATTEMPT}" >> $GITHUB_ENV

      - name: Define Channel Name
        run: echo "CHANNEL_NAME=${{ github.ref_name }}-${GITHUB_RUN_ID}${GITHUB_RUN_ATTEMPT}" >> $GITHUB_ENV

      - name: Package helm chart
        run: |
          docker run --rm \
            -v ${{ github.workspace }}/turbine-kots:/app \
            -v ${{ github.workspace }}/turbine:/chart \
            alpine/helm:3.9.4 \
            package -d /app/config /chart --dependency-update

      - name: Create Replicated Release
        id: create-release
        uses: replicatedhq/replicated-actions/create-release@v1
        with:
          app-slug: ${{ env.REPLICATED_APP }}
          api-token: ${{ env.REPLICATED_API_TOKEN }}
          yaml-dir: ./turbine-kots/config
          promote-channel: ${{ env.CHANNEL_NAME }}

Failed action:

This is fixed in v1.5.1


A type parameter does not appear as a completion item for an unfinished signature

The completion list should include T at the end of the line in the following case:
function f<T>(x: T

Note that this works if you add a closing paren to finish the parameter list.

Dupe of #1410


Gdp-update

Modification of the GDP adapters function to reflect the hourly database update.
To merge once the DAC update completely the 2.01/ FTP folder.
Should the global variable be moved from gdp.py to gdp1h.py since it applies only to that product?

Not sure why this PR contains old commits?

Should the global variable be moved from gdp.py to gdp1h.py since it applies only to that product?

Yes. So the 6-hourly GDP is a completely different version track, i.e. we don't expect the 6-hourly GDP to follow the hourly one in terms of dataset updates/versions?
The 2.01 upstream data URL seems to contain NetCDF files. Is that still a generation in progress or we can actually test and (if no problems) merge?

Should the global variable be moved from gdp.py to gdp1h.py since it applies only to that product?

Yes. So the 6-hourly GDP is a completely different version track, i.e. we don't expect the 6-hourly GDP to follow the hourly one in terms of dataset updates/versions?

Correct, 6-hourly is on a different version track.

The 2.01 upstream data URL seems to contain NetCDF files. Is that still a generation in progress or we can actually test and (if no problems) merge?

I sent email to @RickLumpkin with @milancurcic copied. He is working on organizing the 2.01/ folder just like the 2.00/ folder so hold on.

Do you think it's worth it to test processing it just in case? (I won't be able to do it before Monday) Otherwise, looks good to me!

We should also soon discuss how do we want to treat different dataset versions from the clouddrift.datasets point of view.

Do you think it's worth it to test processing it just in case? (I won't be able to do it before Monday) Otherwise, looks good to me!

Yes, we need to test.

We should also soon discuss how do we want to treat different dataset versions from the clouddrift.datasets point of view.

My proposition is to supply the latest by default but optionally supply previous ones.

For clouddrift.datasets.gdp1h() should an option be to open the dataset from the zarr or nc file?

netcdf dependencies can be problematic from my experience so this favors zarr
the zarr file has shown issues for low bandwidth so this favors netcdf

Thoughts?

nc access was not yet supported by the NetCDF-C version that shipped with netCDF4 on PyPI, so Zarr was the only option when I introduced the datasets module.

Do you understand why it fails?
@RickLumpkin is now populating the experimental folder with the files for the 2.02 update. So moving forward the final files for each update/version will be in 2.xx/ and the files for the on-going update will be in experimental/
The idea is that the clouddrift library will update its code to reflect the data updates.

It's failing because of the filename_pattern (I think) that's in download() and to_raggedarray().
    if url == GDP_DATA_URL:
        pattern = "drifter_hourly_[0-9]*.nc"
        filename_pattern = "drifter_{id}.nc"
    elif url == GDP_DATA_URL_EXPERIMENTAL:
        pattern = "drifter_hourly_[0-9]*.nc"
        filename_pattern = "drifter_hourly_{id}.nc"

I don't have time to check now, but I guess it's just a matter of "drifter_{id}.nc" to "drifter_hourly_{id}.nc". And actually, maybe we don't need that condition anymore since both situations the pattern will be the same.

It's failing because of the filename_pattern (I think) that's in download() and to_raggedarray().
    if url == GDP_DATA_URL:
        pattern = "drifter_hourly_[0-9]*.nc"
        filename_pattern = "drifter_{id}.nc"
    elif url == GDP_DATA_URL_EXPERIMENTAL:
        pattern = "drifter_hourly_[0-9]*.nc"
        filename_pattern = "drifter_hourly_{id}.nc"

I don't have time to check now, but I guess it's just a matter of "drifter_{id}.nc" to "drifter_hourly_{id}.nc". And actually, maybe we don't need that condition anymore since for both v2.01 and v2.02 the pattern is the same.

Yes, my last commit fixes that. But down the line there are more issues which I do not understand. I have no time either to pursue this today and will look next when i can.

I fix the fix. You missed two more patterns.

PS: there might be a more elegant way of doing this, but this should do it.

I have now tested the generation of ragged arrays for the entire content of the standard folder (2.01/) and the experimental folder for this PR. I have also tested the creation of ragged arrays for only 100 random ids in both cases and it seems that the creation of two different download folders for these cases is the way to go.
The one thing I have noticed is that the coordinate time is not as before a datetime object but a float variables which is the number of seconds since 1970-01-01. Is this intentional? Not sure what I prefer.

Humm. It might not be converted at the time of the ragged array creation. Although if you save it to netCDF and reload it, does it work?

So I think there is no bug.
import clouddrift as cd
import xarray as xr
ds = cd.adapters.gdp1h.to_raggedarray(n_random_id=10).to_xarray()

if you do this, the values are returned in floats. But if you just do:
ds.to_netcdf("test.nc")
ds2 = xr.open_dataset("test.nc")

You can use this,
ds = xr.decode_cf(ds, decode_times=True)

to convert the time variable after we create the ragged arrays. We could add this to our .to_xarray() method.

As @philippemiron hinted, the difference between float and datetime64 times for GDP has to do with data representation after the dataset is loaded. In both scenarios the data in file is stored as float seconds.
So the question is really what should be the default (decode or don't decod) for RaggedArray.to_xarray() and for datasets.gdp*h() (It's decoded there by default).
I personally like simple float seconds because they're simple, but I know many people who like np.datetime64[ns].
Ideally, we should be consistent between adapters and datasets modules.
An important gotcha in context of clouddrift is that if you pass time in float seconds to velocity_from_position, you get velocities in m/s. If you pass time as np.datetime64[ns] you get velocities in m/ns. There won't be a warning because both are valid and expected. But the user may be surprised about the result (I was).

As @philippemiron hinted, the difference between float and datetime64 times for GDP has to do with data representation after the dataset is loaded. In both scenarios the data in file is stored as float seconds.
So the question is really what should be the default (decode or don't decod) for RaggedArray.to_xarray() and for datasets.gdp*h() (It's decoded there by default).
I personally like simple float seconds because they're simple, but I know many people who like np.datetime64[ns].
Ideally, we should be consistent between adapters and datasets modules.

Ok I confirm that I can reload also the ragged array I created with or without decoding the times!
I am not a fan of the datetime objects so my suggestion is to keep seconds as floats when creating the ragged arrays, if I understand correctly. And make it consistent across the data adapters and the data accessors if possible.

An important gotcha in context of clouddrift is that if you pass time in float seconds to velocity_from_position, you get velocities in m/s. If you pass time as np.datetime64[ns] you get velocities in m/ns. There won't be a warning because both are valid and expected. But the user may be surprised about the result (I was).

I am fine with this. I think it is reasonable to expect the user to 1) read the doc and 2) know what they input as argument.

If you don't like the datetime object, you can always just do: xr.open_dataset("file.nc", decode_times=False) to get them in the original float values.

What's holding this?


Fix win32 with 2.068

Fix for same problem as #1098 but on win32 driver.
And additionally resolve method name conflict with 2.068

Thanks!


add toString() in Document's ctor to prevent unreadable error message

if I read some text from file by fs, sometime I will forget to pass 'utf-8' as arguments and get a Buffer.
And if I use this content to create a vectorStore, I will get a unreadable error message
const content = readFileSync(join(__dirname, 'input.txt'))  // should be readFileSync(join(__dirname, 'input.txt'), 'utf-8')
Chroma.fromTexts(
        [content],
        [{}],
        embeddingModel,
        {
            collectionName: "abc",
        }
    );

// will got this error
TypeError: t.replaceAll is not a function
    at file:///T:/_CODE_/langchain-test2/node_modules/langchain/dist/embeddings/openai.js:68:79
    at Array.map (<anonymous>)
    at OpenAIEmbeddings.embedDocuments (file:///T:/_CODE_/langchain-test2/node_modules/langchain/dist/embeddings/openai.js:68:66)
    at Chroma.addDocuments (file:///T:/_CODE_/langchain-test2/node_modules/langchain/dist/vectorstores/chroma.js:39:53)
    at Chroma.fromDocuments (file:///T:/_CODE_/langchain-test2/node_modules/langchain/dist/vectorstores/chroma.js:120:24)
    at Chroma.fromTexts (file:///T:/_CODE_/langchain-test2/node_modules/langchain/dist/vectorstores/chroma.js:116:23)
    at insertIntoChroma (file:///T:/_CODE_/langchain-test2/chroma.mjs:57:18)
    at run (file:///T:/_CODE_/langchain-test2/chroma.mjs:47:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)

That is because langchain try to invoke replaceAll for the inputting Buffer.

This PR add a toString() invoke when creating a vectorstore by text. I don't know whether should we check the typeof text or use toString directly. If you think it is better to check the type and throw Error, plz let me know.

Thanks for this @zombieyang can we do this instead in https://github.com/hwchase17/langchainjs/blob/main/langchain/src/document.ts#L23

Oh, yes. That's way better.
I changed my commit.

Oh, that's way better. Thank you.
I force pushed my new commit.

This issue still occurs if not on Node 16+

This issue still occurs if not on Node 16+

langchain.js declared a node version limitation in package.json.
https://github.com/hwchase17/langchainjs/blob/main/langchain/package.json#L7
I even cannot run any http request in node16. How can you run that?


Add Openshift supported versions

Description
Add Openshift supported versions
Issues
List the issues impacted by this PR:

Issue ID

https://github.com/dell/helm-charts/issues/54

Checklist

[ ] I have performed a self-review of my own code
[ ] I have run 'make check' to ensure my code does not have any formatting, vetting, linting, or security issues
[ ] I have run 'make test' to ensure new and existing unit tests pass locally with my changes
[ ] I have not allowed coverage numbers to degrade
[ ] I have maintained at least 90% code coverage
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[ ] I have added tests that prove my fix is effective or that my feature works

How Has This Been Tested?
Please describe the tests that you ran to verify your changes. Please also list any relevant details for your test configuration

[ ] Unit tests
[ ] Manual test with Openshift deployment. Create an image, deployed to internal docker repo, referenced the image in values.yaml, ran helm deployment. Then ran manual e2e test.
[x] These are documentation changes only.

e2e pass


it8xxx2_evb: fail all tests

Describe the bug
All tests on ITE fail. Timeout with no output. Handler log is empty.
I did a bisection and found a commit that breaks the tests: 8dc3f85
I haven't started bisectioning on collab-hwm yet. hwmv2 bring bug
Logs and console output
Example log:
2024-03-05 14:21:32,331 - twister - DEBUG - Timed out while monitoring serial output on it8xxx2_evb
2024-03-05 14:21:32,332 - twister - DEBUG - Serial port is already closed, stop reading.
2024-03-05 14:21:32,332 - twister - DEBUG - run status: it8xxx2_evb/samples/hello_world/sample.basic.helloworld failed
2024-03-05 14:21:32,338 - twister - INFO - 1/1 it8xxx2_evb               samples/hello_world/sample.basic.helloworld         FAILED Timeout (device 70.342s)

or
2024-03-05 14:51:25,789 - twister - DEBUG - Timed out while monitoring serial output on it8xxx2_evb
2024-03-05 14:51:25,790 - twister - DEBUG - Expected suite names:['bitarray', 'printk', 'common', 'bitfield', 'irq_offload', 'clock', 'byteorder', 'common_1cpu', 'boot_delay', 'atomic', 'pow2', 'common_errno', 'multilib', 'bitarray', 'printk', 'common', 'bitfield', 'irq_offload', 'clock', 'byteorder', 'common_1cpu', 'boot_delay', 'atomic', 'pow2', 'common_errno', 'multilib']
2024-03-05 14:51:25,790 - twister - DEBUG - Detected suite names:[]
2024-03-05 14:51:25,790 - twister - DEBUG - run status: it8xxx2_evb/tests/kernel/common/kernel.common failed
2024-03-05 14:51:25,794 - twister - INFO - 8/8 it8xxx2_evb               tests/kernel/common/kernel.common

To Reproduce
Steps to reproduce the behavior:
twister -p it8xxx2_evb --device-testing --west-flash="../../itetool/loader.sh" --device-serial=/dev/ttyUSB0 -T tests -T tests/

OS: Linux
Toolchain: zephyr-sdk-0.16.5
v3.6.0-402-g3bf61528cce6

CC @tejlmand @gmarull @nordicjm

CC @Dino-Li @GTLin08 @RuibinChang

Fail how? Please elaborate

I updated the bug description

If you take a board, manually build hello world and flash it, what output do you get?

If you take a board, manually build hello world and flash it, what output do you get?

I build and flash manually...but I still have no output
Log from ite flash tool:
Flash via I2C interface...
ITE DLB4 Linux Flash Tool: Version 1.0.6
Current time is Tue Mar  5 16:45:02 2024

Open file: build/zephyr/zephyr.bin
Using libusb v<IP_ADDRESS>96

Connecting ITE Device....
Protect Status: mode=ff data=0 2

ITE DLB4 FW Version : 0013
===================================
CHIP ID          : 1302c1 ( 81302 )
Flash ID         : c8 65 14
Eraseing...      : 100%
Checking...      : 100%
Programng...     : 100%
Verifying...     : 100%

Protect Status: mode=82 data=0 2
Current time is Tue Mar  5 16:45:10 2024

Please change default SOC variant of it8xxx2_evb to SOC_IT81202_BX and verify test again.
https://github.com/zephyrproject-rtos/zephyr/blob/main/boards/ite/it8xxx2_evb/Kconfig.it8xxx2_evb

Or SOC_IT81302_BX

Changing the SOC to SOC_IT81202_BX or SOC_IT81302_BX enabled reading the output. Hello_world sample pass, kernel/common fails, but there is output for both.
However, fail kernel.common is rather suitable for a separate issue.


Add insert/update/delete/(ctas?) to DataFusion planner

Is your feature request related to a problem or challenge? Please describe what you are trying to do.
As a library, parts of DataFusion can be very useful, even if they aren't plumbed entirely through to something like the CLI. At my company, we are attempting to build an HTAP database on top of DataFusion, and running into roadblocks because at present DataFusion cannot convert insert/update/delete/ctas queries into LogicalPlans, even though the sqlparser crate can parse them.
Describe the solution you'd like
Parse, plan, but don't execute insert/update/delete queries. (It might be a fun follow on PR to support creating tables with CTAS from the CLI?)
Describe alternatives you've considered

Intercept these at the AST level in our app, and plumb a different path for write plans, but lose functionality like named parameter replacement and have to re-implement.

I think this proposal (to have DDL / DML support in the engine) is very much in the spirit of DataFusion as a library to build other databases on.
Specifically, the semantic analysis / basic plan support for these nodes is non trivial (aka resolving references to columns, etc) and is not database specific. The specific implementations of how to actually implement those commands I think are almost certainly going to be system specific.
Ideally, I hope that DataFusion can have a clear separation between

"built in logical plan nodes that have good implementations" (e.g. the query ones like TableSource, Filter, etc) and
"built in logical plan nodes that have either no or basic implementations" (e.g. like create table, write rel, etc)


[BUG] 2.3.0-dev.2 doesn't work with Android 7.1.1

Seem like 2.3.0-dev.2 doesn't work with Android 7.1.1
i found this issue on
Android Emulator that running API 25

For what?


🚀 - Add RTL support for maskitoPrefixPostprocessorGenerator / maskitoPostfixPostprocessorGenerator

Which package(s) are relevant/related to the feature request?
@maskito/kit
Description
Generators will get new second optional argument – direction (ltr by default).
Example:
postprocessor: maskitoPipe(
        maskitoPrefixPostprocessorGenerator('$', 'rtl'),
        maskitoPostfixPostprocessorGenerator('.00', 'rtl'),
    ),

I think we should try and get in touch with somebody from Arabic countries to see if it makes sense, because it depends on the actual characters. I'll try to reach out to somebody after vacation.