Receive: Allow remote write request limits to be defined per file and tenant

[x] I added CHANGELOG entry for this change.
[ ] Change is not relevant to the end user.

Changes

Allow request limits & gates to be configured using a file.
A user can save the file to disk and pass its path to receive.limits-config-file or pass the file content inline to receive.limits-config.
Documentation was updated with an example and explanation about how default and tenant limits interact.

Potential follow ups

Move the configuration for the active series limit added in #5520 to the same file.

Verification

Unit tests.
Ran it locally.

xref: https://github.com/thanos-io/thanos/pull/5527#discussion_r927267408

@yeya24 based on the conversation we had at https://github.com/thanos-io/thanos/pull/5527#discussion_r927267408, after I tried to add CLI args to configure the default limits in this PR while keeping also the file my opinion on this has changed for the following reasons:

It adds complexity for users of Thanos to understand the configuration

The logic becomes convoluted. There would be CLI args that override missing or present default values that override missing tenant values.
It even allows for partial configuration of default via CLI and file at the same time, creating potential confusing setups for users.

It adds complexity in the code without clear benefits

Each one of these levels have different default values (zero or nil) that have to be handled.
The type we used as a standing for passing configuration files (extflag.PathOrContent) also supports inlining of the configuration as a CLI argument. It's not difficult to use it to inline the configuration proposed in this PR in case you only want to set defaults.

I don't think adding extra CLI args is worth the cost given the features and simplicity that we get from extflag.PathOrContent. What do you think?

I found out during verification tests that the default values for limits are not being exported in the Receive's metrics. Will fix this.

Would changing the limits require receivers to be redeployed?

@fpetkovski yes. We might want to improve this with some mechanism to reload this configuration in a follow up PR, like the config reload endpoint other components have.
Probably during reload time the limits would be shortly disabled to avoid synchronization issues under high load. WDYT?

Yeah I think config reloading will be more than a nice to have for this feature. Large receiver deployments can take hours to rollout, so we should try to speed up configuration changes if we can.

it still is tenant aware, even though it could be just "per label". I assume the conclusion is to use per tenant limits at the end?

I can refactor this to be purely label-aware and take a few more days (or weeks) to get it ready, tested, and documented while the feature doesn't land.
Or land the feature as experimental (very likely to change) and then work on extending and changing it to be just label-aware afterwards. I thought this was our conclusion from the community meeting. Wasn't it, @bwplotka?

I can even already fill up the code, example configuration file, and logs with warnings that the configuration structure will be changing soon to work on a per-label basis.

A point of the discussion: being straightforward that this feature support tenancy is a plus for users/maintainers of Thanos clusters. Changing it to be label aware is friendly to maintainers (keep tenancy logic away and "hidden") but not to users (tenancy logic is hidden even though Receive is tenant-aware).

There might be other points to consider before committing to make this purely label aware solution too:

Does it even make sense to apply a "request body size limit" to a subset of the request?

Only applicable limits are maximum amount of timeseries and samples.

Does it make sense performance-wise?

Regex matching or simple exact match?
What would the request response look like if only part of it hit a limit?

Complex logic vs simple per tenant limits

It becomes possible that two limit rules apply to given set of timeseries, which one would have priority?
What if there are multiple labels per group? i.e. labelA=valueA && labelB=valueB.
What if there are multiple values to group by, will regex performance be acceptable? i.e. labelA=valueA || labelA=valueB.
How to enable configuration if each individual value should be its own group? i.e. apply the limits for each unique value of labelA.

So I prefer to not rush directly into it.


There is a UI issue on the Tax Rates page

Bagisto Version: Master
Steps To reproduce--
1. log in as an admin.
2. Go Settings > Taxes > Tax Rates
Expected result: List of tax rates
Actual result: Empty page

@prateek-webkul
There should be only one export option. Please find the screenshot here


credits.txt is not working

Describe your problem here.
kk, soooo i put my credits.txt in the mods/data folder and it's not working!
Are you modding a build from source or with Lua?
Lua
What is your build target?
Windows x64
Did you edit anything in this build? If so, mention or summarize your changes.
nope im using lua

can you send over the file so we can examine it further?

Credits without a modpack won't show up, idk if it's intended or not but mods should be distributed inside a pack anyway

can you send over the file so we can examine it further?

yes here
credits.txt

Credits without a modpack won't show up #12856

thanks bro


Document adv.mem instruction

The parser supports an opcode adv.mem that is currently lacking user documentation.

Closed by #933.


Always hidden, hide '|'

What's this PR do?

[x] Minor changes of interface
[x] Allow to hide '|' button to have more space in status bar
[x] Optional 'always hidden' section

What are the relevant Git tickets?
https://github.com/dwarvesf/hidden/issues/73
https://github.com/dwarvesf/hidden/issues/80
Screenshots (if appropriate)

Cool 👍 , thanks for the pr. I will take a look at it 😄

I just took a quick look at it.
I believe that using right-click to open the context menu is a kind of anti-pattern and I'm not really sure if Apple allows it or not.
In the past version, we did use this and got reject. Anyway, just keep what you are doing here and I will give it a try. If Apple rejects it I will remove the right click part.
Another quick note: You should consider using if let or guard let to safely unwrap the optional 👍

Thank you for your quick answer:)
I have some questions about right-click. It's important to leave some kind of other way of interacting with '<' to show the menu (not left-click) so '|' could be hidden and shown. Is everything apart from left-click is rejected? (may be option+click or something else is ok?)

hi @s-valent , I have used it, and everything seems to work perfectly. But I think we should keep showing the menu context when a user clicks to the separator menu button so that the old user will not be surprised with the changes  🤣
Would you mind to change it ❤

Hi @s-valent, can you update this pr 😢
If you got any problems, just feel free to chat with me. I'm willing to help you 😄

I'm really sorry for waiting so long(
I was busy last month passing exams, will be here soon fixing

haha, @s-valent 😄  I really understand it.
please don't be worry, just update it whenever you feel comfortable.


bluetooth: Fix the incompatibility made by https://github.com/apache/nuttx/pull/14224

Summary
that pr requires chip turn on CONFIG_DRIVERS_BLUETOOTH to use bluetooth, but not all defconig enable this option, so let's map bt_driver_register to bt_netdev_register in header file in this case and revert the unnecessary change in the related chip and board folders.
Impact
bluetooth keep the compatibility before https://github.com/apache/nuttx/pull/14224.
Testing

[Experimental Bot, please feedback here]
The PR summary you provided is a bit difficult to understand, but I can tell you it does not meet the NuttX requirements. Here's why:

Summary lacks details:

Why is the change necessary? Simply stating it reverts an unnecessary change isn't enough. Explain the problem caused by the previous change.
What functional part of the code is being changed? Be specific about the files and functions modified.
How does the change work? Explain the technical details of mapping bt_driver_register to bt_netdev_register.
Links are missing: Provide links to the related NuttX issue and/or PR that prompted this change.

Impact section is incomplete:

While stating it maintains compatibility is good, you need to elaborate on other aspects:

Impact on build: Does this change how someone builds with Bluetooth?
Impact on hardware: Are there any specific boards or drivers affected?
Impact on documentation:  Does any documentation need updating to reflect this change?

Testing section is empty:

Provide details about your testing environment:  What OS, architecture, and board configuration did you use?
Include logs:  "Testing logs before change" and "Testing logs after change" sections are empty.  Show the actual logs demonstrating the problem and the fix.

To improve this PR:

Rewrite the summary with more detail and clarity.
Thoroughly complete the impact section, addressing all points.
Provide specific details about your testing environment and include actual logs.

By providing this information, you make it easier for reviewers to understand and approve your changes.


Pictures not being saved

What's the issue?
When taking a picture with the camera, a paper is consumed but no picture appears in inventory or is dropped on the ground. Nothing remarkable in the client logs, but the server logs this:
pool-16-thread-9/ERROR]: Uncaught exception in thread "pool-16-thread-9"
mc-1  | java.lang.UnsatisfiedLinkError: 'long com.luciad.imageio.webp.WebPDecoderOptions.createDecoderOptions()'
mc-1  | 	at com.luciad.imageio.webp.WebPDecoderOptions.createDecoderOptions(Native Method) ~[io_github_darkxanter_webp-imageio-0.3.2-e4e37d5606a8f057.jar:?]
mc-1  | 	at com.luciad.imageio.webp.WebPDecoderOptions.<init>(WebPDecoderOptions.java:26) ~[io_github_darkxanter_webp-imageio-0.3.2-e4e37d5606a8f057.jar:?]
mc-1  | 	at com.luciad.imageio.webp.WebPReadParam.<init>(WebPReadParam.java:24) ~[io_github_darkxanter_webp-imageio-0.3.2-e4e37d5606a8f057.jar:?]
mc-1  | 	at com.luciad.imageio.webp.WebPReader.getDefaultReadParam(WebPReader.java:147) ~[io_github_darkxanter_webp-imageio-0.3.2-e4e37d5606a8f057.jar:?]
mc-1  | 	at javax.imageio.ImageIO.read(Unknown Source) ~[?:?]
mc-1  | 	at javax.imageio.ImageIO.read(Unknown Source) ~[?:?]
mc-1  | 	at me.chrr.camerapture.picture.ServerPictureStore.put(ServerPictureStore.java:64) ~[Camerapture-1.3.1+mc1.20.1.jar:?]
mc-1  | 	at me.chrr.camerapture.Camerapture.lambda$registerPackets$4(Camerapture.java:179) ~[Camerapture-1.3.1+mc1.20.1.jar:?]
mc-1  | 	at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[?:?]
mc-1  | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[?:?]
mc-1  | 	at java.lang.Thread.run(Unknown Source) ~[?:?]

I have looked for any other issues similar to this one and  I think that it could be caused by the C2ME mod. I'm unable to test without it right now as the server is running for many people but would be able to do it in another one with the same mods.
Screenshots
No response
Mod and Minecraft version
1.3.1, Fabric for 1.20.1

Huh, that's an interesting problem, looks like it doesn't load a native library.
What are you running the server on? Are you running it yourself, or through a server host? Also, maybe a weird question, if you don't know it's fine, but do you know the OS and architecture of the server?

I have managed to solve it partially. Here's how I did it.
My server runs on a virtual machine using a docker container, and has a data folder where I put the corresponding Minecraft folder (e.g. mods, config). Here's where I noticed this issue.
Today, I wanted to reproduce it on my machine, where I first tested the server before uploading it to the virtual machine, using the same docker container. Surprisingly, it worked on my machine with the same exact mods, but different config as I hadn't updated some config files (I was doing it on the VM).
So I tried copying Camerapture config from the VM to my machine, and as expected the same error happened. And doing the same but from my machine to the VM solved it.
Basically, what I did was changing this
{
  "version": 3,
  "max_image_bytes": 200000,
  "max_image_resolution": 1280,
  "ms_per_picture": 50,
  "can_rotate_pictures": true,
  "check_frame_position": false
}

to this
{
  "version": 1,
  "max_image_bytes": 200000,
  "max_image_resolution": 1280
}

Which seems to be the config of the older version which I first used on my machine when testing the server, but that got changed when updating the mod.
However, Camerapture automatically edits the config file to match the newer version, which is a problem because when the server restarts it's going to use that config that causes the problem.
Why does the config cause this issue? No idea. Hope this can be useful for you.

The VM runs Ubuntu 22.04.4 LTS aarch64, and my machine Debian GNU/Linux 12 (bookworm) aarch64

Hmm. I couldn't recreate the problem on Linux on my own PC, and I've also never seen it on a server I run. More testing needed I guess..
It's weird that the config thing fixes it for a moment, since it's a whole separate system. It shouldn't matter, as when it's an older version, it just uses default values for the missing fields, and the two configs effectively are exactly the same.
Thank you for being so detailed! I'll see if I can hopefully find the issue.

I can try to reproduce it on a docker container only with this mod, and if I'm able to do it I can share the docker compose file so you'd be able to run the same exact container.

I managed to reproduce the issue, but now for some reason the workaround (tweaking the config) stopped working.
This time, as only Camerapture was included, I was able to see that it logs some lines saying that it cannot load a library when starting the server. Here are the full logs of the server starting and me taking a photo: https://mclo.gs/YseQS1c
It seems that it has to do with GLIBC version, but I'm not sure how to handle that as it's a docker container. I checked the GLIBC version on my machine and it is 2.36, but on the container (running docker exec -i mc-mc-1 ldd --version ), it returned ldd (Ubuntu GLIBC 2.31-0ubuntu9.16) 2.31
If it's that what's causing the issue, I think I should probably report it to the docker image maintainer. I don't know if there's anything that can be done on Camerapture's side.
If you want to test it and see if you can reproduce it, you'll need to install docker (which you can uninstall after doing this). I'm using this docker-compose.yml file:
services:
  mc:
    image: itzg/minecraft-server:java17
    ports:
      - "25565:25565"
    environment:
      EULA: "TRUE"
      TYPE: "FABRIC"
      VERSION: "1.20.1"
      INIT_MEMORY: 5600M
      MAX_MEMORY: 5600M
      USE_AIKAR_FLAGS: "TRUE"
      GUI: "FALSE"
      OVERRIDE_SERVER_PROPERTIES: "FALSE"
      DUMP_SERVER_PROPERTIES: "TRUE"
      ENABLE_AUTOPAUSE: "FALSE"
      AUTOPAUSE_TIMEOUT_EST: "1800"
      AUTOPAUSE_TIMEOUT_INIT: "450"
      RCON_PASSWORD: "same password as in server.properties"
    restart: unless-stopped
    dns:
      - <IP_ADDRESS>
      - <IP_ADDRESS>

    volumes:
      - ./data:/data

Here's how the folder tree should look:
.
└── mc/
    ├── docker-compose.yml
    └── data/
        ├── mods/
        │   ├── fabric-api
        │   └── camerapture
        ├── server.properties
        └── other files and folders that minecraft will create

Once you have all that set, you have to download the image by running docker compose pull in the folder where docker-compose.yml is. Then, docker compose up -d will start the container (if it doesn't work try docker compose restart). To access the logs, simply run docker compose logs -f.
In addition, in order to run minecraft commands (to make yourself op, for example), you have to enable rcon and set its password in server.properties, then run docker exec -i mc-mc-1 rcon-cli (replace mc-mc-1 with the name of the container, which you can see using docker ps).

I have just tested on a x86_64 computer, and it works fine there. It is definitely related to the architecture (aarch64) and it not being able to find a suitable glibc version.

Ah yeah, you got it exactly. Looks like the image the docker container is using uses an incompatible version of glibc to the one that the WebP library was compiled against. The minecraft-server docker image is based on Ubuntu 20.04, which has a slightly outdated version I think. As you've already found out, not much i can do to fix that. I did test using Docker in the meantime, but all computers I have are x86_64, which work fine.
Since the server check is kind of flawed anyway, I'll remove it in the next version, as it's not really necessary either.

I've released 1.4.0 which removes the server check, so it should work now!

Thanks, it works now! But I don't understand what you did to solve it. You removed the server check of this library and now it works without it? I mean, is the library required in the first place?

I'm using a library to read and write webp files, mostly on the client side. The server side basically just accepts the image bytes, and passes them through to other clients. I did have a small sanity check on the server side, just to check if it's actually an image or not, which is the only part where this library was used on the server. That's the check I removed, which makes the server work without it.
It's a workaround for sure, but it's the best fix I can do right now. Theoretically, this issue can also exist on the client, but it's very specific to linux that hasn't had an update for a while, and since you don't run your Minecraft client in Docker (i hope at least), it doesn't really happen.


Do you have examples for adversarial training?

Hi Ross,
Can I shamelessly ask whether you have any example for adversarial training?
Thanks,
Jing

I've been working on that recently, have something that's promising but it doesn't train very fast and requires multiple GPUs. I'll publish in a separate repository within the next month.

There is an adversarial training example here: https://github.com/rwightman/pytorch-nips2017-adversarial/blob/master/python/train_adversarial_defense.py


Add support for different backends

Codegens for different backends would be nice, currently it does not compile dependencies according to the backend selected for the target binary.

This has been open for a long time, and I'm not sure if this is still an issue or the --gc command-line option is enough. I'm going to close this, because I'd like to clean up the issue tracker a bit. Feel free to reopen, if this requires further work.


Update asset and contract docs

Diagrams  and terminologoy  need to get aligned with the changes described in #227
Would be great to have the javadocs in the header of the corresponding classes as source of truth for the definitions.
Maybe we can just link or autocreate the markdown from javadoc.
 Moritz Keppler<EMAIL_ADDRESS>Daimler TSS GmbH, legal info/Impressum

@MoritzKeppler is this something you can look into for the release? I can help if there are questions.


HTTP Status Codes For Command Failures

Hi Vladimir.
This isn't a technical issue with this repository so much as it is a question for you.
Using a CQRS approach like this repository does, do you have any recommendations on how one would go about responding with different http status codes depending on the nature of a command's failure without API (UI) logic leaking into the application services layer?
Example:
In your StudentController (https://github.com/vkhorikov/CqrsInPractice/blob/master/After/src/Api/Controllers/StudentController.cs) the following method takes in a Student's ID and a StudentEnrollmentDto:
[HttpPost("{id}/enrollments")]
public IActionResult Enroll(long id, [FromBody] StudentEnrollmentDto dto)
{
    Result result = _messages.Dispatch(new EnrollCommand(id, dto.Course, dto.Grade));
    return FromResult(result);
}

What might we do if we wanted to respond with a 404 error if no matching Student is found with the provided ID, but respond with a generic 400 if some other expected failure occurs in the EnrollCommand handler?

I recommend the following:

Create a custom Error value object. List application errors explicitly in one place, like:

class Errors {
  class General {
    public static Error NotFound(string entityName, long id) {
      return new Error("error.code.goes.here", /* compose a nice error message here */); }
    /* other errors */
  }
}

Use the Result<T,E> version of Result or introduce your own Result specific to your app that would use Error as E

In BaseController, modify FromResult to distinguish between different types of errors.

Got it. Thanks for taking the time to share some advice!


Fix redirected links in README, add note re running BigDiffy via CLI

#41 & part of #34

Codecov Report

Merging #44 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master      #44   +/-   ##
=======================================
  Coverage   73.58%   73.58%
=======================================
  Files          28       28
  Lines        1026     1026
  Branches      123      125    +2
=======================================
  Hits          755      755
  Misses        271      271

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update d838357...da97c91. Read the comment docs.


Ability to Pass Dask Arrays as data in DataArray Creation

Is your feature request related to a problem? Please describe.
I'm trying to convert a dask dataframe into a dask xarray without having to load the data fully into memory.
I was hoping I'd be able to pass df.values which is a Dask array to the data parameter in xr.DataArray
idx_dim = 'datetime'
col_dim = 'fueltypes'

xr.DataArray(df.values, [df.index, df.columns], [idx_dim, col_dim])

However this raises the error: ValueError: conflicting sizes for dimension 'datetime': length nan on the data but length 90386 on coordinate 'datetime'

Describe the solution you'd like
An ability to create DataArrays from dask dataframes, similar to the existing reverse method for converting Datasets to dask dataframes: Dataset.to_dask_dataframe

Describe alternatives you've considered
I tried using xr.Dataset.from_dataframe(df) but it required the dataframe to be fully loaded into memory
Additionally, unlike the standard Pandas dataframe the Dask dataframe does not have a  .to_xarray method.

Additional context
This is in part made necessary by the decision of the Zarr developers to not support saving of dask dataframes to zarr, instead suggesting that you convert to an xarray and then save that to zarr.

duplicate of #3929
As stated there and in dask/dask#6058, we would need to add a Dataset.from_dask_dataframe method which dask.dataframe could then wrap in a to_xarray method. This is currently only partially possible because we don't allow dask.array in dimension coordinates, but I guess it would be good to at least have partial support.

As stated there and in dask/dask#6058, we would need to add a Dataset.from_dask_dataframe method which dask.dataframe could then wrap in a to_xarray method. This is currently only partially possible because we don't allow dask.array in dimension coordinates, but I guess it would be good to at least have partial support.

Thanks, I saw dask/dask#6058 but missed #3929.
If I'm understanding you correctly there should be no problem passing a dask array for the data parameters its just the dims/coords. If the _infer_coords_and_dims method on DataArrays was adapted to check for any dask.delayed elements and compute them would that enable this functionality or are there additional blockers? Thanks for your help with this.

Have started to implement this but will continue the discussion in 3929


no-magic-numbers should ignore various Number methods' params

Bug Report
Since linter now ingores radix param in parseInt method maybe it should be good to standardize how params are handled in those Number methods:

toFixed()
toExponential()
toPrecision()

TypeScript code being linted
someNumber.toFixed(2);
someNumber.toExponential(4);
someNumber.toPrecision(2);

with tslint.json configuration:
{
  "no-magic-number": true
}

Actual behavior
[tslint] 'magic numbers' are not allowed (no-magic-numbers)
Expected behavior
No error.

This was fixed by #3668 🎉


metrics, elect: Show the metrics reader owner on Grafana

What problem does this PR solve?

Issue Number: close #614
Problem Summary:
Show the metrics reader owner on Grafana
What is changed and how it works:

Change VIPGauge to OwnerGauge so that it's general
Delete the metric when it's not the owner

Check List
Tests

[x] Unit test
[ ] Integration test
[ ] Manual test (add detailed scripts or steps below)
[ ] No code

Notable changes

[ ] Has configuration change
[ ] Has HTTP API interfaces change
[ ] Has tiproxyctl change
[ ] Other user behavior changes

Release note

Please refer to Release Notes Language Style Guide to write a quality release note.
None

/retest


Synonymization/generality problems

For test 7 asset 79, the ARAX result has progesterone as result 2 of 103. But the asset asks for progestin (the synthetic version of progesterone, iirc).
For test 12, asset 309, pegfilgrastim is asked for, but any filgrastim or G-CSF should be accepted.
For test 13, asset 362, the goal is to get ACE inhibitors and ARAX returns Angiotensin-converting enzyme inhibitors (i.e. the full name)
For test case 15, asset 318, Ivacaftor is asked for and ARAX returns Ivacaftor / texacaftor and ivacaftor /lumacaftor as results 2 and 3. Do we want to do the testing post-conflation?
Test 24, asset 396 Butyrate derivatives is asked for, but butyrate and butyric acid aren't accepted as answers.
Test 29, asset 504, thrombin is asked for, but alpha-thrombin is not accepted as an answer (similarly for test 30, asset 595)
Test 35 asset 665, KRASG12D inhibitor MRTX1133 is asked for, but MRTX1133 (CHEMBL.COMPOUND:CHEMBL5081048) is not accepted

Similarly Test 9 asset 623, Rabeprazole is asked for, but Rabeprazole sodium is not accepted as correct. Again with the post/pre-conflation issue

Note this issue for Asset 362 https://github.com/NCATSTranslator/Tests/issues/76

We noted the same issues for some tests:

asset 396 Butyrate Derivatives (UMLS:C0581820): BTE returned entities that seem related like butyric acid (CHEBI:30772), D-alpha-aminobutyric acid (CHEBI:28797), and phenylbutyrate (CHEBI:41500)

Here's some more tests with the same kind of problem (I'm closing their separate issues and moving the info here):

asset 32 Lactase CHEMBL.COMPOUND:CHEMBL2108505:

the NodeNorm entry for this ID seems odd: it has no other equivalent IDs (Dev NodeNorm).
There are other lactase entities with more equivalent IDs that show up in BTE's results with higher scores/ranks: MESH:D043322 (ChemicalEntity) and UMLS:C0083183 (Protein)
I've noted before that tools tended to fail this test. I haven't done this comparison lately though

So I think this gets to a root question: The Test is asking for a superclass identifier (in most cases) and an ARA gives back a subclass (more specific). Is the ARA expected to also return the superclass? If not, why not?

From the subclass reasoning perspective (if a general concept is asked for, also return more specific instances), my impression was that precision is preferred to generality. But I guess it hasn't really been codified one way or another. My $0.02 is that a subclass being should "count" for the test asking for a superclass. Open to other opinions though

I agree that more specific instances are preferred, but does that mean that the general concept that was asked for should not be returned?
If we were to support subclass answers in the tests, how exactly would that work? Is there an easy way to determine if something is a subclass of the expected output?

This general topic will be discussed during the testing session of the upcoming Relay.

wrt "wrong output IDs": I guess not all tests are from me but the purpose of the test assets is to test the UI so when the UI returns something wrong (e.g. superclasses) the ID given by the UI is reported.
wrt synonymization/generalization:

since the testing is testing the UI, the testing is done "post conflation" if the creative query returned by ARA does the conflation. At least that's how I made the tests.
When a super set family was outputed the question I was asking myself was "are all BioLink entities in that superclass" passing/failing. If not then it is "too general" and is a failure.
for the thrombin case: I have not idea why alpha-thrombin is not accepted because I did not write a fail test for that one.

Asset 79 also has this issue. It's been running in sprints 5-6.
The answer is "progestin" MESH:D011372, but this is a drug class with ~ 60 individual chemicals. Some of those individual chemicals (including progesterone itself) are high-ranking ARA results and should probably pass...
No one has been passing this test is sprints 5-6 (also noted previously).
This test is also flagged in https://github.com/NCATSTranslator/Tests/issues/93


Right click crash

SpongeForge version: spongeforge-1.12.2-2611-7.1.0-BETA-2996
Forge version: forge-1.12.2-<IP_ADDRESS>11-universal
Java version: openjdk version "1.8.0_161"
Operating System: centos 7
Plugins/Mods:
SpongeAPI, SpongeForge, Actually Additions, Advanced Generators, BD Lib, Baubles, Bed Patch, BedFix, Binnie Core, Binnie's Botany, Binnie's Design, Binnie's Extra Bees, Binnie's Extra Trees, Binnie's Genetics, Blood Magic: Alchemical Wizardry, Botania, Brandon's Core, CoFH Core, CoFH World, CodeChicken Lib, Cyclops Core, Draconic Evolution, Epic Siege Mod, Erebus, EvilCraft, EvilCraft-Compat, FTB Utilities, FTBLib, Forestry, Galacticraft Core, Galacticraft Planets, Guide-API, Immersive Engineering, Improved Extraction, Industrial Foregoing, IndustrialCraft 2, Iron Chest, Just Enough Items, MJRLegendsLib, Mantle, Mekanism, MekanismGenerators, MekanismTools, Micdoodle8 Core, More Planets, NetherPortalFix, NuclearCraft, OMLib, Open Modular Passive Defense, Open Modular Turrets, Planet Progression, PlusTiC, Reborn Core, Redstone Flux, Reforged, Shadowfacts' Forgelin, TESLA, Tech Reborn, Tesla Core Lib, Tesla Core Lib Registries, The Betweenlands, Thermal Cultivation, Thermal Dynamics, Thermal Expansion, Thermal Foundation, Tinker I/O, Tinkers' Construct, UniDict, WanionLib
Issue Description
Right click item: improvedextraction:auto_cutting_table crash
Error log:
https://gist.github.com/xxlio109/095e70a9bbe8142d450ec2bbcdcd25ee
sponge git:
https://github.com/SpongePowered/SpongeForge/issues/2073

I hope that I can make it understandable.
It is still the same problem.
Look at lines 2100 and 2199 in the crash report.
Have this and click on [show all versions].
Than download Forge
<IP_ADDRESS>08 | 02/01/18 05:18 AM | --------  ----------  -------- --------

Or install the new Sponge.
https://www.spongepowered.org/downloads/spongeforge/stable/1.12.2


Error npm run build

Error Build Frontend : npm run build

<EMAIL_ADDRESS>build /root/whaticket/frontend
react-scripts build
sh: 1: react-scripts: Permission denied
npm ERR! code ELIFECYCLE
npm ERR! errno 126
npm ERR<EMAIL_ADDRESS>build: react-scripts build
npm ERR! Exit status 126
npm ERR!
npm ERR! Failed at the<EMAIL_ADDRESS>build script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.
npm ERR! A complete log of this run can be found in:
npm ERR!     /root/.npm/_logs/2020-12-12T12_57_15_658Z-debug.log

Error Build Backend: npm run build

<EMAIL_ADDRESS>build /root/watiket/backend
tsc
src/app.ts:19:3 - error TS2769: No overload matches this call.
The last overload gave the following error.
Argument of type '(req: Request<never, never, never, never>, res: { statusCode?: number | undefined; setHeader(key: string, > value: string): any; end(): any; }, next: (err?: any) => any) => void' is not assignable to parameter of type > > 'RequestHandlerParams<ParamsDictionary, any, any, ParsedQs>'.
Type '(req: Request<never, never, never, never>, res: { statusCode?: number | undefined; setHeader(key: string, value: > string): any; end(): any; }, next: (err?: any) => any) => void' is not assignable to type 'RequestHandler<ParamsDictionary, any, any, > ParsedQs>'.
Types of parameters 'req' and 'req' are incompatible.
Type 'Request<ParamsDictionary, any, any, ParsedQs>' is not assignable to type 'Request<never, never, never, never>'.
Type 'ParamsDictionary' is not assignable to type 'never'.
19   cors({
~~~~~~
20     credentials: true,
21     origin: process.env.FRONTEND_URL

22   })

node_modules/@types/express-serve-static-core/index.d.ts:883:85
 883 export type ApplicationRequestHandler<T> = IRouterHandler<T> & IRouterMatcher<T> & ((...handlers: > RequestHandlerParams[]) => T);
                                                                                ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
The last overload is declared here.

Found 1 error.

npm ERR! code ELIFECYCLE
npm ERR! errno 2
npm ERR<EMAIL_ADDRESS>build: `tsc`
npm ERR! Exit status 2
npm ERR!
npm ERR! Failed at the<EMAIL_ADDRESS>build script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.

npm ERR! A complete log of this run can be found in:
npm ERR!     /root/.npm/_logs/2020-12-12T13_27_41_902Z-debug.log

Hi @myfrizqi. Did you run "npm install" on both folders before build?

I've run "npm install" in both folders before building.
It's solved now. I changed the code in the backend/dist/app.js script as below:

//import cors from “cors”;
and add this code:
const cors = require('cors');

Thank you


How to/feature request: Run Chrome as utility and browser

Preface

For general technical questions or "how to" guidance, please search StackOverflow for questions tagged "puppeteer" or create a new post.

Am banned from SO for another 4 years. That is not going to happen any time soon.
Have previously asked the question at Chromium discuss, /r/chrome, and bugs.chromium

What is the canonical procedure to use --utility, --utility-cmd-prefix, --utility-startup-dialog, --enable-service-binary-launcher flags?

What is the canonical procedure to use --utility, --utility-cmd-prefix, --utility-startup-dialog, --enable-service-binary-launcher flags?

Issue 1042473: How to use Chromium as utility and browser?

Concept

SpeechSynthesis to a MediaStreamTrack or: How to execute arbitrary shell commands using inotify-tools and DevTools Snippets

Am trying to execute arbitrary shell scripts on the local machine without using a local server, Native Messaging, or WebAssembly to do so.
Execution of the local shell scripts and retrieval of the output as a file is not the issue.
Retaining the ability to use the browser even though launched as a utility is the issue.
Perhaps the developers here will be able to help. If not do not know where to ask the question next.
If this issue is determined to be off-topic for this repository, kindly close the issue.

For issues, feature requests, or setup troubles with Puppeteer, file an issue right here!

Steps to reproduce
Tell us about your environment:

Puppeteer version: N/A
Platform / OS version: Linux
URLs (if applicable): file:, and Web address
Node.js version: 8.10.0

What steps will reproduce the problem?
Please include code that reproduces the issue.
notify_directory_modifications.sh
#!/bin/bash
requestLocalScripts() {
  while true; do
    inotifywait -e attrib -e close $HOME/localscripts/run.txt | while read a c;
      do
        $HOME/localscripts/script.sh
        echo "$$ $a $c"
      done
  done
}

requestLocalScripts

script.sh
#!/bin/bash
/usr/bin/espeak-ng -m -f $HOME/localscripts/input.txt -w $HOME/localscripts/output.wav

run.txt
A  plain text file having 0 size. We write the file to local file system without content to observe ATTRIB event (modification date) dispatched by inotifywait.
HTML
<!DOCTYPE html>

<meta charset="utf-8"/>
  <title>Choose directory, get writable permission, write without executing close()</title>

Choose directory, get writeable permission, execute script

Launch Chromium 81 with --utility, --utility-and-browser flags set
chromium-browser --utility-and-browser --utility-cmd-prefix="/path/to/notify_directory_modifications.sh" "/path/to/choose_directory_get_writable_permission_without_executing_close.html"
Write arbitrary sheel script to local filesystem using Native File System.
Utilize inotify-tools to execute the arbitrary shell script and get output of command as file.

What is the expected result?
Ability to navigate to a Web address at a tab other than the local HTML doccument at file: protocol set as argument to Chromium executable.
What happens instead?
When attempting to naviagte to a Web URL at the new tab page the document does not load, instead the tab appears to remain in the request state, similar to requesting a N GB resource, though does not ever conclude the request.
--
How to run Chromium, Chrome as both a utility and general browser?

Why was this closed

No answers forthcoming.
The closest to what I describe is Native Messaging and https://github.com/guest271314/requestNativeScripts.
Technically, it is possible to run arbitrary, dynamic scripts and programs using Native Messaging and File System Access API.


collect anonymous contributors

For repos with > 500 contributors, the GH api only returns 500 (though it seems like sometimes fewer, e.g. 404 for JuliaLang/julia).
This PR passes anon=true so that GH returns us all the contributors, but for some it will return GH info like their GH id and login, and for others it will return just a name and email, which is presumably not deduplicated if one used multiple names/emails but with the same GH identity.
To handle the variety of responses, I switched the object we store to a table that uses missing entries for id/login or name/email depending on what we have.
Draft since it isn't totally clear if we want to go this way (now we probably have duplicate entries instead of missing entries) and I haven't updated tests or docs.
Example:
julia> AnalyzeRegistry.contribution_table("JuliaLang/julia"; auth) |> DataFrame
1277×6 DataFrame
  Row │ login            id       name             email                              type       contributions
      │ String?          Int64?   String?          String?                            String     Int64
──────┼────────────────────────────────────────────────────────────────────────────────────────────────────────
    1 │ JeffBezanson      744556  missing          missing                            User                9721
    2 │ StefanKarpinski   153596  missing          missing                            User                4238
    3 │ missing          missing  Jameson Nash<EMAIL_ADDRESS>       Anonymous           3429
    4 │ ViralBShah        744411  missing          missing                            User                2830
    5 │ Keno             1291671  missing          missing                            User                2019
    6 │ tkelman          5934628  missing          missing                            User                1724
    7 │ timholy          1525481  missing          missing                            User                1582
    8 │ yuyichao          712232  missing          missing                            User                1361
    9 │ kshyatt           828643  missing          missing                            User                1145
  ⋮   │        ⋮            ⋮            ⋮                         ⋮                      ⋮            ⋮
 1270 │ missing          missing  wfrgra<EMAIL_ADDRESS>                 Anonymous              1
 1271 │ missing          missing  wgmitchener<EMAIL_ADDRESS>               Anonymous              1
 1272 │ missing          missing  willywalters5<EMAIL_ADDRESS>Anonymous              1
 1273 │ missing          missing  woclass<EMAIL_ADDRESS>Anonymous              1
 1274 │ missing          missing  wooglooskr<EMAIL_ADDRESS>                Anonymous              1
 1275 │ missing          missing  wschildbach<EMAIL_ADDRESS>     Anonymous              1
 1276 │ missing          missing  yuebanyishenqiu<EMAIL_ADDRESS>            Anonymous              1
 1277 │ missing          missing  zsoerenm<EMAIL_ADDRESS>              Anonymous              1
                                                                                1260 rows omitted

I'm not really sure why it gives Jameson an anonymous response and most of the other top contributors non-anonymous. I wonder if that means the commits weren’t associated to a GH identity? in which case maybe omitting anon=true means we would miss those contributions altogether.

I think I want this, as long as it's easy to distinguish authenticated users and anonymous ones.  We can provide the total number of authenticated users as safe lower bound, and the number of anonymous contributors with a huge caveat that there will be duplicated that aren't really easy to disentangle.  I'm just not sure whether to carry the email addresses.

The “type” field should make it easy to distinguish the two. The emails were to help deduplicate but I agree maybe we don’t want them if there’s issues around collecting that kind of info and maybe it’s still hard to deduplicate even with them...

The emails were to help deduplicate but I agree maybe we don’t want them if there’s issues around collecting that kind of info and maybe it’s still hard to deduplicate even with them...

I've seen a few cases were anonymous users are simply GitHub users who committed with an email address not registered in their GitHub account (and for GitHub users we don't have email addresses anyway), I don't really see an easy way to deduplicate these cases.  My feeling is that deduplication is anyway a massive mess without lots of matching and guessing.

I can rm the emails and add tests and docs if we want to go this way?

Sounds good!

We didn't have any tests for contributors and I'm not really sure how to do it with the auth anyway (I guess we could look at mocking but maybe that's overkill here..). So I just removed the email field, changed show to separate out anonymous users, and updated the docs.

We can use GITHUB_TOKEN.  For example in CI for the runtests step we can do
env:
    GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}

and have the test about contributor to be run only when PackageAnalyzer.github_auth() is non-anonymous

Thanks!


Interpret #tag as tag

with the todo.txt android app not only +project and @context are interpreted but also #tag as tag.
It would be really helpful if sleek could work in the same way and it could be also filtered for tags.

Hi @Saturo78 thanks for your proposal. I myself don't see a big value in adding another filter mechanism in sleek. It adds weight to the GUI and is not part of the basic todo.txt syntax.
As this is more a loose idea than a precise feature request, it might be a good idea to open up a general discussion about it, so we can discuss is before making anything more precise out of it.

Today i use +Projects and @persons tho whom the tasks are assigned and i would like to have a third option for locations, departments or other tags.
I will try if #tag works for me with the standard filter options.


ci: test

[x]  Modal测试
[x] GuideTour测试
[x] Grid测试
[x] Checklist测试

Codecov Report
Base: 7.68% // Head: 11.41% // Increases project coverage by +3.73% :tada:

Coverage data is based on head (e657079) compared to base (ee71bff).
Patch has no changes to coverable lines.

Additional details and impacted files
@@            Coverage Diff             @@
##           master     #581      +/-   ##
==========================================
+ Coverage    7.68%   11.41%   +3.73%
==========================================
  Files         152      152
  Lines        3135     3135
  Branches      801      801
==========================================
+ Hits          241      358     +117
+ Misses       2526     2428      -98
+ Partials      368      349      -19

Impacted Files
Coverage Δ

src/mixins/value.ts
73.46% <0.00%> (+20.40%)
:arrow_up:

src/Grid/index.ts
100.00% <0.00%> (+100.00%)
:arrow_up:

src/Grid/props.js
100.00% <0.00%> (+100.00%)
:arrow_up:

src/Modal/index.ts
100.00% <0.00%> (+100.00%)
:arrow_up:

src/Modal/props.js
100.00% <0.00%> (+100.00%)
:arrow_up:

src/Checklist/index.ts
100.00% <0.00%> (+100.00%)
:arrow_up:

src/Checklist/props.js
100.00% <0.00%> (+100.00%)
:arrow_up:

src/GuideTour/index.ts
100.00% <0.00%> (+100.00%)
:arrow_up:

src/GuideTour/props.js
100.00% <0.00%> (+100.00%)
:arrow_up:

src/Grid/GridItem/index.ts
100.00% <0.00%> (+100.00%)
:arrow_up:

... and 3 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


chore(build): creating default superset_text.yaml placeholder file

SUMMARY

Gets rid of a frequently reported warning about a missing file by providing one! The file will remain git-ignored for people to freely edit.
BEFORE/AFTER SCREENSHOTS OR ANIMATED GIF

TESTING INSTRUCTIONS

ADDITIONAL INFORMATION

[ ] Has associated issue:
[ ] Required feature flags:
[ ] Changes UI
[ ] Includes DB Migration (follow approval process in SIP-59)

[ ] Migration is atomic, supports rollback & is backwards-compatible
[ ] Confirm DB migration upgrade and downgrade tested
[ ] Runtime estimates and downtime expectations provided

[ ] Introduces new feature or API
[ ] Removes existing feature or API

@rusackas When running npm run dev-server the module is returning null and breaking the app.


Please add release for tag 0.2.9

https://github.com/Homebrew/homebrew-core/pull/127198

@HeyJavaBean please help, thanks

We will release a new version and make release log at next middle version (v0.3.0). Before that, you can use 'go install github.com/cloudwego/thriftgo@latest' to install thriftgo.


Fix for uncompressed draco attributes

Fixes https://github.com/CesiumGS/cesium/issues/10662
loadAsTypedArray in GltfLoader wasn't taking into account that Draco attributes can be losslessly compressed.
Here's the glTF extracted from the test data: draco_outlines.gltf.zip

Thanks for the pull request @lilleyse!

:heavy_check_mark: Signed CLA found.
:grey_question: CHANGES.md was not updated.

If this change updates the public API in any way, please add a bullet point to CHANGES.md.

:grey_question: Unit tests were not updated.

Make sure you've updated tests to reflect your changes, added tests for any new code, and ran the code coverage tool.

Reviewers, don't forget to make sure that:

[ ] Cesium Viewer works.
[ ] Works in 2D/CV.

I can confirm that this PR fixes the loading error, I'm able to load the glTF:

However, looking at the glTF itself, I notice some issues which is why no outlines are appearing: the accessors do not mention a bufferView, so CesiumJS is following the spec and initializing them to an array of all 0s. I'll post some notes about this in the original issue.


Supporting moving files from one project to another [INS-3865]

Support moving files(collections/documents/mocks/envs) from one project to another.
Due to the cloud synchronization mechanism, the move operation is implemented by first copying the file to new project and then deleting it in previous project. This may lead to some unexpected results:

Since the deleted files will not be automatically removed from the clients of other collaborators within the same organization, when User A moves a file from Project X to Project Y, User B will have two identical files in both Project X and Project Y.
The IDs of the files and their subfiles will change after the move, so if a mock file is moved, the mock URL will change, and the old mock URL will no longer be available.

Do we need to add some description text to prompt the user that the mock server URL will change after move to another project?

We initially intended to implement the feature to move files to another project, but we discovered that due to issues with cloud synchronization, true file movement couldn't be achieved. Therefore, we have enhanced the existing copy feature, allowing users to now choose the organization and project to which the files will be copied.
Why we can't implement real move:
I had considered implementing a real move operation that keeps the file IDs unchanged, but it introduces several problems in cloud sync:
If we directly change the parentId of the workspace from the old project to the new project, the server currently does not support synchronizing this behavior to other collaborators' clients. Even if the server supports this mechanism, we automatically executing the move operation for users when they receive the move message. It would not work for users using an older version of the client, as they wouldn't be able to achieve this synchronization.
I also tried simply copying the workspace and pointing the parentId of all sub-files of the original workspace to the new workspace, and then deleting the old workspace. However, this method also fails to synchronize on the collaborators' clients because deleting the workspace does not result in the workspace being removed on the collaborators' clients (We do not delete local files for user when the same one is deleted remotely). When the new workspace is synchronized to the collaborators' clients, the synchronization fails due to non-unique IDs of the sub-files.


Hangs on JavaScript scan 3/5

Hangs on 3/5 until ctrl+c they gives error ^^^^
Tried on arm64 and amd64 same result, everything is installed.

reconFTW uses LinkFinder which takes time, it is not hung, it just takes some time. About the sed expression error, a solution has been uploaded, please run ./install.sh again to get the new changes.


[FIX_BUG][server-test] dismiss of server warm-up time in RoundRobinSe…

dismiss of server warm-up time in RoundRobinSelectorTest
Consider the server warm-up time, which will cause dynamic changes in related test results, and we cannot make correct assertions
Verify this pull request
This pull request is code cleanup without any test coverage.

Codecov Report

Merging #4067 (291e651) into dev (f047f51) will increase coverage by 0.01%.
The diff coverage is n/a.

@@             Coverage Diff              @@
##                dev    #4067      +/-   ##
============================================
+ Coverage     39.11%   39.13%   +0.01%
- Complexity     2947     2949       +2
============================================
  Files           467      467
  Lines         22088    22088
  Branches       2711     2711
============================================
+ Hits           8640     8644       +4
+ Misses        12647    12642       -5
- Partials        801      802       +1

Impacted Files
Coverage Δ
Complexity Δ

...e/dolphinscheduler/remote/NettyRemotingClient.java
52.77% <0.00%> (+1.38%)
11.00% <0.00%> (+1.00%)

...org/apache/dolphinscheduler/remote/utils/Host.java
16.41% <0.00%> (+2.98%)
6.00% <0.00%> (+1.00%)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update f047f51...291e651. Read the comment docs.


loss clsoe to -1 at the begining of training

Has anyone met the problem that the loss close to -1 at the beginning of training? BTW, the training data is not sourced from traditional classification data like Imagenet or cifar.

What kind of data? cifar/imagenet put target object in the middle and only one instance may appear for contrastive learning. The data augmentation (resized random crop etc.) is tailored to this type of input.

What kind of data? cifar/imagenet put target object in the middle and only one instance may appear for contrastive learning. The data augmentation (resized random crop etc.) is tailored to this type of input.

Similar to coco format, yet I crop the target from the original image. The target is centrally present in the image, as in Imagenet.

Has anyone met the problem that the loss close to -1 at the beginning of training? BTW, the training data is not sourced from traditional classification data like Imagenet or cifar.

Yes! Especially for parameters that differ from the ones given in the paper!
Checkout Fig.2 in the paper and track the channel std!

Has anyone met the problem that the loss close to -1 at the beginning of training? BTW, the training data is not sourced from traditional classification data like Imagenet or cifar.

Yes! Especially for parameters that differ from the ones given in the paper!
Checkout Fig.2 in the paper and track the channel std!

Hi，do you use Imagenet or custom data?

Has anyone met the problem that the loss close to -1 at the beginning of training? BTW, the training data is not sourced from traditional classification data like Imagenet or cifar.

Yes! Especially for parameters that differ from the ones given in the paper!
Checkout Fig.2 in the paper and track the channel std!

Hi，do you use Imagenet or custom data?

custom dataset!
but i can get good results by choosing the right parameters!

Has anyone met the problem that the loss close to -1 at the beginning of training? BTW, the training data is not sourced from traditional classification data like Imagenet or cifar.

Yes! Especially for parameters that differ from the ones given in the paper!
Checkout Fig.2 in the paper and track the channel std!

Hi，do you use Imagenet or custom data?

custom dataset!
but i can get good results by choosing the right parameters!

Could you share some experience? e.g., how to choose the parameter? or which parameter affects most?

Has anyone met the problem that the loss close to -1 at the beginning of training? BTW, the training data is not sourced from traditional classification data like Imagenet or cifar.

Yes! Especially for parameters that differ from the ones given in the paper!

Interesting! So SimSiam is very sensitive to certain parameters right? What hyperparameter did you change ?

Checkout Fig.2 in the paper and track the channel std!

What's with the channel std?

Has anyone met the problem that the loss close to -1 at the beginning of training? BTW, the training data is not sourced from traditional classification data like Imagenet or cifar.

Yes! Especially for parameters that differ from the ones given in the paper!

Interesting! So SimSiam is very sensitive to certain parameters right? What hyperparameter did you change ?

Checkout Fig.2 in the paper and track the channel std!

What's with the channel std?


Quarto formatting not applied in README

(works on the website though)

Yeah, I am aware of this, but not sure what to do here.
The only option I can think of is what I am doing in kittyR package:
Have README.md and index.md and knit the latter to HTML.

Not sure either, but you're aware of this problem so I'll close this (just wanted to mention in case you didn't notice)

Let's keep it open.
A lot of people might be landing on the README instead of the website, so definitely worth fixing sooner than later.
I will try to see what I can do.

Using gfm format fixed this.


Implement i18n solution with Japanese translation sample

Description
This is an i18n solution & language-selection dropdown in navbar with Japanese translation sample.
Language-selection dropdown in navbar
Add a select menu to the navbar using react-select and react-country-flag libraries.
I18n solution
Based on the official Gatsby i18n example, we have implemented a page-by-page translation function using mdx files and a sentence-by-sentence translation function using [LANG].json files.
Using mdx based i18n
Prepare a translation file in the form of [FILENAME].[LANG].mdx under the src/missions folder.
Using  json based i18n
Prepare a translation file in the form of [LANG].json under the src/config/translations folder.
eg.)
ja.json:
{
    "subtitle": "モダンな方法で<Highlight>ブロックチェーンを学ぼう</Highlight>",
    "beta": "ベータ版",
    "feedback": "フィードバック",
    "contribute": "貢献する",
    "index_title": "CryptoDappyでブロックチェーンを学ぼう",
    ...
}

To use the translated text in the page, use the useTranslations component.
index.js:
import * as React from "react"
import useTranslations from "../components/useTranslations"

const IndexPage = () => {
  const { index_title } = useTranslations

  return (
    ...

{index_title}

    ...
  )
}

Localized Link & Navigate
Links in the site will be converted into pages according to the current selected language using the LocalizedLink and ocalizedNavigate components.
navbar.js:
<NavLink>
  <Dappy src={`${config.ASSETS_URL}/images/Dappy${i + 1}.png`} />
  <LocalizedLink to={m.link}>{m.name}</LocalizedLink >
</NavLink>

<Button onClick={() => localizedNavigate('/contribute', lang)}>Contribute</Button>

Edit i18n options
To add or change a language setting, edit config/i18n.js.
module.exports = {
  defaultLang: 'en',
  langs:{
    en: {
      path: `en`,
      name: 'English',
      countryCode: 'GB',
    },
    vn: {
      path: `vn`,
      name: 'Tiếng Việt',
      countryCode: 'VN',
    },
    ja: {
      path: `ja`,
      name: '日本語',
      countryCode: 'JP',
    },
  }
}

Japanese translation
Our team has created additional Japanese translation files for these.

contribute.ja.mdx
FAQ.ja.mdx
mission-[1-6].ja.mdx
onboarding.ja.mdx
overview.ja.mdx
resources.ja.mdx
ja.json

Json ranslation with HTML tag/React component
Our team has implemented an additional function that allows you to use html tags and React components in the translated text in [LANG].json.
eg.)
en.json:
{
    ...
    "subtitle": "The modern way to <Highlight>learn blockchain</Highlight>",
    ...
    "index_p1": "CryptoDappy is a mission-based online course directed at developers who want to get started learning blockchain development.",
}

index.js:
import useTranslations from "../components/useTranslations"
import parse from 'html-react-parser';

const IndexPage = () => {
  const {index_p1} = useTranslations()
  ...
  return (
    ...

{parse(index_p1)}

    ...
  )
}

header.js:
import useTranslations from "./useTranslations"
import parse, { domToReact } from 'html-react-parser';

export default function Header() {
  const { subtitle } = useTranslations()
  const replace = (node) => {
    if(node.type ==="tag" && node.name === "highlight"){ return <Highlight>{ domToReact(node.children) }</Highlight> }
  }

  return (
    ...
    <SubTitle>{parse(subtitle, { replace })}</SubTitle>
    ...
  )
}

const Highlight = styled.span`
  color: yellow;
  word-break: break-all;
`

Translation fallback
Our team has added the ability to fall back to the default language (en) if there is no corresponding translation in the mdx file or [LANG].json for each language.
Mdx fallback example
In case of privacy.en.mdx and imprint.en.mdx do not exist.
src
└── missions
    ├── mission-1.ja.mdx
    ├── mission-1.mdx
...
    ├── privacy.mdx
    └── imprint.mdx

Mapping of URL paths to mdx files

https://www.cryptodappy.com/missions/mission-1 -> mission-1.mdx
https://www.cryptodappy.com/ja/missions/mission-1 -> mission-1.ja.mdx
https://www.cryptodappy.com/privacy -> privacy.mdx
https://www.cryptodappy.com/ja/privacy -> privacy.mdx
https://www.cryptodappy.com/imprint -> imprint.mdx
https://www.cryptodappy.com/ja/imprint -> imprint.mdx

Json fallback example
In case of the {title} key is present in en.json but not in ja.json.
en.json:
{
    "title": "<Highlight>Crypto</Highlight>Dappy",
    "subtitle": "The modern way to <Highlight>learn blockchain</Highlight>",
    ...
}

ja.json:
{
    "subtitle": "モダンな方法で<Highlight>ブロックチェーンを学ぼう</Highlight>",
    ...
}

The value of the {title} key always refers to the value of title in en.json.

Hey @knagato, after FLIP Fest has finished, I just merged your other PR into Crypto-Dappy Learning Hub (react I18n). This PR here is now obsolete, correct?

@bebner thank you for merging the PR. Yes, this PR is no longer needed. I'm closing.


can't make a Debug build with v22.12

with v22.12 the command:
python Scripts/installExternals.py --build-variant=Debug ExternalDir
has lots of make fails ( with OIIO, USD )
I'm on Windows 10. Working from a clean repo.
on 22.11, I was able to make the Debug build easily.

I just did a debug build of the externals. Clean clone and clean build, and it built successfully.
Could you post the errors you got from the build? There should be a log.txt file created by the script when the build fails. You can just attach the log file.  Thanks.

Thanks for your reply, I'm currently still using 22.11 and it works correctly.
If I need to updated later to 22.12, I'll create a new ticket with more details: log and errors from build.
In the meantime, I'm closing this issue.


⚠ Bofrost.be has degraded performance

In 058d10f, Bofrost.be (https://www.bofrost.be) experienced degraded performance:

HTTP code: 200
Response time: 930 ms

Resolved: Bofrost.be performance has improved in 656d478.


gitlab

Title
Dataset URL - here
Does the dataset exists in a scraped format ?   No
URL if Yes - here
Description
Gitlab, like github, but not in bigquery
Procedure

[ ] Scrape the website
[ ] Formulate appropriate filters if at all we want to.
[ ] Processing and formatting.
[ ] lm_dataformat Processing

https://docs.gitlab.com/ee/api/
it has an API available, and includes diffs: https://docs.gitlab.com/ee/api/commits.html#get-the-diff-of-a-commit

Is anyone working on this?
Currently started working on it.
Using the (https://python-gitlab.readthedocs.io/en/v3.9.0/index.html) API for this. It's a python wrapper on the official Gitlab API.
Presently Ongoing:
At present running a preliminary python script which will provides us 89 keys of all public repositories and save them all as CSV. It might take some time as there are a lot of repositories on Gitlab.
(Ran a preliminary test on 20 repositories to see if this works. Passed but found an issue. The API call doesn't always return 89 keys. Sometimes some keys are missing. This is a limitation of the gl.projects.list() call. This will not be a limitation in the final script. As we will be using  gl.projects.get() then as we will have all the gitlab project ids.)
Gameplan after acquiring the preliminary CSV:
We believe this will help us filter out public repositories with low star_counts much in the nature of (https://github.com/EleutherAI/github-downloader) by setting a certain threshold.
After Having done that we can use the python-gitlab API along with gitlab project ids of relevant repositories from the csvs to collect, diff-of-a-commit  commits, issues and notes.
Would appreciate your feedback on this, @dmahan93  @ncoop57 .....

@imr555 Looks awesome! Thank you for contributing!! The game plan makes sense, especially filtering by stars, though I don't think we should set this too high, maybe keep repos that are > 2 stars. We should also filter based on license type, which might require checking the LICENSE file and parsing it as it doesn't look like there are any keys with that info :(
Does this python library use an API key to make calls? If so, we need to catalog how many requests we can make in a set interval so we don't get blocked

@ncoop57
Yeah. I haven't still started on the game plan yet.
We can start on the star_count filtration once we have the CSV.
I just called the gl.projects.list() API which claims that they can return all public repos under a certain Authentication Key. I am using the authentication key created on permissions on Gitlab based on this (https://docs.gitlab.com/ee/user/profile/personal_access_tokens.html#personal-access-token-scopes).
(But according to the official Gitlab API documentation the limit of the request should be around 50000 pages or 2500000 repos if we count 50 repos per page.) (I have the script running on an instance I have access to. Let's see how it goes).
And of course, LICENSE  details are important. I will start working on that once I get the csv..
(For licensing and star_count I will try to get those working on the 20 small test csv for tests.)
On discord, my name's Ifty if you want to ask me anything there.

Feel free to open an PR with your current script (make sure not to include your API key :) ) . That way ppl can easily contribute before the working branch gets too far away from your local code.

Thank You. I will open a PR on the working branch then.

@ncoop57
I will open a PR by the end of today.
Just updating on a few facts before that.
It seems the python-gitlab API does not do well at scale. It can only process 400 requests per minute.
So, hacked together a solution using some popular concurrent python libraries like async and aiohttp. (Sidenote: Don't know if Javascript or Rust might be better suited for this. Not well versed in them so took the Python route)
So, the hacked solution manages to perform around give or take 18000 requests per minute concurrently. (Sidenote: Apparently, there seems to be no limit to the number of requests to the Official Gitlab API. Other than the fact that, it can only take 1000 requests concurrently. Hence the 18000 cap we haven't been able to break
At, present, I am saving the details of each repository(project) based on the list of 89 keys in this post,
https://github.com/CarperAI/Code-Pile/issues/4#issuecomment-1253481991
as individual json files. (Helps keep it resumable and there are some endline issues if we initially save them into a csv.)
We can create a csv by concatenating all the jsons once the script finishes running. (After that, we will have all the valid project ids. With can then start filtering them based on requirements like licenses and start count.)

@ncoop57
Last update before Actually uploading the script.
You were right. There seems a limitation for gitlab requests like gitlab allows one to perform at most 2000 requests per minute.. So It might be good if we can get multiple private tokens and run it from different machines.
To scale it.

@imr555 makes sense, could you also set a cool down to your script that does like 90% of allowed requests and then waits the necessary timeout before restarting?

@ncoop57
Cool idea.
We added that. In case of async. It's actually quite simple... If we add async.time(29). It performs a thousands requests per half minute(29 seconds wait, 1 second for request and processing), it seems. So we manage to get 2000 requests per minute to happen. We will update this once ours post processing takes more time
We are still collecting the names of the high star githubs.
Once we are done we can use the scripts to download the necessary data.

@imr555  do you have any update on this? May I can take some help if you need.

@ncoop57  @PhungVanDuy  So we ran the gitlab script. It captured base info of the 38 keys mentioned in https://github.com/CarperAI/Code-Pile/issues/4#issuecomment-1253481991.
There are around 694400 public repos, it seems. The script searched among 8353643 repos it seems.According to the repos , it seems there are no more repos after that.
So, we think we can move forward with gathering what is required from those repos. Please let us know what we should download from each repo. Thanks.

I think it is code/license files if we have from the repo, also Gitlab Diff like this issue (https://github.com/CarperAI/Code-Pile/issues/31). @ncoop57 please consider this one and my bitbucket data at https://github.com/CarperAI/Code-Pile/issues/5#issuecomment-1264563142.

@ncoop57 @PhungVanDuy So we ran the gitlab script. It captured base info of the 38 keys mentioned in #4 (comment).
There are around 694400 public repos, it seems. The script searched among 8353643 repos it seems.According to the repos , it seems there are no more repos after that.
So, we think we can move forward with gathering what is required from those repos. Please let us know what we should download from each repo. Thanks.

great progress, thank you so much. Can you share your script as well?

Yeah sure. @PhungVanDuy
I can give you a rundown if necessary.
Apologies, I totally forgot the Discord Message.
Apparently they didn't let me upload it as .py file so I zipped it.
gitlab_scr_pagi_E_R.zip
Also, lemme know If I should upload the repo details somewhere. It's around 2.9GB. I saved the details as jsons for each repo. (Easy to convert to a csv if needed.)
Best regards :)

@imr555 thank you so much for this!! For the repo details, please upload them to s3 or if you don't have access to s3, maybe gdrive and @PhungVanDuy can move it to s3 once he gets permission.
Uh weird that you can't upload your script. What is the issue you are getting trying to push the file? I'd like to have this work as a PR when you get a chance and some unit tests and dummy data to evaluate the script against for reproducibility. If you open a PR, I can review and help contribute to it.

@ncoop57 ,
I will open a PR and push the script then. With a few  dummy tests as you said.
And Actually I am ok the road for the next two days. Some personal stuff. So I don't have access to my laptop. I will upload the data and open a PR after I am back.

@ncoop57  @PhungVanDuy
Link:
https://drive.google.com/drive/folders/1j9MC0dbmP0oE1rrefzF7ULEMw9OoG9Pu?usp=sharing
The data.zip folder in the link contains the repo details of each public repo.
gitlab_scr_pagi.py  was the script used to generate the data. The code's a bit of a mess. I will refactor it and send a PR.
By the way, if you guys need help on anything else or any other data sources(issues), please let me know.
Have a great day.
:)

@ncoop57 @PhungVanDuy
Link: https://drive.google.com/drive/folders/1j9MC0dbmP0oE1rrefzF7ULEMw9OoG9Pu?usp=sharing
The data.zip folder in the link contains the repo details of each public repo.
gitlab_scr_pagi.py was the script used to generate the data. The code's a bit of a mess. I will refactor it and send a PR.
By the way, if you guys need help on anything else or any other data sources(issues), please let me know. Have a great day. :)

Great! I will check it.

I made some progress on this today.

I filtered the data in the data.zip provided above to get all repos with 2 or more stars. This ends up being about 10000 rows.
I found this endpoint (https://docs.gitlab.com/ee/api/projects.html#get-single-project) which allows you to pull down individual license information for a file. There are 2397 repos on gitlab with 2 or more stars that are permissively licensed.
I then downloaded about a tenth of these to my local machine to test that cloning is working as expected.

Tomorrow I plan to implement the processing of the individual cloned repos into at least a parquet file. I'm going to rip the process from https://github.com/EleutherAI/github-downloader/blob/master/download_repo_text.py very likely, but will probably avoid multithreading as the amount of data here is relatively small.
Showing my work
import json
import os
import requests
import pandas as pd
import shutil

repos = []
for root, dirs, files in os.walk("data"):
    for repo_filename in files:
        with open("data/" + repo_filename, "r") as f:
            repo = json.loads(f.read())
            if (repo["star_count"] > 1):
                repos.append({"id": repo["id"],
                              "path_with_namespace": repo["path_with_namespace"],
                              "http_url_to_repo": repo["http_url_to_repo"],
                              "star_count": repo["star_count"],
                              "visibility": repo["visibility"]})

repos_df = pd.DataFrame(repos)
repos_df.to_csv("all_repos.csv")

def get_gitlab_project_license(project_id):
    try:
        response = requests.get("https://gitlab.com/api/v4/projects/" + str(project_id), params = {"license": True}).json()
        if ("license" in response.keys() and response["license"] is not None):
            return response["license"]["name"]
    except:
        return None
    return None

licensed_repos = []
failed_repos = []
for repo in repos:
    license = get_gitlab_project_license(repo["id"])
    if license:
        repo["license"] = license
        licensed_repos += [repo]
    else:
        failed_repos += [repo]

licensed_repos_df = pd.DataFrame(licensed_repos)
licensed_repos_df.to_csv("licensed_repos.csv")

failed_repos_df = pd.DataFrame(failed_repos)
failed_repos_df.to_csv("failed_repos.csv")

license_allowlist = set(["MIT License",
                         "Apache License 2.0",
                         "BSD 3-Clause \"New\" or \"Revised\" License",
                         "Mozilla Public License 2.0",
                         "BSD 2-Clause \"Simplified\" License",
                         "ISC License",
                         "The Unlicense",
                         "Creative Commons Zero v1.0 Universal",
                         "Eclipse Public License 1.0",
                         "Artistic License 2.0",
                         "BSD 3-Clause Clear License"])

permissively_licensed_repos = licensed_repos_df[licensed_repos_df["license"].isin(license_allowlist)]
permissively_licensed_repos.to_csv("permissively_licensed_repos.csv")

if 'output' not in os.listdir():
    os.makedirs('output')

def download_gitlab_repo(repo):
    file_name = repo["path_with_namespace"].split("/")[-1]
    if file_name not in os.listdir("output/"):
        os.system(f'git clone --depth 1 --single-branch {repo["http_url_to_repo"]} output/{file_name}')
        shutil.rmtree(f'output/{file_name}/.git', ignore_errors=True)
    else:
        print(f'Already downloaded {repo["http_url_to_repo"]}')

for index, repo in permissively_licensed_repos.iterrows():
    download_gitlab_repo(repo)

Two files uploaded directly to github. one is all repos with 2 or more stars (all_repos.csv) and one that is all permissively licensed repos with 2 or more stars (permissively_licensed_repos.csv).
permissively_licensed_repos.csv
all_repos.csv

I made some progress on this today.

I filtered the data in the data.zip provided above to get all repos with 2 or more stars. This ends up being about 10000 rows.
I found this endpoint (https://docs.gitlab.com/ee/api/projects.html#get-single-project) which allows you to pull down individual license information for a file. There are 2397 repos on gitlab with 2 or more stars that are permissively licensed.
I then downloaded about a tenth of these to my local machine to test that cloning is working as expected.

Tomorrow I plan to implement the processing of the individual cloned repos into at least a parquet file. I'm going to rip the process from https://github.com/EleutherAI/github-downloader/blob/master/download_repo_text.py very likely, but will probably avoid multithreading as the amount of data here is relatively small.
Showing my work
import json
import os
import requests
import pandas as pd
import shutil

repos = []
for root, dirs, files in os.walk("data"):
    for repo_filename in files:
        with open("data/" + repo_filename, "r") as f:
            repo = json.loads(f.read())
            if (repo["star_count"] > 1):
                repos.append({"id": repo["id"],
                              "path_with_namespace": repo["path_with_namespace"],
                              "http_url_to_repo": repo["http_url_to_repo"],
                              "star_count": repo["star_count"],
                              "visibility": repo["visibility"]})

repos_df = pd.DataFrame(repos)
repos_df.to_csv("all_repos.csv")

def get_gitlab_project_license(project_id):
    try:
        response = requests.get("https://gitlab.com/api/v4/projects/" + str(project_id), params = {"license": True}).json()
        if ("license" in response.keys() and response["license"] is not None):
            return response["license"]["name"]
    except:
        return None
    return None

licensed_repos = []
failed_repos = []
for repo in repos:
    license = get_gitlab_project_license(repo["id"])
    if license:
        repo["license"] = license
        licensed_repos += [repo]
    else:
        failed_repos += [repo]

licensed_repos_df = pd.DataFrame(licensed_repos)
licensed_repos_df.to_csv("licensed_repos.csv")

failed_repos_df = pd.DataFrame(failed_repos)
failed_repos_df.to_csv("failed_repos.csv")

license_allowlist = set(["MIT License",
                         "Apache License 2.0",
                         "BSD 3-Clause \"New\" or \"Revised\" License",
                         "Mozilla Public License 2.0",
                         "BSD 2-Clause \"Simplified\" License",
                         "ISC License",
                         "The Unlicense",
                         "Creative Commons Zero v1.0 Universal",
                         "Eclipse Public License 1.0",
                         "Artistic License 2.0",
                         "BSD 3-Clause Clear License"])

permissively_licensed_repos = licensed_repos_df[licensed_repos_df["license"].isin(license_allowlist)]
permissively_licensed_repos.to_csv("permissively_licensed_repos.csv")

if 'output' not in os.listdir():
    os.makedirs('output')

def download_gitlab_repo(repo):
    file_name = repo["path_with_namespace"].split("/")[-1]
    if file_name not in os.listdir("output/"):
        os.system(f'git clone --depth 1 --single-branch {repo["http_url_to_repo"]} output/{file_name}')
        shutil.rmtree(f'output/{file_name}/.git', ignore_errors=True)
    else:
        print(f'Already downloaded {repo["http_url_to_repo"]}')

for index, repo in permissively_licensed_repos.iterrows():
    download_gitlab_repo(repo)

Two files uploaded directly to github. one is all repos with 2 or more stars (all_repos.csv) and one that is all permissively licensed repos with 2 or more stars (permissively_licensed_repos.csv).
permissively_licensed_repos.csv all_repos.csv

It looks great! Do you have any problem with the limitation of Gitlab API?
Let me know if you need any help from us e.g. when you run batch download we can setup on our server.
Thank you so much for your work.

Gitlab API was slow but the order of magnitude of the data is small enough to make it work.
Happy to help, this is an incredible project!

permissively_licensed_repos.csv is all repos with 2 or greater stars. there are very few repos with 2 or greater stars!

permissively_licensed_repos.csv is all repos with 2 or greater stars. there are very few repos with 2 or greater stars!

Can you try to run on all repos dont care about stars, Gitlab quite different comapre with Github.

Yeah I can set that up tonight.

@CamdenClark  , First of all I want to say that exceptionally good work on finding the license and filtering the repos
As @PhungVanDuy  said, it would be great if you could download all repos regardless of stars.
I believe @ncoop57  told me to do that too. As Gitlab is very much different from Github.
Like, it would be great if you would able to download , commited code, code diffs, issues and repo branches from the links in the single endpoint. I believe the links for issues, code diffs, commits can be found in the metadata for each repo or project as they are called in Gitlab.

Thanks all! I refactored my script that scrapes all the gitlab repo license info to use aiohttp which makes it possible to do within 24 hours I think. I will run the script today to do so.
Today I plan to organize these into real scripts that we could run sequentially, and scrape the issue data along with the repo code itself.
I'm wondering specifically what commit and diff data we are looking for. Do we want the text content of each diff or just commit messages?
Note: I haven't started on integrating this into the framework that you have for downloading, I need to spend more time figuring out how that works.

so I was looking into getting all diffs from Gitlab as well, I think API calls are the wrong way to go about this.
Let's say there are about 300k repositories with permissive licensing, and each repository has on average 10 commits (pretty conservative).
That means we need to do
1 API call to list commits and 10 to get the diff of each commit.
That results in ~3M api calls for each repository.
That's about 3 days just to pull each diff. And we don't get the individual content of each file before and after the commit--that's just the visual diff that's shown. So we can't get the individual content of each file without extra processing.
--
I suggest the path forward being cloning the repositories with the main branch git history (git clone --single-branch), and using local git commands in a script to get the individual file content. I think this will be much faster and will allow us to be a better citizen and not overload gitlab's API with requests.
Thoughts? I'll have a prototype tomorrow.

Circling back, any updates @CamdenClark, @imr555  ?

Honk honk (we are addicted to geese memes at Carper) y'all, thanks so much for such great work! @imr555 @CamdenClark could y'all work on a PR for getting the code from the latest commit as @reshinthadithyan discussed for now? We are pushing up against a deadline and wanna make sure we get this data source in.

Yes I can! I am off work today and the next so can have something to pull together.

awesome!!! 😎


ReferenceError: int is not defined

this line triggers the runtime error (in the title):
var a:Object = { a: int, b:int, c:int, d:int };

Obviously javascript doesn't have int or uint.
Maybe the the compiler could replace int and uint by Number in such case ?
In other cases int is just get trimmed out normally.

Just a quick update...
I have a proposed solution (which covers a number of general cases beyond the issue highlighted here) that also addresses this issue.
These assertions pass with the related code updates in the compiler and the framework:
https://github.com/apache/royale-asjs/blob/improvements/Language/manualtests/UnitTests/src/main/royale/flexUnitTests/github/GithubIssues2018.as#L56
This is in a separate branch at the time of posting this comment. I'll review it with others and hopefully it will make it into a future release.

Fixed and merged into develop


How to export contents form google sites of google apps?

How to export contents form google sites of google apps?
like this
https://sites.google.com/a/st.thsh.tp.edu.tw/xxxxxxxx/

Ok,I found the method to export form google sites of google apps.
http://i.imgur.com/M06fKRb.png

May I use this image in README for #117 ?
Or you can add it in img directory by a new pull request if you want.

No problem


Issue with extendingTensorFlow Tutorial #20

I am trying to implement your TensorFlow Tutorial 20 . I have a huge dataset approx 2.5GB . Now in your code x_train_text, y_train = imdb.load_data(train=True) in this line I understand that you are trying to load whole train data in memory which I cant do as I will run out of memory. So I was trying to create TF-Records for the same by combining your tutorial TensorFlow Tutorial 18  Can you please take a look at my code
I have three text files A.txt, B.txt,C.txt the labels are A,B and C
def convert(file_paths, labels, out_path):

    print("Converting: " + out_path)

    # Number of images. Used when printing the progress.
    num_files = len(file_paths)

    # Open a TFRecordWriter for the output-file.
   with tf.python_io.TFRecordWriter(out_path) as writer:

    # Iterate over all the image-paths and class-labels.
    for i, (path, label) in enumerate(zip(file_paths, labels)):
           # Print the percentage-progress.
           print_progress(count=i, total=num_files - 1)

           lines=getModifiedLines(path)

          # Create a dict with the data we want to save in the
          # TFRecords file. You can add more relevant data here.
          data = \
              {
                  'text': wrap_int64(lines),
                  'label': wrap_int64(label)
              }

          # Wrap the data as TensorFlow Features.
          feature = tf.train.Features(feature=data)

          # Wrap again as a TensorFlow Example.
          example = tf.train.Example(features=feature)

          # Serialize the data.
          serialized = example.SerializeToString()
          writer.write(serialized)

def getModifiedLines(filePath):
    data = open(filePath, 'r', encoding='UTF8', errors='ignore').read()
    lines = re.split("\n", data)
    all_lines=[]
    for line in lines:
      _l=count_vect.fit_transform(line)
      all_lines.append(_l)

return all_lines

I am getting error at line 'text': wrap_int64(lines),

Error
`[<12071x21108 sparse matrix of type '<class 'numpy.int64'>'
with 226655 stored elements in Compressed Sparse Row format>] has type
<class 'list'>, but expected one of: (<class 'int'>,)``

I do not give support for people who try and customize the tutorials. I could spend the rest of my life doing that. This was stated clearly in the text you deleted before posting your issue:

Questions about modifications or how to use these tutorials on your own data-set should also be asked on StackOverflow. Thousands of people are using these tutorials. It is impossible for me to give individual support for your project.

If your data-set is only 2.5 GB then it should be able to fit into most modern machines' RAM. If you have less than 8 GB then you have too little RAM anyway and you need to upgrade. You probably should have at least 16 GB of RAM.


Updates for latest OpenMC version

OpenMC have updated how sources are handled, so this source should be updated to align with that:

Abstract base class name has changed to Source.
Source is now managed by the CustomSourceWrapper.
Sampling is done by a const method.
The path to the source library and the representation of the parameters are given as strings, rather than XML elements
It should be possible to remove pugixml as a dependency.

when you pr this, im busy making a system to better find openmc, I was still using the master branch - totally forgotten that it changed - and im finding that it works better than this brnach

Thanks for the note @makeclean - I think I'll hold off on a PR for this until #16 is merged as they touch on a few common points. I suspect the master branch doesn't have some of the python packaging that has been worked on (and hopefully now fixed under #16), so the CMakeLists.txt is probably a bit simpler because of that.


The exact "apllies to" product is "Azure Synapse Analytics (dedicated SQL pool (formerly SQL DW) only)" refer to  https://learn.microsoft.com/en-us/azure/azure-sql/database/connectivity-architecture?toc=%2Fazure%2Fsynapse-analytics%2Fsql-data-warehouse%2Ftoc.json&view=azuresql

[Enter feedback here]

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: ebc22d6d-6411-8b1f-6b0c-df0c6c0d4f41
Version Independent ID: f34d4fa8-dc18-d2bb-a42f-bdea4329b118
Content: Customer-managed transparent data encryption (TDE) - Azure SQL Database & Azure SQL Managed Instance & Azure Synapse Analytics
Content Source: azure-sql/database/transparent-data-encryption-byok-overview.md
Service: sql-db-mi
Sub-service: security
GitHub Login: @GithubMirek
Microsoft Alias: mireks

Hi @jiaqhuan ,
Thanks for raising the feedback. We request you to share more information with the feedback details so that we can work on it.

Hi @jiaqhuan ,
We request you to share more information with the feedback details so that we can work on it. Thanks

Hi @jiaqhuan ,
We request you to share more information with the feedback details so that we can work on it. Thanks

Hi @jiaqhuan ,
I am closing this thread since we need more information on the feedback.
Please re-open when you ae able to add your feedback, thank you.


proposal: spec: len(a)/cap(a) should be constant if a's type is a type parameter constrained by arrays of the same length

Proposal Details
The code
func _[A C](a A) {
   const _ = len(a) // or cap(a)
}

should be valid if the constraint C describes a type set containing only (pointer to) arrays and all arrays have the same length. Currently, the length and capacity of a type parameter value are always non-constant. Either way, the type is defined to be int per the spec. An int constant value can be used wherever an int non-constant value is permitted. Thus, this change is strictly backward-compatible; it simply increases the set of valid programs.
See also #50226.

Thus, this change is strictly backward-compatible; it simply increases the set of valid programs.

I believe this is a counter-example that would stop type-checking with this change:
func F[T *[0]int](x T) {
	switch 0 {
	case 0:
	case len(x):
	}
}

If we want to be strictly backwards-compatible, I think this semantic change needs to be tied to the language version like for loops.

Bit-shift 1 << len(a) is also a blocker.

@mdempsky Indeed. Seems pretty esoteric, but it would break such code. Maybe not worth making this change.
(More generally, the same spec trick can be used for any similar language change where we might go from a variable value to a constant value.)

Similar to https://github.com/golang/go/issues/28591

Honestly speaking, the change is quite small comparing to the loop var change.

Since the change is not backwards compatible, it seems like we should leave things as they are.

Retracting.


feat: add basic command

Current dependencies on/for this PR:

main

PR #2   👈

This comment was auto-generated by Graphite.


chore(*): upgrade concerto-metamodel

Description
Upgrade concerto-metamodel to v3.9.0
Author Checklist

[x] Ensure you provide a DCO sign-off for your commits using the --signoff option of git commit.
[ ] Vital features and changes captured in unit and/or integration tests
[x] Commits messages follow AP format
[ ] Extend the documentation, if necessary
[ ] Merging to main from fork:branchname

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 100.0%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
202

Relevant Lines:
202

💛  - Coveralls


I getting error on running flutter application...

The error I was getting:
Finished with error: ProcessException: Process "D:\Projects\FlutterAndroidProjects\Calculator\calculator\android\gradlew.bat" exited abnormally:
Unzipping C:\Users\Muhammad_Kamran.gradle\wrapper\dists\gradle-4.10.2-all\9fahxiiecdb76a5g3aw9oi8rv\gradle-4.10.2-all.zip to C:\Users\Muhammad_Kamran.gradle\wrapper\dists\gradle-4.10.2-all\9fahxiiecdb76a5g3aw9oi8rv
Exception in thread "main" java.util.zip.ZipException: error in opening zip file
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.(ZipFile.java:225)
at java.util.zip.ZipFile.(ZipFile.java:155)
at java.util.zip.ZipFile.(ZipFile.java:169)
at org.gradle.wrapper.Install.unzip(Install.java:214)
at org.gradle.wrapper.Install.access$600(Install.java:27)
at org.gradle.wrapper.Install$1.call(Install.java:74)
at org.gradle.wrapper.Install$1.call(Install.java:48)
at org.gradle.wrapper.ExclusiveFileAccessManager.access(ExclusiveFileAccessManager.java:65)
at org.gradle.wrapper.Install.createDist(Install.java:48)
at org.gradle.wrapper.WrapperExecutor.execute(WrapperExecutor.java:128)
at org.gradle.wrapper.GradleWrapperMain.main(GradleWrapperMain.java:61)
Command: D:\Projects\FlutterAndroidProjects\Calculator\calculator\android\gradlew.bat -v

What is your ide

What is your ide

Android Studio

Hi @kamikhalid075
can you please provide your flutter doctor -v
and your flutter run --verbose?
Thank you

Hi, @iapicca
flutter doctor -v : "Flutter (Channel stable, v1.9.1+hotfix.6, on Microsoft Windows [Version 10.0.18363.535], locale en-PK)"
flutter run --verbose : it showing an error...
"Error: No pubspec.yaml file found.
This command should be run from the root of your Flutter project.
Do not run this command from the root of your git clone of Flutter."
#0      FlutterCommand.validateCommand (package:flutter_tools/src/runner/flutter_command.dart:568:9)

#1      RunCommand.validateCommand (package:flutter_tools/src/commands/run.dart:278:19)

#2      FlutterCommand.verifyThenRunCommand (package:flutter_tools/src/runner/flutter_command.dart:465:11)

#3      FlutterCommand.run. (package:flutter_tools/src/runner/flutter_command.dart:407:33)

#4      AppContext.run. (package:flutter_tools/src/base/context.dart:154:29)

#5      _rootRun (dart:async/zone.dart:1124:13)
#6      _CustomZone.run (dart:async/zone.dart:1021:19)
#7      _runZoned (dart:async/zone.dart:1516:10)
#8      runZoned (dart:async/zone.dart:1463:12)
#9      AppContext.run (package:flutter_tools/src/base/context.dart:153:18)

#10     FlutterCommand.run (package:flutter_tools/src/runner/flutter_command.dart:397:20)
#11     CommandRunner.runCommand (package:args/command_runner.dart:197:27)

#12     FlutterCommandRunner.runCommand.
(package:flutter_tools/src/runner/flutter_command_runner.dart:402:21)

#13     AppContext.run. (package:flutter_tools/src/base/context.dart:154:29)

#14     _rootRun (dart:async/zone.dart:1124:13)
#15     _CustomZone.run (dart:async/zone.dart:1021:19)
#16     _runZoned (dart:async/zone.dart:1516:10)
#17     runZoned (dart:async/zone.dart:1463:12)
#18     AppContext.run (package:flutter_tools/src/base/context.dart:153:18)

#19     FlutterCommandRunner.runCommand (package:flutter_tools/src/runner/flutter_command_runner.dart:356:19)

#20     CommandRunner.run. (package:args/command_runner.dart:112:25)
#21     new Future.sync (dart:async/future.dart:224:31)
#22     CommandRunner.run (package:args/command_runner.dart:112:14)
#23     FlutterCommandRunner.run (package:flutter_tools/src/runner/flutter_command_runner.dart:242:18)
#24     run.. (package:flutter_tools/runner.dart:63:22)

#25     _rootRun (dart:async/zone.dart:1124:13)
#26     _CustomZone.run (dart:async/zone.dart:1021:19)
#27     _runZoned (dart:async/zone.dart:1516:10)
#28     runZoned (dart:async/zone.dart:1500:12)
#29     run. (package:flutter_tools/runner.dart:61:18)

#30     AppContext.run. (package:flutter_tools/src/base/context.dart:154:29)

#31     _rootRun (dart:async/zone.dart:1124:13)
#32     _CustomZone.run (dart:async/zone.dart:1021:19)
#33     _runZoned (dart:async/zone.dart:1516:10)
#34     runZoned (dart:async/zone.dart:1463:12)
#35     AppContext.run (package:flutter_tools/src/base/context.dart:153:18)

#36     runInContext (package:flutter_tools/src/context_runner.dart:59:24)

#37     run (package:flutter_tools/runner.dart:50:10)
#38     main (package:flutter_tools/executable.dart:65:9)

#39     main (file:///C:/b/s/w/ir/k/archive/flutter/packages/flutter_tools/bin/flutter_tools.dart:8:3)
#40     _startIsolate. (dart:isolate-patch/isolate_patch.dart:303:32)
#41     _RawReceivePortImpl._handleMessage (dart:isolate-patch/isolate_patch.dart:172:12)

@JonathanMonga
Hi,
I'm using Android Studio...

Hi again @kamikhalid075
"Error: No pubspec.yaml file found.
This command should be run from the root of your Flutter project.
Do not run this command from the root of your git clone of Flutter."

did you double check that you are running the command from the appìs folder?
are you getting the same running the app from terminal?
thank you

Hi again @iapicca
Yes, I have checked, getting the same error running the application from terminal...

Hi @kamikhalid075
for the issue to be workable
need to be reproducible.
Can you please provide a minimal code sample
or the steps to reproduce the problem.
Thank you

Hi @kamikhalid075
I apologize for noticing only now;
I see there's an open issue addressing the case you described.
Please follow up on that issue,
I'm closing the current one as duplicate.
If you disagree please write in the comments
and I will reopen it.
Thank you


[SMALLFIX] test change

alluxio-bot, check this please

alluxio-bot, check this please

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Alluxio-Pull-Request-Builder/15865/
Test FAILed.