Duplicate individuals management

While working with Trident to manage EIGENSTRAT packages, I found that having duplicate samples in two or more datasets really slows the workflow down: if I want to extract sample A that is present in both my packs X and Y, I have to first subset one of the two by removing all the individuals (or pops) that are in the other one, or rename them.
This basically doubles the time required, and this happens pretty often when combining and subsetting many different published datasets and private ones at once.
I guess a possible solution would be improving the trident forgeString synthax, so that one could hierarchically specify from which population/package trident should select a sample, or from which package a population should be taken.

In today's poseidon meeting @stschiff proposed a pretty interesting idea how to handle duplicates in forge, which is a little simpler than my suggestion above. Simpler also means more robust, which compensates a slide lack in elegance. I think this is worth a try, although sometimes the implementation uncovers unforeseen issues.
Imagine a user Bob who has a package X with an individual A in group P and a package Ỳ with an individual A in group P. Bob wants to forge them with a forgeString <A>. Stephan's idea now entails, that A gets renamed internally to X.P.A and Y.P.A. This renders Bob's initial forgeString invalid. He gets an error message like this: Error: <A> exists multiple times in this data selection: <X.P.A>, <Y.P.A>. Please specify!. He could then edit his forge string to either <X.P.A>,  <Y.P.A> or <X.P.A>,<Y.P.A>, to include one or both of the iterations of A. In the output the individual will not be called A any more, but X.P.A or Y.P.A. This is slightly verbose, but Bob can rename that later if he so pleases.

Yes, that summarises what I meant.
But on a much more radical note: Why not simply allow duplicate names, and then <A> would simply catch all individuals named <A>? Going back to what I said back in June: What's the harm in fully allowing duplicates in trident?
As a first step, we could simply output warnings in readPoseidonPackage, and nowhere else... I think there is no problem in any downstream step. Forge will simply go through, by selecting all individuals with that name and causing duplicate names in the forged output. When then someone reads the forged package again with some trident function, there will be a warning about duplicate individuals. The same happens in Xerxes, since it calls readPoseidonPackage... all analyses (FStats and so on) will go through as is, simply by taking in both samples if they are not renamed.
I think I'm voting for the simplest here... :-)

I do not think that it is a good idea to ignore duplicates. Allowing them causes all sorts of confusion and makes it extremely easy to arrive at wrong results. I remember multiple instances where I had forgotten a derived, forged repo below my respective -d, when compiling a new forge operation. I am now absolutely convinced that a hard rule of no duplicate PoseidonIDs in a given dataset will prevent many wrong results in the future.
I suggest the following solution:

readPoseidonPackageCollection and readPoseidonPackage fail hard by default, if any duplicates are detected
An additional command line option --allowDuplicates allows to proceed anyway
forge, fstats, and any other command where it matters will require specification with Package.Group.Individual as suggested above

This is exactly the opposite of your suggestion, but I think it is in the user's interest to not have duplicates in their dataset.

OK, I did not think of the annoying problem of having forgotten packages under -d, which has happened to me too. OK, I think you're right.
I think for the specification language thing, we need to be careful how to implement this, though. What I proposed, and what you summarised above is that duplicate individual names get renamed... but when? The naive solution would be to rename right when duplicates are observed... but then, if the user as given <A>, you wouldn't arrive at "Duplicates found ... please specify!". Rather you would get <A> not found... so implementation will need to be a bit careful in the logic and the order of checks and renamings.
Perhaps the easiest is to do the rename right within readPoseidonPackage and readPoseidonPackageCollection, but give a warning when it happens, like "found duplicate individual name 'A', renaming to 'X.P.A' and 'Y.P.A'" before giving the expected error output "Entity  not found."

Right - the implementation is not trivial. The details usually emerge when you start to change the code. This is on my list for a long time, but I don't mind if you want to tackle it. We just have to communicate it here, when one of us starts to work on it, to prevent duplication of effort.

This should finally be solved in v<IP_ADDRESS>: https://github.com/poseidon-framework/poseidon-hs/releases/tag/v<IP_ADDRESS>
I close this issue now. Please let me know if it does not enable the desired usecase, @ltcrod :+1:


PusherBatchAuthorizer is undefined and ReferenceError: Can't find variable: document #React-Native

I have try to this library on react-native, anyone suggest what is PusherBatchAuthorizer in below and how to implement in react-native
var pusher = new Pusher(API_KEY, {
    authorizer: PusherBatchAuthorizer,
    authDelay: 200
});

my code is here please suggest how can use authorizer in below code
import Pusher from 'pusher-js/react-native';
Pusher.logToConsole = true;
const token = 'xyz...';

var pusher = new Pusher('xyz', {
  authEndpoint: 'operator/v1/pusher_auth',
  cluster: 'us2',
  encrypted: true,
  auth: {
    headers: {
      'Content-Type': 'application/x-www-form-urlencoded, application/vnd.api+json',
      'Authorization': 'Bearer ' + token,
    }
  }
});

var channel = pusher.subscribe('private-abc-def-xyz-000123');
channel.bind('ticket_changed', function (data) {
  alert(JSON.stringify(data));
});

If I import as below then I am getting error that is 'ReferenceError: Can't find variable: document'
const PusherBatchAuthorizer = require('pusher-js-auth');

var pusher = new Pusher('xyz', {
  authorizer: PusherBatchAuthorizer,
  authEndpoint: 'operator/v1/pusher_auth',
  cluster: 'us2',
  encrypted: true,
  auth: {
    headers: {
      'Content-Type': 'application/x-www-form-urlencoded, application/vnd.api+json',
      'Authorization': 'Bearer ' + token,
    }
  }
});

Which version of pusher-js-auth are you using exactly ? I don't see any usage of document in the code.

Found the issue: The problem is that there is a hard-coded require to pusher-js on the code. If the runtime is react native, it should be importing from pusher-js/react-native. The document error is from inside pusher's runtime when creating xhr requests thinking it's running on the web

Found the issue: The problem is that there is a hard-coded require to pusher-js on the code. If the runtime is react native, it should be importing from pusher-js/react-native. The document error is from inside pusher's runtime when creating xhr requests thinking it's running on the web


[Device Support Request] Develco Frient ZHEMI101 Electricity meter reader

Is your feature request related to a problem? Please describe.
Device is supported but only exposes a single entity for Instantaneous measured power in Watts.
Describe the solution you'd like
Support to be added for Energy monitoring in KWh and if possible battery level
Device signature - this can be acquired by removing the device from ZHA and pairing it again from the add devices screen. Be sure to add the entire content of the log panel after pairing the device to a code block below this line.
{   "node_descriptor": "NodeDescriptor(logical_type=<LogicalType.EndDevice: 2>, complex_descriptor_available=0, user_descriptor_available=0, reserved=0, aps_flags=0, frequency_band=<FrequencyBand.0: 0>, mac_capability_flags=<MACCapabilityFlags.0: 0>, manufacturer_code=0, maximum_buffer_size=0, maximum_incoming_transfer_size=0, server_mask=0, maximum_outgoing_transfer_size=0, descriptor_capability_field=<DescriptorCapability.0: 0>, *allocate_address=False, *is_alternate_pan_coordinator=False, *is_coordinator=False, *is_end_device=True, *is_full_function_device=False, *is_mains_powered=False, *is_receiver_on_when_idle=False, *is_router=False, *is_security_capable=False)",   "endpoints": {     "1": {       "profile_id": 49353,       "device_type": "0x0001",       "in_clusters": [         "0x0002",         "0x0003",         "0x0005"       ],       "out_clusters": [         "0x0001"       ]     },     "2": {       "profile_id": 260,       "device_type": "0x0007",       "in_clusters": [         "0x0000",         "0x0003",         "0x0702"       ],       "out_clusters": [         "0x000a"       ]     }   },   "manufacturer": "Develco",   "model": "ZHEMI101",   "class": "zigpy.device.Device" }
Additional context
zigbee2mqtt appears to support energy monitoring for this device already:
https://www.zigbee2mqtt.io/devices/ZHEMI101.html
https://github.com/Koenkk/zigbee2mqtt/issues/5960
Also the OEM manufacturer has documentation on their webpage.
https://www.develcoproducts.com/products/meter-interfaces/external-meter-interface/

Likely a limitation of ZHA to be addressed by
https://github.com/home-assistant/core/pull/50471

FYI, it looks like support for more Zigbee clusters attributes is now being worked on for ZHA integration in Home Assistant core, see:
home-assistant/core#56909
and
home-assistant/core#56666
Also, note the last comment from Adminiuga in PR for ZHA in Home Assistant core -> home-assistant/core#56909
"Support for other attributes could be extended later, as I couldn't find too many devices other than Sinopé RM3250ZB Electrical Load Controller – 50A – Zigbee https://www.amazon.com/dp/B07CGJ6XH2/ reporting anything interesting on the electrical measurement cluster."
So maybe now you could try to get this working with the latest Home Assistant beta or wait for the next upcoming release:
https://www.home-assistant.io/faq/release/
PS: There is much more discussion about the current ZHA limitation of only supporting 1 sensor per cluster here -> #605 and #1045

Thanks - I've been quietly following the developments and appreciate the effort thats gone in to a comprehensive solution rather than the quick fix I had referenced - As soon as the commits end up in the RC branch I think I'll be able to close this bug as I'm not on the beta branch at the moment.

The device pairing and entity creation were successful, however both sensors do not offer units. As the customizing menu was removed, its not even easy to add correct units


Add OTTR Bioconductor image

Working on adding an OTTR bioconductor image

It's not detecting files changed properly. Not sure why.

Yay! It builds correctly. I'm going to merge and then next step is to see if it actually renders the material properly.


DataCollatorForCompletionOnlyLM not working with MPS

Hi there,
amazing work :)
I just encountered an error while trying to run the library on an Apple M3 Max. Below is a MWE to reproduce the error. The example itself doesn't make sense but at least I can consistently get the error.
from transformers import AutoModelForCausalLM, AutoTokenizer, DataCollatorForLanguageModeling
from trl import DataCollatorForCompletionOnlyLM, SFTConfig, SFTTrainer
import torch
from datasets import Dataset

if __name__ == "__main__":

    torch.set_default_device("mps")
    print(f"MPS is available: {torch.backends.mps.is_available()}.")

    train_dataset = Dataset.from_dict(
        {
            "text": [
                "This is a test~",
                "This is another test~",
            ]
        }
    )
    train_dataset.set_format('torch', device="mps")

    model_name = "microsoft/Phi-3-mini-128k-instruct"
    model = AutoModelForCausalLM.from_pretrained(
        model_name,
        trust_remote_code=True,
        device_map="mps",
    )
    model.config.use_cache = False

    tokenizer = AutoTokenizer.from_pretrained(
        model_name,
        trust_remote_code=True,
        add_eos=True,
        return_tensor="pt",
        padding=True,
    )

    tokenizer.pad_token = tokenizer.bos_token

    training_arguments = SFTConfig(
        output_dir="output",
        optim="adamw_torch",
        group_by_length=True,
        dataset_text_field="text",
        remove_unused_columns=True,
    )

    response_token_id = tokenizer.convert_tokens_to_ids("~")
    collator = DataCollatorForCompletionOnlyLM(
        response_template=[response_token_id], tokenizer=tokenizer
    )
    # collator = DataCollatorForLanguageModeling(
    #     tokenizer=tokenizer,
    #     mlm=False,
    # )

    trainer = SFTTrainer(
        model=model,
        train_dataset=train_dataset,
        tokenizer=tokenizer,
        data_collator=collator,
        args=training_arguments,
    )

    trainer.train()

Error:
TypeError: can't convert mps:0 device type tensor to numpy. Use Tensor.cpu() to copy the tensor to host memory first.

If you comment the DataCollatorForCompletionOnlyLM and use the DataCollatorForLanguageModeling it works.
Versions:
transformers==4.44.0
trl==0.9.6

Thank you very much in advance!
Best,
Giulia

Hi @giuliabaldini, thank you for reporting this issue. Can you share the output of transformers-cli env?
If can't reproduce the error locally. Instead, I get
Traceback (most recent call last):
  File "/Users/quentingallouedec/trl/trl/mps.py", line 22, in <module>
    model = AutoModelForCausalLM.from_pretrained(
  File "/usr/local/Caskroom/miniforge/base/envs/trl/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 558, in from_pretrained
    return model_class.from_pretrained(
  File "/usr/local/Caskroom/miniforge/base/envs/trl/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3677, in from_pretrained
    ) = cls._load_pretrained_model(
  File "/usr/local/Caskroom/miniforge/base/envs/trl/lib/python3.10/site-packages/transformers/modeling_utils.py", line 4104, in _load_pretrained_model
    new_error_msgs, offload_index, state_dict_index = _load_state_dict_into_meta_model(
  File "/usr/local/Caskroom/miniforge/base/envs/trl/lib/python3.10/site-packages/transformers/modeling_utils.py", line 852, in _load_state_dict_into_meta_model
    param = param.to(old_param.dtype)
  File "/usr/local/Caskroom/miniforge/base/envs/trl/lib/python3.10/site-packages/torch/utils/_device.py", line 77, in __torch_function__
    return func(*args, **kwargs)
TypeError: Trying to convert BFloat16 to the MPS backend but it does not have support for that dtype.

Hi there, thank you for the quick answer!
This is the output:
- `transformers` version: 4.44.0
- Platform: macOS-14.5-arm64-arm-64bit
- Python version: 3.11.0
- Huggingface_hub version: 0.24.5
- Safetensors version: 0.4.4
- Accelerate version: 0.33.0
- Accelerate config:    not found
- PyTorch version (GPU?): 2.4.0 (False)
- Tensorflow version (GPU?): not installed (NA)
- Flax version (CPU?/GPU?/TPU?): not installed (NA)
- Jax version: not installed
- JaxLib version: not installed
- Using distributed or parallel set-up in script?: No

About the error, what if you change it to this?
model = AutoModelForCausalLM.from_pretrained(
        model_name,
        trust_remote_code=True,
        device_map="mps",
        torch_dtype=torch.float16,
    )

Hi, I just want to clarify the status of this issue:
TRL is primarily optimized for CUDA, and while it may work on MPS, we don't officially support it at this time, nor is it a current priority. What you're encountering could indeed be a bug, but due to the reasons mentioned, it's unlikely to be resolved soon.
However, we're leaving this open to signal that TRL is open to contributions that would extend support to MPS.

Hopefully the solution below works for you. The error that I get when running this code is: RuntimeError: Placeholder storage has not been allocated on MPS device!
For me this was resolved by removing the line: torch.set_default_device("mps")
The default device before making that setting is cpu. The statement made by that setting is do everything on mps by default, and I'll specify when to use the cpu, an approach that may not align with how trl is implemented. OP and my error message make sense in this context, but qgallouedec - yours is looking more vague.
I'm on an Apple M2 Max, and I hope it works for your M3 as well. trl==0.11.1. System details below.
- `transformers` version: 4.45.0
- Platform: macOS-14.7-arm64-arm-64bit
- Python version: 3.12.0
- Huggingface_hub version: 0.25.1
- Safetensors version: 0.4.3
- Accelerate version: 0.34.1
- Accelerate config:    not found
- PyTorch version (GPU?): 2.6.0.dev20241020 (False)
- Tensorflow version (GPU?): not installed (NA)
- Flax version (CPU?/GPU?/TPU?): not installed (NA)
- Jax version: not installed
- JaxLib version: not installed

Phi 3's HF model files also have some sample code which has some extra info and settings that might help with training.


decide on what to do with /faq/ urls?

it seems like none of the FAQ urls actually display something. I rather believe that those URLs are somehow generated in the sitemap by wordpress as the FAQ is added on the about page.
I guess we can simply add the FAQ on the about page itself and ignore those urls.

Agreed.


[WIP] 4 add test data

[x]  Github action to run tests
I'm only setting up macos actions for Python 3.11 to avoid issues with macos arm machines in CI & older Python versions

[x]  Github action logic for pooch caching

[x] Github action for coverage reporting in PRs
This lets us keep better track of test coverage :)

I'm having issues with the coverage reporting. I think it's because there needs to be a baseline in main to compare to. I'll merge this PR now and open a new one to test this.
This PR as is adds the github actions to run tests, cache pooch folders & run coverage reports => doesn't influence anything happening in the task


commando-vm installation doesn't seem to complete

Hello
I am filling in using google translate.
I'm using win10 with virtualBox. The commando-vm installation doesn't seem to complete. Fill in the log for "C: \ Users \ IEUser \ AppData \ Local \ Boxstarter \ Boxstarter.log".
Also, even if I execute "cinst -y commandovm.win10.config.fireeye -f", the wallpaper will be restored when I restart.
Thank you.
boxstarter.log

Hello
1 Rebooted.
2 After restarting, the command prompt will start every time you log in automatically.
3 win10 is "17763.r5 release.180914-1434".
Thank you.

it sounds like boxstarter is caught in a loop, what happens when you let it finish?

Hello
The command prompt that appears after a reboot will close automatically. When you reboot, the command prompt will be displayed and it will close automatically.
It looks like the installation is running every time because the installation ends with an error.
Thank you.

@fzrGit I would recommend running the .\install.ps1 script again and letting it run through to completion again. You will probably see some errors along the install but I think that will clear the auto login from boxstarter

Hello
I ran install.ps with administrator privileges and rebooted, but the command prompt continues to appear after the reboot. I will attach the log.
Thank you.
boxstarter.log
PowerShell_transcript.COMMANDO.2h0MI+S1.20210211133300.txt
PowerShell_transcript.COMMANDO.5alScMGb.20210211133342.txt
PowerShell_transcript.COMMANDO.65IOVEUz.20210211133437.txt
PowerShell_transcript.COMMANDO.AK5u1r1e.20210211133440.txt
PowerShell_transcript.COMMANDO.BXLoJGES.20210211133336.txt

@fzrGit you shouldnt have to manually reboot.. Please run the install script again as administrator and let it run through to completion.
Looking through the log it looks like the auto run was not removed from the registry. Boxstarter will do that automatically if you let the install script complete

Hello
I waited for about an hour without restarting manually, but it doesn't seem to go beyond the screenshot screen.
Thank you.

Hello
I tried running cinst-y commandovm.win10.config.fireeye--force with boxstarter-post-restart.bat disabled. The background changes to the commando-vm background, but it will be restored on reboot.
Also, when I run cinst-y commandovm.win10.config.fireeye--force, the operation stops at the screenshot screen.
Thank you very much.

@fzrGit can you try running the following command?
C:\ProgramData\Boxstarter\Boxstarter.Bootstrapper\Cleanup-Boxstarter.ps1; Cleanup-Boxstarter

You will probably also have to use regedit to change the following key/value from 1 to 0:
HKLM:\Software\Microsoft\Windows NT\CurrentVersion\Winlogon\AutoAdminLogon

This looks to be a boxstarter problem, but this should fix it temporarily.. Please let me know if the issues continue

Hello
I did the method you taught me and restarted. After restarting, it became as follows.
1 You can no longer log in automatically.
2 The command prompt is no longer displayed.
After rebooting, I installed with install.ps1. It became as follows.
1 You will not be logged in automatically.
2 The command prompt is not displayed.
3 The wallpaper remains the attached image.
Thank you.

boxstarter.log

@fzrGit can you run this command?
cinst -y commandovm.win10.config.fireeye -f

If that doesnt work I would assume your trial has expired and you can run slrmgr /rearm and then run the above command again

Hello
1 The reboot will be completed automatically. The background changed after the reboot, but after about a minute it returned to the original background.
2 slmgr / rearm completed successfully.
3 I'm trying to reinstall.

Hello
I reinstalled it.
1 The command execution window was not displayed after installation.
2 The background has not changed.
It seems that it can be used.
Thank you very much.


AccumulateTest.swift fails to build in Xcode 8-Beta-6

Using Xcode 8-Beta-6, building the tests fail to build in testAccumulateRecursively() because Cannot invoke 'XCTAssertEqual' with an argument list of type '([Array<String>], [[String]])'.
I have tested many of the submitted answers as well as the example in the xswift repo and they are all failing in the same way.
There are a couple changes I needed to make to even get to this point.
First thing is that the extension(or function) needs to be declared public now or the build will fail.
The next thing is to add the _ before the parameter name so it is not required in the call.
It appears that there needs to be another extension to make [Array<String>] Equatable?  I tried, but  failed to wrap my head around it.  How do we test equality on this now?

We only support swift 2.2 at the moment. We have a swift3 branch that we will merge once xcode 8 goes out of beta

this is the reference bug: https://bugs.swift.org/browse/SR-2284
we have a work around the swift3 branch.

@masters3d ,
10-4.  I'll focus elsewhere until Xcode 8 is released.
FWIW, I was using the tests from the swift3 branch.

Oh okay. The tests are passing on the CI and locally with Xcode 8 b6
https://github.com/exercism/xswift/blob/swift3/exercises/accumulate/AccumulateTest.swift#L18-L20
PR's welcome :)

We just pushed xcode 8 GM. Let me know if you have any issues. Closing for now.


speed up information collection stage a lot

This patches help to speed up collect stage from  190s to 36 seconds.

LGTM. These patches can reduce the time of init stage which is event better for systems with a small number of cpu cores. And have you counted how many functions have been moved out?

LGTM. These patches can reduce the time of init stage which is event better for systems with a small number of cpu cores. And have you counted how many functions have been moved out?

After applying these patches, only sched_setscheduler related functions are moved out. All other files are still the same.

LGTM. These patches can reduce the time of init stage which is event better for systems with a small number of cpu cores. And have you counted how many functions have been moved out?

After applying these patches, only sched_setscheduler related functions are moved out. All other files are still the same.

Looks good!


12593 files changed, 12606 insertions(+), 5 deletions(-)

Date: Thu Nov 2 14:10:37 2017 -0700

+/* SPDX-License-Identifier: GPL-2.0+ WITH Linux-syscall-note */

commit e2be04c7f9958dde770eeb8b30e829ca969b37bb
Author: Greg Kroah-Hartman<EMAIL_ADDRESS>Date:   Wed Nov 1 15:09:13 2017 +0100
License cleanup: add SPDX license identifier to uapi header files with a license

Many user space API headers have licensing information, which is either
incomplete, badly formatted or just a shorthand for referring to the
license under which the file is supposed to be.  This makes it hard for
compliance tools to determine the correct license.

Update these files with an SPDX license identifier.  The identifier was
chosen based on the license information in the file.

GPL/LGPL licensed headers get the matching GPL/LGPL SPDX license
identifier with the added 'WITH Linux-syscall-note' exception, which is
the officially assigned exception identifier for the kernel syscall
exception:

   NOTE! This copyright does *not* cover user programs that use kernel
   services by normal system calls - this is merely considered normal use
   of the kernel, and does *not* fall under the heading of "derived work".

This exception makes it possible to include GPL headers into non GPL
code, without confusing license compliance tools.

Headers which have either explicit dual licensing or are just licensed
under a non GPL license are updated with the corresponding SPDX
identifier and the GPLv2 with syscall exception identifier.  The format
is:
        ((GPL-2.0 WITH Linux-syscall-note) OR SPDX-ID-OF-OTHER-LICENSE)

SPDX license identifiers are a legally binding shorthand, which can be
used instead of the full boiler plate text.  The update does not remove
existing license information as this has to be done on a case by case
basis and the copyright holders might have to be consulted. This will
happen in a separate step.

This patch is based on work done by Thomas Gleixner and Kate Stewart and
Philippe Ombredanne.  See the previous patch in this series for the
methodology of how this patch was researched.

Reviewed-by: Kate Stewart<EMAIL_ADDRESS>Reviewed-by: Philippe Ombredanne<EMAIL_ADDRESS>Reviewed-by: Thomas Gleixner<EMAIL_ADDRESS>Signed-off-by: Greg Kroah-Hartman<EMAIL_ADDRESS>

This patch is based on work done by Thomas Gleixner and Kate Stewart and
Philippe Ombredanne.  See the previous patch in this series for the
methodology of how this patch was researched.

commit 5cb0512c02ecd7e6214e912e4c150f4219ac78e0 (HEAD -> master, origin/master, origin/HEAD)
Author: Linus Torvalds<EMAIL_ADDRESS>Date:   Thu Nov 2 14:10:37 2017 -0700
Kbuild: don't pass "-C" to preprocessor when processing linker scripts

For some odd historical reason, we preprocessed the linker scripts with
"-C", which keeps comments around.  That makes no sense, since the
comments are not meaningful for the build anyway.

And it actually breaks things, since linker scripts can't have C++ style
"//" comments in them, so keeping comments after preprocessing now
limits us in odd and surprising ways in our header files for no good
reason.

The -C option goes back to pre-git and pre-bitkeeper times, but seems to
have been historically used (along with "-traditional") for some
odd-ball architectures (ia64, MIPS and SH).  It probably didn't matter
back then either, but might possibly have been used to minimize the
difference between the original file and the pre-processed result.

The reason for this may be lost in time, but let's not perpetuate it
only because we can't remember why we did this crazy thing.

This was triggered by the recent addition of SPDX lines to the source
tree, where people apparently were confused about why header files
couldn't use the C++ comment format.

Cc: Thomas Gleixner<EMAIL_ADDRESS>Cc: Greg KH<EMAIL_ADDRESS>Signed-off-by: Linus Torvalds<EMAIL_ADDRESS>

commit ead751507de86d90fa250431e9990a8b881f713c
Merge: fdebad11e50e e2be04c7f995
Author: Linus Torvalds<EMAIL_ADDRESS>Date:   Thu Nov 2 10:04:46 2017 -0700
Merge tag 'spdx_identifiers-4.14-rc8' of git://git.kernel.org/pub/scm/linux/kernel/git/gregkh/driver-core

commit a74c7494c0c9b6eeb2ece99831945b2b8da41f56
Merge: 146d8cd929d4 69f9cdc63319
Author: Arnd Bergmann<EMAIL_ADDRESS>Date:   Wed Aug 16 23:29:02 2017 +0200
Merge tag 'uniphier-dt-v4.14' of git://git.kernel.org/pub/scm/linux/kernel/git/masahiroy/linux-uniphier into next/dt

Pull "UniPhier ARM SoC DT updates for v4.14" from Masahiro Yamada:

- complete migrating to SPDX License Identifier
- remove support for old SoC
- add nodes for NAND, Audio pinctrl
- replace /include/ with #include

* tag 'uniphier-dt-v4.14' of git://git.kernel.org/pub/scm/linux/kernel/git/masahiroy/linux-uniphier:
  ARM: dts: uniphier: add Denali NAND controller node
  ARM: dts: uniphier use #include instead of /include/
  ARM: dts: uniphier: remove sLD3 SoC support
  ARM: dts: uniphier: add audio out pin-mux node
  ARM: dts: uniphier: use SPDX-License-Identifier (2nd)

commit 4376f01a1c4ad3f6be461583bc2bd7e329bfbe73
Author: Masahiro Yamada<EMAIL_ADDRESS>Date:   Tue Jul 11 23:08:56 2017 +0900
ARM: dts: uniphier: use SPDX-License-Identifier (2nd)

Commit fa53757bca33 ("ARM: dts: uniphier: use SPDX-License-Identifier")
missed to touch these two.  Now updating.

Signed-off-by: Masahiro Yamada<EMAIL_ADDRESS>

commit d828e97815f7aa7dd7d3e26a23073a7776ffa7b9
Merge: d8a4109634d6 1b6d58acdb26
Author: Olof Johansson<EMAIL_ADDRESS>Date:   Sun Jun 18 20:12:57 2017 -0700
Merge tag 'uniphier-dt64-v4.13' of git://git.kernel.org/pub/scm/linux/kernel/git/masahiroy/linux-uniphier into next/dt64

UniPhier ARM64 SoC DT updates for v4.13

- specify timing delay properties of eMMC
- fix W=1 build warnings
- increase memory reserve size
- use SPDX License Identifier
- add new board support (LD11/LD20 global)

* tag 'uniphier-dt64-v4.13' of git://git.kernel.org/pub/scm/linux/kernel/git/masahiroy/linux-uniphier:
  arm64: dts: uniphier: add support for LD20 Global board
  arm64: dts: uniphier: add support for LD11 Global board
  arm64: dts: uniphier: use SPDX-License-Identifier
  arm64: dts: uniphier: reserve more memory for LD11/LD20
  arm64: dts: uniphier: fix simple-bus unit address format error
  arm64: dts: uniphier: Use - instead of @ for DT OPP entries
  arm64: dts: uniphier: add cdns, phy-dll-delay-sdclk(-hsmmc) for eMMC
  arm64: dts: uniphier: add input-delay properties to Cadence eMMC node

Signed-off-by: Olof Johansson<EMAIL_ADDRESS>
commit 1830893b427262e12c923364b987f5b3f8ccda9d
Merge: d25b45539b90 73f9de0c7f5d
Author: Olof Johansson<EMAIL_ADDRESS>Date:   Sun Jun 18 20:11:08 2017 -0700
Merge tag 'uniphier-dt-v4.13' of git://git.kernel.org/pub/scm/linux/kernel/git/masahiroy/linux-uniphier into next/dt

UniPhier ARM SoC DT updates for v4.13

- fix W=1 build warnings
- use SPDX License Identifier
- add generic compatible string for I2C EEPROM

* tag 'uniphier-dt-v4.13' of git://git.kernel.org/pub/scm/linux/kernel/git/masahiroy/linux-uniphier:
  ARM: dts: uniphier: Add generic compatible string for I2C EEPROM
  ARM: dts: uniphier: use SPDX-License-Identifier
  ARM: dts: uniphier: fix simple-bus unit address format error
  ARM: dts: uniphier: Use - instead of @ for DT OPP entries

Signed-off-by: Olof Johansson<EMAIL_ADDRESS>

commit 12301cffc37a138b0e901a8b536a052055c29184
Author: Masahiro Yamada<EMAIL_ADDRESS>Date:   Mon Jun 5 12:57:59 2017 +0900
arm64: dts: uniphier: use SPDX-License-Identifier

Follow the recent trend for the license description, and fix the wrongly
stated X11 to MIT.

The X11 license text [1] is explicitly for the X Consortium and has a
couple of extra clauses.  The MIT license text [2] is actually what the
current DT files claim.

[1] https://spdx.org/licenses/X11.html
[2] https://spdx.org/licenses/MIT.html

Signed-off-by: Masahiro Yamada<EMAIL_ADDRESS>

commit b65fba3d87216bfe6ae9bc77be5eb6eabb6514a4
Author: Greg Kroah-Hartman<EMAIL_ADDRESS>Date:   Fri Oct 28 17:16:36 2016 -0400
USB: core: add missing license information to some files

Some of the USB core files were missing explicit license information.
As all files in the kernel tree are implicitly licensed under the
GPLv2-only, be explicit in case someone get confused looking at
individual files by using the SPDX nomenclature.

Signed-off-by: Greg Kroah-Hartman<EMAIL_ADDRESS>

using the SPDX nomenclature.

use SPDX-License-Identifier

https://spdx.org/licenses/X11.html

https://spdx.org/licenses/MIT.html

complete migrating to SPDX License Identifier

针对 user space API headers 的现状 either incomplete, badly formatted or just a shorthand

带来的麻烦 This makes it hard for compliance tools to determine the correct license.

现在的做法 GPL/LGPL licensed headers get the matching GPL/LGPL SPDX license identifier with the added 'WITH Linux-syscall-note' exception, which is the officially assigned exception identifier for the kernel syscall.  SPDX license identifiers are a legally binding shorthand, which can be used instead of the full boiler plate text

注意，This copyright does not cover user programs that use kernel services by normal system calls.

想要达到的效果 makes it possible to include GPL headers into non GPL code, without confusing license compliance tools

主要调研与完成人，Thomas Gleixner and Kate Stewart and Philippe Ombredanne.


Expressions using Transformations

Through the usage of GetTransformation, expression is now capable of performing transformation invocations.

LGTM


Synchronizing data using dropbox

Can sync data with desktop app.

WebDAV sync would also be awesome
Or sync with a folder in the local storage (internal, sdcard)
And it should only contact dropbox, when you really want to use it.

Perhaps we could use DeepStreamHub, so that way we can get free remote syncing with deepstreamhub.com (see free plan with 1gb of storage here). We should of course allow you to specify an arbitrary DSH server for those who want to self-host.
I've been looking for an excuse to play with DeepStreamHub, and boostnote looks like a cool project to contribute to. Would BoostIO be interested in a pull request for this?

Now that we can use Dropbox sync.
So I close this issue.
If @yashha or @ericvicenti want to use another sync feature, please open another issue!
Thanks 😄


Big EN translation and string localization

A bunch of string changes with the goal of making English text appear more natural.

Add LocalizableObjectPropertyBrowserAlias so we can localize property browser labels
Add resource keys for a bunch of raw zh strings
Make drag buttons (like "add CurveControlPoint") show "Hand" cursor to allow making English text shorter
Fix Options menu playfield settings not wrapping text
Change a lot of English strings
Add some missing button tooltips

Things to check

Make "RecordId" read-only in object inspector, is this OK?

thx your PR

Make "RecordId" read-only in object inspector, is this OK?
NP


Vuex + eventSources

Hello guys, i want add Vuex + eventSources in my app.. its possible?
I try but i have no success.. thanks!

Hello @lucassmacedo,
There is a section on the readme with eventSources examples.
And this plugin will work whether you use Vuex in your application or not.
I hope that helps?

Thanks


Add release version to website somewhere

Add release version somewhere on the website, probably the footer so we know what version of EasyCLA is deployed.

Added API endpoint to return the version: /v3/ops/version.  See https://github.com/communitybridge/easycla/pull/461. The response looks similar to:
{
    "branch": "feature/416-version-info",
    "buildDate": "2019-12-28T12:26:01-0800",
    "commit": "8c72ca30",
    "version": "v1.0.0"
}

@pranab-bajpai and @ngozi-ekekwe - please coordinate where the version information should be placed on the UIs. I recommend either the header, footer, or in the menu somewhere. Feel free to leverage any/all information above.

Ready for UX integration.

@ngozi-ekekwe pushed the UI update

awesome thanks
On Mon, Jan 6, 2020 at 3:09 PM David Deal<EMAIL_ADDRESS>wrote:

[image: Screen Shot 2020-01-06 at 1 08 42 PM]
https://user-images.githubusercontent.com/519609/71848985-cc06c200-3085-11ea-90ac-4dd203c70e02.png
@ngozi-ekekwe https://github.com/ngozi-ekekwe pushed the UI update
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/communitybridge/easycla/issues/416?email_source=notifications&email_token=AAAPSIO2DXDVALT3HGEHBZDQ4OM2BA5CNFSM4JZVJXIKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEIGZKYQ#issuecomment-571315554,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAAPSIKFXGOACJMABMTWAULQ4OM2BANCNFSM4JZVJXIA
.

--
Cheers,
Chris Aniszczyk
http://aniszczyk.org
+1<PHONE_NUMBER>


WIP: Alexandria

What was wrong?
Issue #
How was it fixed?
Summary of approach.
To-Do

[ ] Clean up commit history

[ ] Add entry to the release notes

Cute Animal Picture

This has been partially taken apart into smaller PRs now.  See #110 #109 #108 #107 #106
They each need to be individually cleaned up because they are all a little broken from the process of untangling them from each other.

The last commit in this can still actually be taken apart into two separate pieces which I think is going to make all of these PRs within the reviewable size (<300 SLOC)

@lithp I went ahead and hammered out d83b341 which makes the code that serves FINDNODES requests generic.  It might be a better example to demonstrate the proposed change.
I'm not fully sold on this BTW.  I don't like copy/pasting the NetworkAPI.find_nodes and NetworkAPI.recursive_find_nodes but I'm also a little uneasy making them the same.... Both Alexandria and the base protocol currently share business logic for maintaining the routing table.  There are no guarantees that the business logic stays the same.

My intuition is that we will probably end up preferring the way it was back in https://github.com/ethereum/ddht/commit/a63138cd33bf4f2ef7932e0fe184cd18561b8a1f . The implementations are the same now, and there might be some helper methods both will benefit from, but I expect we'll appreciate the extra flexibility when we want to make tweaks to how Alexandria works.

@lithp I don't follow.  a63138c implements PingClientAPI which co-locates the logic for ping/pong sending and the service for responding to ping message.
You comment both sounds like you support a63138c

My intuition is that we will probably end up preferring the way it was back in a63138c

And that  maybe you think we should keep them separate.

but I expect we'll appreciate the extra flexibility when we want to make tweaks to how Alexandria works.

Clarification please :grinning:

Hah, sorry, I misunderstood. I saw d83b34102ffb3f8cb3 and thought this was the first commit to start going down the route of merging these implementations. Didn't notice that https://github.com/ethereum/ddht/pull/95/commits/a63138cd33bf4f2ef7932e0fe184cd18561b8a1f was the first commit to start merging them.
I should have said https://github.com/ethereum/ddht/pull/95/commits/3043cfd93fb3f3237e277c2cd14fe4b6897980f7, I think I prefer the way is was back in https://github.com/ethereum/ddht/pull/95/commits/3043cfd93fb3f3237e277c2cd14fe4b6897980f7.

I should have said 3043cfd, I think I prefer the way it was back in 3043cfd.

:+1: I'm dropping 04d259d (ping absttraction) and 9e8c65 (find nodes abstraction) into their own branch for reference and rolling them back from this branch.

Alright, running ahead now with copy/pasta of the remaining functionality needed for the AlexandriaNetworkAPI to properly manage the overlay routing table as well as CLI command for running a node on the alexandria network.

@lithp I've got an MVP of SSZ-based partial data proofs in place in this branch. Initial experiments suggest that with an upper bound of about 1200 bytes per datagram and taking advantage of as many optimizations for compressing the proofs over the wire as possible that we can get at least 768 bytes of actual data into each packet with the rest of the packet being taken up by merkle proof overhead.  I think we can probably move this number up higher to maybe 900 or 1000 bytes of data per packet if we take advantage of more aggressive compression like leaving out sections of the tree that are already proven by other packets.
Compression that I'm taking advantage of now:

send the length custom encoded (saves about 30 bytes)
omit padding nodes from the RHS of the tree (saves ~300 bytes)
deduplication of the paths into the tree (2-3 bytes per tree node)
clever bit packing for encoding the path for each node (2-3 bytes per tree node)

Other options that are still on the table are snappy compression which will probably squeeze out a few more bytes.  As it stands I'm going to reach a point by the end of the week where I start to polish this and carve off chunks for review, after which this serves as the foundation for setting up the messages for doing content transmission over alexandria which is really exciting.


feat: Cairo 1.0 support [APE-665]

What I did
Fixes: APE-658
@dtdang may take this one home, but opening it up early to help get it started and because I was writing down instructions anyway for getting the sierra-compile in your PATH.
I also commented out the code we are getting rid of and added a TODO.
I think by the end, we won't official need starknet.py or cairo-lang as dependencies
fixes: APE-658
How I did it
How to verify it
Checklist

[ ] Passes all linting checks (pre-commit and CI jobs)
[ ] New test cases have been added and are passing
[ ] Documentation has been updated
[ ] PR title follows Conventional Commit standard (will be automatically included in the changelog)

to align more with how devnet does this, we may want to switch to using a config pointing to the Cairo manifest compiler config

@dtdang we need to migrate tests/dependency/src/dependency/depndency.cairo to know if deps still work on our end

Remaining TODOs:

[ ] get_compiler_version() to return version of Cairo
[ ] Include an Account contract in tests and make sure that works
[ ] Include a contract that imports the contract from the dependency
[ ] Include two contracts with the same name in different directories

After all those boxes are checked, and we have a passing build, we can ship it.


Is there a config option to automatically upload generated files?

I've got a project with webpack that has a watcher that generates bundled files every time I save the related project files.
I'd like to have the generated bundles to be automatically uploaded to the dev server, as of now my SFTP configuration uploads only the files saved by the user and the others must be always uploaded manually (with a right click on the file and a click on "Upload").
Is there a config option to automatically upload generated files?
Here is my current configuration:
// ...apart from host, port, username, password, privateKeypath and remotePath...
{
    "protocol": "sftp",
    "agent": null,
    "passphrase": null,
    "passive": false,
    "interactiveAuth": false,
    "uploadOnSave": true,
    "syncMode": "update",
    "watcher": {
        "files": "**/*",
        "autoUpload": false,
        "autoDelete": true
    },
    "ignore": [
        "**/.vscode/**",
        "**/.git/**",
        "**/.DS_Store",
        "**/node_modules"
    ]
}

Super curious to know as well. Did you figure it out @glebgolov-ziosem ?


Merge

I want everything to go to the main branch. If I merge this do changes go to main or main-content?

The changes will apply to main-content. Do you have any changes in main-content? If you want an up-to-date branch you can do git pull on main and then create a new branch.

I don't have changes in main-content. Ready to merge.

Yeah, feel free to go ahead and merge. Or delete main-content and create a new branch, up to you.


muti line display becomes a single line. why \r\n does not work

Triggering word wrap is a cell style property.  Cell styling is part of our Pro offering, see https://sheetjs.com/pro for more info


Enable search on the documentation

It is possible to enable search on Docusaurus, using Algolia DocSearch: https://docusaurus.io/docs/en/search
CC @kevinbarabash

@kevinbarabash Could you submit the website to DocSearch? It seems only owner can submit.


Feature: Talents

Vainglory's last update introduced Talents. In Brawl modes (Battle Royale and Blitz), Talents are equipped like skins and alter certain abilities' behaviour or stats. Every hero can have one of 3 different Talents (currently) at different levels which affect the strength (= the buffs) of the Talent.
Right now, the API does not return data about equipped Talents.

I need to research this, to see if we have it and aren't surfacing it (I think this is the case) or simple don't have it.

@bguilder as you know, I'm out next week.  Can you take this one?

What will the data be like? Will it be a Telemetry object or a participant attribute?

@genexp This is labeled "ready" and "VG 2.9" so I suppose it's coming next Wednesday.
Will it come with a breaking change, will the match data be incompatible with previous Brawl match data? Will it impose new mappings? Can we get the mappings and an example match?

Can't see any talent data


Explicitly instantiate configured schedulers

Fixes schedule_last_test linkage failures on msvc

Yay, finally some code clang-tidy has not seen yet ;-)


Add test in tag service realization test

Hi!
Please add test for deleteById method where existsById equals true in tag service realization test.
It's all. Thanks.

@Vikkingg13 i quess this test is redundant.

isn't that avoid mock realization our repository?

@egnaf what u think?

@Vikkingg13 @egnaf I mean that at this point we do not expect any behavior regarding the ServiceTag

@coungard see in other mock tests this case.

Viewed


code parser does not honour cmake_prefix_path?

I pass the command -DCMAKE_PREFIX_PATH=... to cmake (configured in the config.json) as I have some libraries in a non standard path. In the CMakeLists.txt I also do "include_directories(...)".
Building of the project works as expected, but the parsing of the code shows lots of errors, as the include-files are not found - only include-files in the standard paths are found..

CMAKE_PREFIX_PATH should only affect the Find_* commands. What OS are you on? Also, take a look at your ./build/compile_commands.json and see if you can find the problem in its paths there.

This should solve it I think, either:

open a CMakeLists.txt, modify it (for instance add a space and remove it), and save
or
remove the build directory and reopen the files

If you were on MSYS2, there were problems with included directories due to a slight change in MSYS2 at some point. It is fixed now though.

sorry for my late replay, I was out of office for a while..
Yes, I am using MSYS2, but the workaround (and most recent version) didn't help.
Looking at the compile_commands.json I noticed that the paths are written in different formats:

on one hand there is this part: "-isystem /C/msys/home/foo/bar", which is the include-file that isn't found during parsing.
then there are a lot of "-IC:/msys/some/default/paths", which are found..

As soon as I change the first one to "-isystem C:/msys/home/foo/bar", the parsing works fine an no more errors are shown. Still, this only affects parsing, not compiling, which works either way.
When I look at the compile_commands of jucipp, there all paths are the "/C/msys/.."-way - and still works.

Thank you. The problem is probably here: https://github.com/cppit/jucipp/blob/master/src/cmake.cc#L76. We look for -Isome_path and fixes that for Windows and MSYS2, but we do not look for "-i system some_path. You might be able to fix this yourself and make a pull request? If not, I'll have a look at it in a couple of days.

Fixed in #249


batchSize > 1时，INVALID_ARGUMENT:  required broadcastable shapes

batchsize测试下来只能设置1，不管是什么gpu，一旦设置大于1就会报错如下
-----------------
模式1：搭建模型
模式2：训练模型
模式3：开启Coolq接口
模式4：进行对话
-----------------
输入工作模式：2
输入循环轮数：2000
输入batch size:2
Tue May 10 09:35:46 2022 正在处理训练数据...
Tue May 10 09:35:46 2022 循环轮数:2000 batch size:2
2022-05-10 09:35:46.823820: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:936] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-05-10 09:35:46.833743: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:936] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-05-10 09:35:46.834556: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:936] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-05-10 09:35:46.835683: I tensorflow/core/platform/cpu_feature_guard.cc:151] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2022-05-10 09:35:46.836013: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:936] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-05-10 09:35:46.836818: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:936] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-05-10 09:35:46.837657: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:936] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-05-10 09:35:47.446699: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:936] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-05-10 09:35:47.447592: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:936] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-05-10 09:35:47.448356: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:936] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2022-05-10 09:35:47.449143: W tensorflow/core/common_runtime/gpu/gpu_bfc_allocator.cc:39] Overriding allow_growth setting because the TF_FORCE_GPU_ALLOW_GROWTH environment variable is set. Original config value was 0.
2022-05-10 09:35:47.449235: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1525] Created device /job:localhost/replica:0/task:0/device:GPU:0 with 10794 MB memory:  -> device: 0, name: Tesla K80, pci bus id: 0000:00:04.0, compute capability: 3.7
Epoch 1/2000
2022-05-10 09:36:03.719284: I tensorflow/stream_executor/cuda/cuda_dnn.cc:368] Loaded cuDNN version 8100
2022-05-10 09:36:04.314831: W tensorflow/core/framework/op_kernel.cc:1733] INVALID_ARGUMENT: required broadcastable shapes
Traceback (most recent call last):
  File "/content/drive/MyDrive/Ossas_ChatBot/main.py", line 113, in <module>
    rnn.train_model(bat, epo)
  File "/content/drive/MyDrive/Ossas_ChatBot/Seq2Seq.py", line 79, in train_model
    model.fit([encoder_input_data, decoder_input_data], decoder_target_data,
  File "/usr/local/lib/python3.9/site-packages/keras/utils/traceback_utils.py", line 67, in error_handler
    raise e.with_traceback(filtered_tb) from None
  File "/usr/local/lib/python3.9/site-packages/tensorflow/python/eager/execute.py", line 54, in quick_execute
    tensors = pywrap_tfe.TFE_Py_Execute(ctx._handle, device_name, op_name,
tensorflow.python.framework.errors_impl.InvalidArgumentError: Graph execution error:

Detected at node 'Equal' defined at (most recent call last):
    File "/content/drive/MyDrive/Ossas_ChatBot/main.py", line 113, in <module>
      rnn.train_model(bat, epo)
    File "/content/drive/MyDrive/Ossas_ChatBot/Seq2Seq.py", line 79, in train_model
      model.fit([encoder_input_data, decoder_input_data], decoder_target_data,
    File "/usr/local/lib/python3.9/site-packages/keras/utils/traceback_utils.py", line 64, in error_handler
      return fn(*args, **kwargs)
    File "/usr/local/lib/python3.9/site-packages/keras/engine/training.py", line 1384, in fit
      tmp_logs = self.train_function(iterator)
    File "/usr/local/lib/python3.9/site-packages/keras/engine/training.py", line 1021, in train_function
      return step_function(self, iterator)
    File "/usr/local/lib/python3.9/site-packages/keras/engine/training.py", line 1010, in step_function
      outputs = model.distribute_strategy.run(run_step, args=(data,))
    File "/usr/local/lib/python3.9/site-packages/keras/engine/training.py", line 1000, in run_step
      outputs = model.train_step(data)
    File "/usr/local/lib/python3.9/site-packages/keras/engine/training.py", line 864, in train_step
      return self.compute_metrics(x, y, y_pred, sample_weight)
    File "/usr/local/lib/python3.9/site-packages/keras/engine/training.py", line 957, in compute_metrics
      self.compiled_metrics.update_state(y, y_pred, sample_weight)
    File "/usr/local/lib/python3.9/site-packages/keras/engine/compile_utils.py", line 459, in update_state
      metric_obj.update_state(y_t, y_p, sample_weight=mask)
    File "/usr/local/lib/python3.9/site-packages/keras/utils/metrics_utils.py", line 70, in decorated
      update_op = update_state_fn(*args, **kwargs)
    File "/usr/local/lib/python3.9/site-packages/keras/metrics.py", line 178, in update_state_fn
      return ag_update_state(*args, **kwargs)
    File "/usr/local/lib/python3.9/site-packages/keras/metrics.py", line 729, in update_state
      matches = ag_fn(y_true, y_pred, **self._fn_kwargs)
    File "/usr/local/lib/python3.9/site-packages/keras/metrics.py", line 4043, in categorical_accuracy
      tf.equal(
Node: 'Equal'
Detected at node 'Equal' defined at (most recent call last):
    File "/content/drive/MyDrive/Ossas_ChatBot/main.py", line 113, in <module>
      rnn.train_model(bat, epo)
    File "/content/drive/MyDrive/Ossas_ChatBot/Seq2Seq.py", line 79, in train_model
      model.fit([encoder_input_data, decoder_input_data], decoder_target_data,
    File "/usr/local/lib/python3.9/site-packages/keras/utils/traceback_utils.py", line 64, in error_handler
      return fn(*args, **kwargs)
    File "/usr/local/lib/python3.9/site-packages/keras/engine/training.py", line 1384, in fit
      tmp_logs = self.train_function(iterator)
    File "/usr/local/lib/python3.9/site-packages/keras/engine/training.py", line 1021, in train_function
      return step_function(self, iterator)
    File "/usr/local/lib/python3.9/site-packages/keras/engine/training.py", line 1010, in step_function
      outputs = model.distribute_strategy.run(run_step, args=(data,))
    File "/usr/local/lib/python3.9/site-packages/keras/engine/training.py", line 1000, in run_step
      outputs = model.train_step(data)
    File "/usr/local/lib/python3.9/site-packages/keras/engine/training.py", line 864, in train_step
      return self.compute_metrics(x, y, y_pred, sample_weight)
    File "/usr/local/lib/python3.9/site-packages/keras/engine/training.py", line 957, in compute_metrics
      self.compiled_metrics.update_state(y, y_pred, sample_weight)
    File "/usr/local/lib/python3.9/site-packages/keras/engine/compile_utils.py", line 459, in update_state
      metric_obj.update_state(y_t, y_p, sample_weight=mask)
    File "/usr/local/lib/python3.9/site-packages/keras/utils/metrics_utils.py", line 70, in decorated
      update_op = update_state_fn(*args, **kwargs)
    File "/usr/local/lib/python3.9/site-packages/keras/metrics.py", line 178, in update_state_fn
      return ag_update_state(*args, **kwargs)
    File "/usr/local/lib/python3.9/site-packages/keras/metrics.py", line 729, in update_state
      matches = ag_fn(y_true, y_pred, **self._fn_kwargs)
    File "/usr/local/lib/python3.9/site-packages/keras/metrics.py", line 4043, in categorical_accuracy
      tf.equal(
Node: 'Equal'
2 root error(s) found.
  (0) INVALID_ARGUMENT:  required broadcastable shapes
	 [[{{node Equal}}]]
	 [[broadcast_weights_1/assert_broadcastable/AssertGuard/pivot_f/_15/_71]]
  (1) INVALID_ARGUMENT:  required broadcastable shapes
	 [[{{node Equal}}]]
0 successful operations.
0 derived errors ignored. [Op:__inference_train_function_21896]

python版本：Python 3.9.12
cudnn版本：<IP_ADDRESS>
环境：Google Colab + GPU

已解决，需要python版本3.7，tensorflow版本 2.1.0


Any option to remove a dataset from the DOM without any result?

Hey guys,
it is possible to hide or remove an empty dataset from the DOM?
I ask because my datasets have a bottom border and if without any results it renders 4 empty dataset div's.

Hi @divdax
No, that isn't currently a feature. You might be able to find some creative workaround. However, I think we'd be open to a pull request adding this, if you'd like. We have some other feature requests having to do with empty data sets as well, so have a look at those as you're thinking about this.


Configure Log Level From CLI

Adding an argument --log-level to configure Log Level for current execution in CLI.
Partially resolves #135 for weather-mv. Same can be done for weather-dl and weather-sp.
Also removing a file level logger.setLevel(..) calls as package level log severity is configured  in pipeline.py.

We have 2 log at debug level.
logger.debug('Created the BigQuery table with schema...')
logger.debug(f'\n{pformat(table_schema)}')
Running the pipeline with --log-level 2 (INFO log level).
INFO:loader_pipeline.sinks:opened dataset size: 3122828
INFO:loader_pipeline.bq:Inferring schema from data.
INFO:loader_pipeline.util:target data_vars empty; using whole dataset; size: 3122828
WARNING:apache_beam.options.pipeline_options:Discarding unparseable args: ['true']
INFO:root:Default Python SDK image for environment is apache/beam_python3.8_sdk:2.40.0

Running the pipeline with --log-level 3 (DEBUG log level).
INFO:loader_pipeline.sinks:opened dataset size: 3122828
INFO:loader_pipeline.bq:Inferring schema from data.
INFO:loader_pipeline.util:target data_vars empty; using whole dataset; size: 3122828
DEBUG:loader_pipeline.bq:Created the BigQuery table with schema...
DEBUG:loader_pipeline.bq:
[SchemaField('d2m', 'FLOAT64', 'NULLABLE', None, (), None),
 SchemaField('u10', 'FLOAT64', 'NULLABLE', None, (), None),
 SchemaField('v10', 'FLOAT64', 'NULLABLE', None, (), None),
 SchemaField('longitude', 'FLOAT64', 'NULLABLE', None, (), None),
 SchemaField('latitude', 'FLOAT64', 'NULLABLE', None, (), None),
 SchemaField('time', 'TIMESTAMP', 'NULLABLE', None, (), None),
 SchemaField('data_import_time', 'TIMESTAMP', 'NULLABLE', None, (), None),
 SchemaField('data_uri', 'STRING', 'NULLABLE', None, (), None),
 SchemaField('data_first_step', 'TIMESTAMP', 'NULLABLE', None, (), None),
 SchemaField('geo_point', 'GEOGRAPHY', 'NULLABLE', None, (), None)]
WARNING:apache_beam.options.pipeline_options:Discarding unparseable args: ['true']
INFO:root:Default Python SDK image for environment is apache/beam_python3.8_sdk:2.40.0

@alxmrs Can you please re-review the changes. As you asked I've added the same configuration for weather-dl and weather-sp.


Clarification of log count

Previous wording implied 6 previous logs and ignored the current one. Added a better explanation.

@way0utwest : Thanks for your contribution! The author(s) have been notified to review your proposed change.

Thank you, @way0utwest #sign-off


How can I search on encrypted data using stored procedure with EF core

This is not possible. It's encrypted in the SQL part.


Missing release notes for Boost 1.87.0

Hi,
It seems that the recent release doesn't include the change notes for the Redis lib?
https://www.boost.org/users/history/version_1_87_0.html
I checked the code and it does seem to include the recent changes made.
Thanks

Hi Bruno,
I keep my own release notes here: https://github.com/boostorg/redis?tab=readme-ov-file#changelog
I did not have the time to update the Boost release notes, will do it next time.

Thanks!


GPs should not accept varkeys/monomials as keys in their substitutions

... whereas varkeys/monomials used as values in a substitution dict passed to solve() or ConstraintSet.__init__ will raise an informative error.

Highly related to #781

After retitle, so highly related it supersedes.

shouldn't it be "as values" instead of "as keys"?

oops yes!


Update codegen to work outside GOPATH

See https://github.com/knative/networking/pull/18/files
Fixes knative/pkg#1287

@Cynocracy You know how to fix the build issue?


Azure GPT-4 model overloaded requests error

When invoking Azure GPT 4 models, you may encounter an error message stating That model is currently overloaded with other requests. You can retry your request, or contact us through an Azure support request. In such cases, the proxy should automatically retry.

The proposed solution involves parsing event data and verifying whether an overloaded model event data is received. If such data is received, an internal retry will be initiated on the proxy side.
Here's an example of event data returned by the Azure OpenAI GPT model when the model is overloaded:
{
"error": {
"message": "That model is currently overloaded with other requests. You can retry your request, or contact us through an Azure support request at: https://go.microsoft.com/fwlink/?linkid=2213926 if the error persists. (Please include the request ID 2dcb57a0-803c-4ac1-986d-e3aee5fedd6e in your message.)",
"type": "server_error",
"param": null,
"code": null
}
}


Bump requirements and add ignore

This PR bumps requirements per npm audit, and also adds an entry for .nvmrc into .gitignore for those using nvm to manage different versions of node locally.
Testing instructions:

npm install
npm start &
npm test
...or just let CI do its thing.

Author notes and concerns:
Just a small thing I found when playing with this repo. Not sure if you have any other required checks before doing requirements updates. Hope to have more stuff for you soon.
Also I used conventional commit syntax for the commit memos, but you don't seem to be using that standard. Please let me know if you have a preferred set of conventions for labeling commits.

Closing in favor of #180 , which bumps requirements directly.


Database issue on Add New Page

Sometimes, when I try and add a new page I get this error.
This is happening more often than not:
Symphony Fatal Database Error
Column 'page_id' cannot be null
An error occurred while attempting to execute the following query
INSERT INTO `sym_pages_types` (`page_id`, `type`) VALUES (NULL, 'primary')
Backtrace:
[/Users/designermonkey/Projects/projectr/sym-projectr/symphony/lib/toolkit/class.mysql.php:463] MySQL->__error();
[/Users/designermonkey/Projects/projectr/sym-projectr/symphony/lib/toolkit/class.mysql.php:546] MySQL->query();
[/Users/designermonkey/Projects/projectr/sym-projectr/symphony/content/content.blueprintspages.php:944] MySQL->insert();
[/Users/designermonkey/Projects/projectr/sym-projectr/symphony/content/content.blueprintspages.php:661] contentBlueprintsPages->__actionEdit();
[/Users/designermonkey/Projects/projectr/sym-projectr/symphony/lib/toolkit/class.administrationpage.php:440] contentBlueprintsPages->__actionNew();
[/Users/designermonkey/Projects/projectr/sym-projectr/symphony/lib/toolkit/class.administrationpage.php:409] AdministrationPage->__switchboard();
[/Users/designermonkey/Projects/projectr/sym-projectr/symphony/lib/toolkit/class.administrationpage.php:242] AdministrationPage->action();
[/Users/designermonkey/Projects/projectr/sym-projectr/symphony/lib/core/class.administration.php:230] AdministrationPage->build();
[/Users/designermonkey/Projects/projectr/sym-projectr/symphony/lib/core/class.administration.php:383] Administration->__buildPage();
[/Users/designermonkey/Projects/projectr/sym-projectr/index.php:25] Administration->display();
Database Query Log:
SET character_set_connection = 'utf8', character_set_database = 'utf8', character_set_server = 'utf8'; [0.0001]
SET CHARACTER SET 'utf8'; [0.0001]
SELECT SQL_CACHE `session_data` FROM `sym_sessions` WHERE `session` = '84e2fa92fd5914539448ac29aa1796a9' LIMIT 1; [0.0002]
DELETE FROM `sym_sessions` WHERE `session_expires` <= '1316785518'; [0.0001]
SELECT SQL_CACHE `name` FROM `sym_extensions` WHERE `status` = 'enabled'; [0.0002]
SELECT SQL_CACHE `id` FROM `sym_authors` WHERE `username` = 'john-porter' AND `password` = 'b064039c12eec87b0034061bc876418a82bca30c' LIMIT 1; [0.0002]
UPDATE sym_authors SET `last_seen` = '2011-10-07 14:45:18' WHERE `id` = '1'; [0.0002]
SELECT SQL_CACHE * FROM `sym_authors` WHERE `id` IN (1) ORDER BY id ASC; [0.0002]
SELECT SQL_CACHE * FROM `sym_extensions`; [0.0002]
SELECT SQL_CACHE `s`.* FROM `sym_sections` AS `s` WHERE `s`.`id` = '1'; [0.0003]
SELECT SQL_CACHE `id`, `element_name`, `type`, `location` FROM `sym_fields` WHERE `parent_section` = '1' ORDER BY `sortorder` ASC; [0.0002]
SELECT SQL_CACHE t1.* FROM sym_fields as t1 WHERE 1 AND t1.`id` = '4' LIMIT 1; [0.0001]
SELECT SQL_CACHE * FROM `sym_fields_memberusername` WHERE `field_id` = '4' LIMIT 1; [0.0002]
SELECT SQL_CACHE t1.* FROM sym_fields as t1 WHERE 1 AND t1.`id` = '5' LIMIT 1; [0.0002]
SELECT SQL_CACHE * FROM `sym_fields_memberemail` WHERE `field_id` = '5' LIMIT 1; [0.0001]
SELECT SQL_CACHE t1.* FROM sym_fields as t1 WHERE 1 AND t1.`id` = '6' LIMIT 1; [0.0001]
SELECT SQL_CACHE * FROM `sym_fields_memberactivation` WHERE `field_id` = '6' LIMIT 1; [0.0002]
SELECT SQL_CACHE t1.* FROM sym_fields as t1 WHERE 1 AND t1.`id` = '7' LIMIT 1; [0.0002]
SELECT SQL_CACHE * FROM `sym_fields_memberpassword` WHERE `field_id` = '7' LIMIT 1; [0.0003]
SELECT SQL_CACHE t1.*  FROM `sym_pages` AS p WHERE p.id = '' LIMIT 1; [0.0002]
SELECT SQL_CACHE MAX(p.sortorder) + 1 AS `next` FROM `sym_pages` AS p LIMIT 1; [0.0002]
SELECT SQL_CACHE p.* FROM `sym_pages` AS p WHERE p.id != '' AND p.handle = 'lists' AND p.path IS NULL LIMIT 1; [0.0002]
INSERT INTO `sym_pages_types` (`page_id`, `type`) VALUES (NULL, 'primary'); [0.0000]

Hah, I think I've found the bug that causes this issue, #765 and #805. Fix shortly.


Return fixed message

Duplicate of https://github.com/browserslist/lint/pull/3 also without docs and tests


many relationship

Laravel Version: 5.3
Voyager Version:  (v0.10.13)
PHP Version: PHP 5.6.4-4ubuntu6.4 (cli) (built: Oct 28 2015 01:21:29)
Database Driver & Version: mysql  Ver 15.1 Distrib 10.0.23-MariaDB, for debian-linux-gnu (x86_64) using readline 5.2

Description:
Tables: certifications - id, name, description
clients - certifications_id (multiple select), name, etc
I have created a BREAD for this, but i can't add or edit multiple values from certifications table.
The BREAD is {
"relationship": {
"key": "id",
"label": "name"
}
}
Client.php

class Client extends Model {
protected $table = 'clients';
public function certifications_id() {
return $this->belongsTo(Certification::class);
}
}

mySQL:
clients:

id	int(10) unsigned Auto Increment
type	varchar(255)
name	varchar(255)
created_at	timestamp NULL
updated_at	timestamp NULL

certifications:
id	int(10) unsigned Auto Increment
name	varchar(255)
indicativ	varchar(255)
certifications_id	varchar(255)
created_at	timestamp NULL
updated_at	timestamp NULL
Steps To Reproduce:

There will be a fix in next release or can i do something to fix this?

Remember than after #638 you have to name your relationship methods in camelCase, not snake_case anymore

Relations are working, but i can't insert to mysql because it says empty value, i have camelCase relations at this moment.

I've seen this error once but I use validation for each field. The ones that you can allow to be null, simply uses the nullable rule. Hence, the required ones need that one rule.
But to be honest, I can't reproduce it right now at 0.10.13, I don't know about @marktopper

Haven't been able to reproduce this either...

Now that's a new error.. Can you edit https://github.com/the-control-group/voyager/blob/master/resources/views/bread/browse.blade.php#L40 and use on the previous line dd($data->{$row->field}) to see what value you're getting?

In {{dd($data->{$row->field})}}
resources/views/vendor/voyager/client/browse.blade.php? or where? Yes i can, but give me more info, please.
Made that column and bread from scratch,

mmm.... to be honest, I think that's working as intended. You're supposed to use validation anyway.
I'm already addressing other things, so at the moment my mind can't handle this as well :D

Just a note, it should properly be public function certificationsId().

Look where i add a new client, it says it needs to be certifications_id.
Validate what? i have no data like error says :)

@emsici: I see, can you please try to update to version 0.10.14 and test it again?

I can finally reproduce this.
Happens to me with a image field which hasn't the current value (when editing).
The constraint is fine, those fields can not be null, I think the problem is when voyager prepares the model to be saved, It seems to be ignoring database values, and if they weren't included in the request, they are getting overridden to NULL.
I think this is already fixed for select_multiple and select_dropdown fields, since they already pick up the actual value from DB (when editing), unlike image field. But it isn't here where we have to address the error in my opinion;

I think the problem is when voyager prepares the model to be saved, It seems to be ignoring database values, and if they weren't included in the request, they are getting overridden to NULL.

So I have two ideas atm

We need to revamp the image field input to work directly with media manager and save strings instead of files.
Check which other field types are triggering this error.
This error has nothing to do with many to many relationships I believe, so... Let's set it to something like SQL Error: Field doesn't have a default value so we may get more feedback

Note to @emsici remember you're saving an array, so you have to cast the attribute as array in your model public $casts = ['certifications_id' => 'array']

Great job reproducing this @Frondor. 👍

Have the same issue on a multiple_select (sponsors).
These sponsors have a name, a website and a logo (image).

@denbatte can you paste your json details in sponsors field?

This is the JSON in the sponsors BREAD field.
{
"relationship": {
"key": "id",
"label": "name"
}
}

Sorry, and the model for that BREAD as well... if you're using one. It would probably be at app\Stage.php

Sorry, has been a while since I was active on GitHub. Updated my last post with code sample.
Isn't here a more convenient channel to communicate?

@Frondor do I need an invite for the slack channel?

Ok, did some more testing.
I created a oneToOne relation of a group and a stage and that works perfectly.
Also, I made the sponsors field in the stages table nullable and this made the last error go away.
There is a different error now though.

Having a look at the relationToLink method at the moment.

@Frondor @marktopper I have found the issue. There is a mistake in the relationToLink method.
It uses an array to get the label values in the code but actually, at the moment its a collection.
https://github.com/the-control-group/voyager/blob/master/src/Http/Controllers/Traits/BreadRelationshipParser.php
                if (!is_object($item[$field])) {
                    $item[$field] = $relation[$relationData->label]; // HERE IS MISTAKE
                } else {
                    $tmp = $item[$field];
                    $item[$field] = $tmp;
                }

I will try to create a PR if I find some time to fix it.

I don't think that's the main problem. This is not only about relationships, since this same error happened with $timestamps fields... But that can be another bug. At the moment, it's working fine in my v0.11 branch

Do we need an invite to that Slack channel, or what?

/offtopic
@emsici there is a link with a slack invite website on the Voyager homepage ;)
Just found out.

/offtopic Get Slack Invite

I seem to get the same issue, but who knows if this is just due to my part.

Here is my parent and pivot table:
public function up()
    {
        Schema::create('orders', function (Blueprint $table) {
            $table->increments('id');
            $table->integer('user_id');
            $table->text('comment')->nullable();
            $table->integer('price');
            $table->boolean('sent');
            $table->boolean('paid');
            $table->string('products');
            $table->timestamps();
        });

        Schema::create('order_product', function (Blueprint $table) {
            $table->primary(array('order_id', 'product_id'));
            $table->integer('order_id')->unsigned();
            $table->foreign('order_id')->references('id')->on('orders')->onDelete('cascade');
            $table->integer('product_id')->unsigned();
            $table->foreign('product_id')->references('id')->on('products');
            $table->integer('amount');
            $table->timestamps();
        });
    }

I had to use composite keys to actually get to the "add item" page if not I got this error which suggest there is either something I did wrong or an error in the way the parts get selected due to not properly formatting the SQL select. I could have left the pivot table as normal and looked into the code, but a composite key at least got me further ahead.

SQLSTATE[23000]: Integrity constraint violation: 1052 Column 'id' in field list is ambiguous (SQL: select id from products inner join  order_product on products.id = order_product.product_id where order_product.order_id is null) (View: D:\WindowsFolders\Documents\PHP\Voyager-test\vendor\tcg\voyager\resources\views\bread\edit-add.blade.php)

Here is the child table:
public function up()
    {
        Schema::create('products', function (Blueprint $table) {
            $table->increments('id');
            $table->string('title')->nullable();
            $table->text('description');
            $table->string('image');
            $table->integer('price');
            $table->string('slug')->unique();
            $table->timestamps();
        });
    }

Here is the Model function:
public function products()
    {
        return $this->belongsToMany(Product::class, 'order_product');
    }

Here is just a few dummy products.

They don't seem to show up properly when I select them in the products menu.

I'm no real programmer yet and can't really help fix anything without great struggle, but I have a question about the many to many relationship. Do you guys plan to expand on it in the future? Because from what it seems like, it's a little restrictive. How would I change some extra data in the pivot table like the "amount" field I added into my pivot table. Because then I could easily define the amount of products of this type is related to the order.
Django admin have a very nice relationship system where you simply leave your models "as is" with no extra field to store data. And just add the relationship in an admin config. Then the admin page simply add the necessary inputs like in the picture below and you could add many children at the same time. The children wouldn't have to be premade. It might be too much to ask for a django like relationship system.

I had a similar issue when listing models in a many to many relationship. In my case, I unchecked the "browse" checkbox in the relationship (products in your case) for the bread configuration and it works fine.
Hope it helps!

@abacram: It's worked great! Thanks a lot, bro.

What I had to do to get this to work is define the relationship in two function.
In your case, you would have to implement belongsToMany in certificationsId() AS WELL AS  a certifications_id() function (the latter of which seems to be required in order for the model to save without throwing a 'Call to undefined method ' error).

@adriangordon1231, that's a workaround, not a fix.  But it hints at the core issue being that we must've missed something when changing from type_id() to typeId()

@fletch3555 Never said it was a fix. All I did what point out with I did to make it work.


[Do not merge] Grant user permissions for manuals publisher

Find users with permissions for specialist_publisher and grant them with those same permissions for manuals publisher

If you rebase this on master and push it again, the tests will pass


Update codeql to latest versions and use.

Updating CodeQL file as this was not updated for a bit and new versions are released. thanks in advance ❤☕💡 cc: @peterbom

Codecov Report

Merging #206 (c6b9521) into master (9bb6cfc) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #206   +/-   ##
=======================================
  Coverage   80.50%   80.50%
=======================================
  Files          14       14
  Lines         785      785
=======================================
  Hits          632      632
  Misses         94       94
  Partials       59       59

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


Heavy builds fail without any response.

Hello
There is a hang when building mkvtoolnix or rust-analyzer.
When it stops, it stops without any error log in the shell prompt, but the entire wsl is frozen.
I'm tinkering with cores and max-jobs in nix.conf.
Builds fine on xeon computer windows 10 wsl2 nixos a little over 10 years old, but slow.
The computer currently in question is windows 11 wsl2 nixos.
Thanks.

cores = 4
max-jobs = 1

I set the settings with and avoided the mkvtoolnix build, and now when I run the mkvtoolnix build again, it stops the same.
just... I avoid builds that don't work.

This is a known problem with WSL. Only fix I know is to reboot.

Had it happen to me for the first time a few days ago as well, but I didn't see anything that might have caused it

I'm having trouble with webkitgtk depending somewhere.
Is there a way to list packages that depend on webkitgtk like gentoolkit equery... I don't know how to do that in a nix environment.
Every time this happens, I feel despair.
I hope that the project that uses binary as much as possible will proceed, not the cache build server.

This issue has been mentioned on NixOS Discourse. There might be relevant details there:
https://discourse.nixos.org/t/how-to-get-preview-depend-package-tree-without-building/25708/3

The only Idea I have is that the build might run out of memory for some reason, but that's unlikely if you say it builds on similar Windows 10 computers. You can of course try adding some swap to the WSL2 VM and see if it helps. What does free -h say at the moment? Maybe MS changed how much RAM gets allocated to the VM between Windows 10 and 11

This seems to be the likely reason! They changed it, so the memory allocation is capped at 8GB by default. So you can either increase the memory or the swap size

You're right! Building now.  The computer is holding up for a long time,

https://github.com/nix-community/NixOS-WSL/issues/123
It's a question I've asked before;
Using nix is so convenient that I keep losing my memory. lol
Thanks.


[Ameba] matter shell with loguart

don't use separate UART port for shell
use atcmd in ameba SDK for shell commands
use queue to pass in command

@pankore Ameba builds are failing:
/__w/connectedhomeip/connectedhomeip/out/ameba-amebad-all-clusters/chip/../../../config/ameba/third_party/connectedhomeip/src/lib/shell/streamer_ameba.cpp:57: undefined reference to `shell_queue'

@andy31415 , it can pass now after the docker ci update


new feature : waterways (ways & areas)

Description
Waterways are a very important item for sustainable development.
It would be very usefull to help little municipalities and local governments worldwide to improve urban planning.
More and more there are ways added in OSM for rivers and streams.
It could be interesting to help adding ditches and streams missing and were the rivers are quite big let us get polygones.
Version
mapwith AI alpha
What browser are you seeing the problem on? What version are you running?
Chrome
Steps to reproduce
No response
The browser URL at the time you encountered the bug
https://mapwith.ai/rapid-v2-alpha#background=Bing&datasets=fbRoads,msBuildings&disable_features=boundaries&map=16.76/44.13656/4.81101

In this format, the Intermitent Waterways are rendered as solid lines and not dashed.
https://mapwith.ai/rapid-v2-alpha#background=Bing&datasets=fbRoads,msBuildings&disable_features=boundaries&map=16.00/-18.65809/-65.15862

Also you can not draw areas or add nodes to existing ways or areas


FileNotFoundError: [Errno 2] No such file or directory: '*.mat'

Hello, tell me what should be contained in .mat files or show an example that was used in your code?

Hi, the mat file contains the annotations of the landmarks. You can change the code to adapt it to your own data. Or you can download the dataset listed in https://aasce19.grand-challenge.org/Home/.

Oh, thank you. I try to can change the code to adapt to my data, but there was a problem with mat files. I have only the source images and their masks.

I can not download the dataset.

I think you have to sign in first.  The mat file should provide the coordinates of the landmarks, as in dataset.py, 'pts' is loaded from the .mat file, 'pts' is a 2D array or matrix with the size of N x 2 (N=68).
def load_gt_pts(self, annopath):
pts = loadmat(annopath)['p2']   # num x 2 (x,y)
pts = rearrange_pts(pts)
return pts

Even after I went in, I did not have access to files.
It turns out that I have to create these mat files myself. I would like to clarify, do these files contain the coordinates of all the vertebrae?

Yes, these mat files contain the coordinates of the corners of the vertebrae. You can adapt the code to your own annotations by replacing the load_gt_pts function in dataset.py
About the dataset, you can send your requirements here http://spineweb.digitalimaginggroup.ca/dataset.php.

Thanks a lot. I'll try!

Hi  since the data downloading link is not available for me, would  you upload the trained model file? Thanks a lot! @yijingru

Hi since the data downloading link is not available for me, would you upload the trained model file? Thanks a lot! @yijingru

The pretrained weights are shared now.

I am trying to change the code to my label:
def load_gt_pts(self, annopath):
pts = loadmat(annopath)['p2'] # num x 2 (x,y)
pts = rearrange_pts(pts)
return pts
Hi, when returns pts, I want to confirm whether these pts are arranged in order.
such as this:
[[x1,y1],
[x2,y2],
......
[x67,y67]
]
Thank you for your reply

Hello, I am getting this error. Is there a problem on my .mat file? I downloaded the train and test images and labels. I am converting from .csv to .mat files. Succeed this. But I am not train the images and labels. Can you help me?
`Setting up data...
Starting training...
Epoch: 1/50
[[21.593  11.619   2.3353]]
[[38.967 11.978 34.892]]
[[35.528 29.172 15.598]]
Traceback (most recent call last):
File "main.py", line 33, in
is_object.train_network(args)
File "/home/ugur/Downloads/Fited-calismalar/Vertebra-Landmark-Detection-master/train.py", line 123, in train_network
epoch_loss = self.run_epoch(phase='train',
File "/home/ugur/Downloads/Fited-calismalar/Vertebra-Landmark-Detection-master/train.py", line 150, in run_epoch
for data_dict in data_loader:
File "/home/ugur/.local/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 363, in next
data = self._next_data()
File "/home/ugur/.local/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 989, in _next_data
return self._process_data(data)
File "/home/ugur/.local/lib/python3.8/site-packages/torch/utils/data/dataloader.py", line 1014, in _process_data
data.reraise()
File "/home/ugur/.local/lib/python3.8/site-packages/torch/_utils.py", line 395, in reraise
raise self.exc_type(msg)
IndexError: Caught IndexError in DataLoader worker process 0.
Original Traceback (most recent call last):
File "/home/ugur/.local/lib/python3.8/site-packages/torch/utils/data/_utils/worker.py", line 185, in _worker_loop
data = fetcher.fetch(index)
File "/home/ugur/.local/lib/python3.8/site-packages/torch/utils/data/_utils/fetch.py", line 44, in fetch
data = [self.dataset[idx] for idx in possibly_batched_index]
File "/home/ugur/.local/lib/python3.8/site-packages/torch/utils/data/_utils/fetch.py", line 44, in
data = [self.dataset[idx] for idx in possibly_batched_index]
File "/home/ugur/Downloads/Fited-calismalar/Vertebra-Landmark-Detection-master/dataset.py", line 73, in getitem
pts = self.load_annotation(index)   # num_obj x h x w
File "/home/ugur/Downloads/Fited-calismalar/Vertebra-Landmark-Detection-master/dataset.py", line 60, in load_annotation
pts = self.load_gt_pts(annoFolder)
File "/home/ugur/Downloads/Fited-calismalar/Vertebra-Landmark-Detection-master/dataset.py", line 50, in load_gt_pts
pts = rearrange_pts(pts)
File "/home/ugur/Downloads/Fited-calismalar/Vertebra-Landmark-Detection-master/dataset.py", line 20, in rearrange_pts
bl = pt_l[y_inds_l[1], :]
IndexError: index 1 is out of bounds for axis 0 with size 1
`


Cannot apply any operations which include a time range

Expected behavior
Using GUI to run through Use Case 6 happy path. Attempted to apply a subset_temporal operation.
Actual behavior
The operation failed validation regardless of which time range was selected.
Note that the problem is seen not just for subset_temporal operation but for other operations, anomaly_internal and open_dataset,  which contain a time range (type TimeRangeLike),
Steps to reproduce the problem

Ensure there is at least one resource of type Dataset in the workspace
From operations panel, select subset_temporal then Apply
In New Operation Step window, select a Dataset resource
Next to TimeRange, enter a start time and end time

Click "Validate" and see error message:

Specifications
Cate 0.9.0-dev.4
Windows 7 Professional

It occurs with both New Operation Step and Edit Operation Step windows.


5441 update installation instructions with groups

This closes #5441. @viddo , CR this, please.

I didn't install using those instructions, as you may know, but steps looks legit :+1:
But why reassigned to me? :) Would probably be best that someone that don't already have the dev env setup to verify those steps working as desired, right?

@viddo we'll do that on QA, when everything's final, I don't want to mess environments yet. I just wanted you to check whether I've missed something.

Ok great! :ok_woman:  :ship: :it:


TypeError: xPrv.derivePath(...).toPrivateKey is not a function

Describe the bug
I tried to use one of example from  wasm/examples/nodejs/javascript/general/derivation.js
It used to derive kaspa addresses from mnemonic seeds.  I left script untouched except changed path to kaspa node module .
To Reproduce
When i run script it producing error.
$ node derive.js
mnemonic: {
  entropy: '6f62daa640b1f7ca0c9402ed7299d34ef659416231a8881ae102da85b9d3365e',
  phrase: 'hunt bitter praise lift buyer topic crane leopard uniform network inquiry over grain pass match crush marine strike doll relax fortune trumpet sunny silk'
}
seed: c5d1fcaedbc58d17870e37b48581ef2b01c4c63a7fb82d5400b8b32ec68af006caa021f6b58234934e680ad7a49118f1aa25437d0093458dff5b2fd742d4b6d3
publickey 03f0a2d0a87840ded228fcd2d544f86cf765544615a479d0c788ed659ab7f45b6c
address {
  version: 'PubKey',
  prefix: 'kaspa',
  payload: 'qrc2959g0pqda53glnfd238cdnmk24zxzkj8n5x83rkktx4h73dkc5m2z4s4v'
}
address {
  version: 'PubKey',
  prefix: 'kaspa',
  payload: 'qrc2959g0pqda53glnfd238cdnmk24zxzkj8n5x83rkktx4h73dkc5m2z4s4v'
}
change address {
  version: 'PubKey',
  prefix: 'kaspa',
  payload: 'qqrvtndmu2h68q6npvk9d3w89eq7vuulkasxp2t26z7098rpsvf4qvvexy53r'
}
/home/dem/Projects/Kaspa/derive.js:44
    let privateKey = xPrv.derivePath("m/44'/111111'/0'/0/1").toPrivateKey();
                                                             ^

TypeError: xPrv.derivePath(...).toPrivateKey is not a function
    at /home/dem/Projects/Kaspa/derive.js:44:62
    at Object.<anonymous> (/home/dem/Projects/Kaspa/derive.js:76:3)
    at Module._compile (node:internal/modules/cjs/loader:1566:14)
    at Object..js (node:internal/modules/cjs/loader:1718:10)
    at Module.load (node:internal/modules/cjs/loader:1305:32)
    at Function._load (node:internal/modules/cjs/loader:1119:12)
    at TracingChannel.traceSync (node:diagnostics_channel:322:14)
    at wrapModuleLoad (node:internal/modules/cjs/loader:220:24)
    at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:151:5)
    at node:internal/main/run_main_module:33:47

Node.js v23.4.0

Desktop (please complete the following information):

OS: Debian 12
Kaspad version: 0.15.2
Node.js v23.4.0
npm list kaspa
Kaspa@ /home/dem/Projects/Kaspa
└──<EMAIL_ADDRESS>
Additional context
I have installed @dfns/kaspa-wasm 0.14.1 and manually moved it to node_modules/kaspa/kaspa/kaspa_wasm because kaspa index.js pointing to it index.js
globalThis.WebSocket = require('isomorphic-ws');
// globalThis.WebSocket = require('websocket').w3cwebsocket;
module.exports = require('./kaspa/kaspa_wasm');

You should not need to relocate any files as examples are self contained. node_modules folder is not used in examples. Did you use/download the official wasm release from releases github page and run example in the folder?
You should join Kaspa Discord #development channel, there are a lot of developers using these tools and someone will be able to point out what might be wrong in your process.

@aspect, okay so according to path defined in derivation.js and other example scripts
 const kaspa = require('../../../../nodejs/kaspa');
it looking for kaspa module in rusty-kaspa/wasm/nodejs which is empty, therefore i built kaspa_wasm
cargo install wasm-pack
cd ~/Projects/Kaspa/rusty-kaspa/wasm
$ wasm-pack build --target nodejs
[INFO]: 🎯  Checking for the Wasm target...
[INFO]: 🌀  Compiling to Wasm...
    Finished `release` profile [optimized] target(s) in 0.19s
[INFO]: ⬇  Installing wasm-bindgen...
[INFO]: Optimizing wasm binaries with `wasm-opt`...
[INFO]: ✨   Done in 0.44s
[INFO]: 📦   Your wasm pkg is ready to publish at /home/dem/Projects/Kaspa/rusty-kaspa/wasm/pkg

And i'm stuck, rusty-kaspa/wasm/nodejs still empty, guess i missed to build something else.
ps. i have joined #develompent channel

You should use pre-built wasm to run examples. Try downloading wasm zip from releases and running example from there.
If you want to build from source you need to use corresponding build scripts in the wasm folder (build-node) and also do npm install in the examples (or wasm) root folder (for nodejs websocket dependency).

Alright, precompiled wasm made scripts working including derivation.js


feature: Use positive/negative instead of assert.Greater(t, 0, a)/assert.Less(t, 0, a)

For records, I started working on the implementation of this feature request.
https://github.com/Antonboom/testifylint/blob/master/CONTRIBUTING.md#negative-positive
I created the issue to keep a track of it, and allow other people to discuss it.
Stay tuned, and ping me if you see no progress in the next month.

:v:


Brutus needs access to the repo

Describe the bug
Brutus cannot access the repo:
Pushing pull request branch to 'origin/autoupdates/pre-commit/pre-commit-hooks'
  /usr/bin/git push --force-with-lease origin autoupdates/pre-commit/pre-commit-hooks:refs/heads/autoupdates/pre-commit/pre-commit-hooks
  remote: Permission to beeware/actions.git denied to brutusthebee.
  fatal: unable to access 'https://github.com/beeware/actions/': The requested URL returned error: 403
  Error: The process '/usr/bin/git' failed with exit code 128

source: https://github.com/beeware/actions/actions/runs/9246153096/job/25433383044#step:9:98
Steps to reproduce
See Actions failure.
Expected behavior
Brutus can checkout and commit to repo.
Screenshots
No response
Environment
n/a
Logs
No response
Additional context
No response

Darn robots, always asking for things... :-)
I've added permissions, and re-run the failed job to confirm, which has passed.


"double callback" errors when nock.disableNetConnect() called twice

@pasupulaphani could you please post a snippet that makes this happen?

Please consider a scenario where this is called in Mocha before method and somewhere in tests we wanted to ensure it is set, so, calling it again in a test causes the fail.

@pasupulaphani From you description I'm not sure how to reproduce this.
Please feel free to reopen this ticket once you post a snippet I can reproduce.

I guess it could be because we are on 2.15.0 :/


Add call for maintainers

[#175826621]

[APPROVALNOTIFIER] This PR is NOT APPROVED
This pull-request has been approved by: joshuatcasey
To complete the pull request process, please assign sawlanipradeep after the PR has been reviewed.
You can assign the PR to them by writing /assign @sawlanipradeep in a comment when ready.
The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@googlebot I signed it!

The project has found new maintainers. 🎉  Thanks to @lizan and @ZackButcher for offering to take over!
This PR is no longer needed.

The project has found new maintainers. 🎉  Thanks to @lizan and @ZackButcher for offering to take over!
This PR is no longer needed.


Test that toHttpService returns a live response body

This is what they call foreshadowing.  It's broken in master, but let's put up the safety net here.

I'll do that one, with fix, as a PR when I get back to a computer.


Fix unterminated `s' command

Original version results in "sed: -e expression #1, char 9: unterminated `s' command"
sed (GNU sed) 4.4
Distributor ID:	Debian
Description:	Debian GNU/Linux 9.13 (stretch)
Release:	9.13
Fixes #9

@kellymarchisio Thanks for this fix!


Refactor project.json generation in boot.go

The boot/boot.go file selects one of two templates for project.json when the apex init command is run: projectConfig when an IAM role is present; and projectConfigWithoutRole when no IAM role is present. They are meant to differ only by the presence of a role key, the defaultEnvironment key.
As implemented, it's a bit of a maintenance chore to keep the two JSON templates in sync if a change is made to the project.json format.
Since the separation is only to handle an optional role value, I propose using text/template instead of fmt.Sprintf for the inline template and subsequent interpolation.
I have a PR nearly-complete for this, in case it's a decision the maintainers support.

they're pretty tiny so it's not much work, but wouldn't hurt to have a template!


Create oracle user step is missing

There is a step to switch to the oracle user, but the oracle user does not exist.
Please add the step to create the user before switching.

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 279359a4-139a-ee4b-027b-4f43c538b90f
Version Independent ID: 950014e2-2457-6045-eefd-865bd1c1fb76
Content: Create an Oracle database in an Azure VM - Azure Virtual Machines
Content Source: articles/virtual-machines/workloads/oracle/oracle-database-quick-create.md
Service: virtual-machines
Sub-service: oracle
GitHub Login: @jjaygbay1
Microsoft Alias: jacobjaygbay

Closed by customer


Add UNO game #283

Add UNO game #283
Issue #283
close #283

The card in the home page of the solve it site is not showing up correctly, sob div tag issue.

Make it responsive and I will merge the PR.

The link in the readme redirects to another project of JWoC.

It's not showing up correctly in mobile phones.

check it


Index using bulk commands?

The docs recommend using the bulk API to index documents in batches for better performance. Low priority for now, especially since we have a cluster of one.
https://www.elastic.co/guide/en/elasticsearch/guide/current/bulk.html

I think there's little to be gained here from using the bulk API, closing.


TypeError: cheerio is not a function

I'm trying out spectaql (0.2.0) for the first time, and I'm hitting the following error:
$ npx spectaql docs/spectaql.yml

COULD NOT LOAD EXAMPLE PROCESSOR

Running "sass:full" (sass) task

Running "sass:foundation" (sass) task

Running "concat:css" (concat) task

Running "cssmin:css" (cssmin) task
>> 1 file created. 140.88 kB → 121.62 kB

Running "concat:js" (concat) task

Running "uglify:js" (uglify) task
>> 1 file created 6.82 kB → 3 kB

Running "clean:html" (clean) task
>> 0 paths cleaned.

Running "compile-handlebars:compile" (compile-handlebars) task
Task error: [TypeError: cheerio is not a function
  at Object.markdown (/Users/trobinson/fittfinder/fittfinder-service/node_modules/spectaql/app/lib/common.js:84:15)

I tried running npm i -D cheerio, but got the same error. I'm running against a schema file:
introspection:
  schemaFile: ./dist/schema.graphql

servers:
  - url: https://example.com/graphql
    description: Production
    production: true

I tried with a trivial schema too, and got the same error:
schema {
  query: Query
}

type Query {
  test: Int
}

node/npm/OS version:
$ node -v
v12.18.4
$ npm -v
6.14.6
$ uname -v
Darwin Kernel Version 20.3.0: Thu Jan 21 00:07:06 PST 2021; root:xnu-7195.81.3~1/RELEASE_X86_64

After digging in to the root cause, I came across this: https://github.com/cheeriojs/cheerio/releases
Which shows that cheerio released 1.0.0-rc.9 a few days ago. So, I'm guessing that the problem for some began because the package.json specifies "cheerio": "^1.0.0-rc.2"...but if you do a new install today, you will actually get "1.0.0-rc.9".
In release v1.0.0-rc.9, they list the following breaking change:

Breaking change: If you were using the function exported by Cheerio directly instead of first load()ing a document, you will now have to update the require to use the default export.

Which is right onto what @benhickson was getting after.
However, it then goes on to state:

Please note that this way of using Cheerio is deprecated and might be removed in a future version. Please consider updating your code to:
const cheerio = require("cheerio");
const $ = cheerio.load(dom)
$('div')

So, I've opted to change the code to the way suggested in the docs vs just adding the .default to the require. Feels like the better way to go since I saw that.
Thanks for bringing this up!

Looks good! thanks @newhouse

Thanks @newhouse, can't wait to try it out! Also, you're a towel. 😂

@newhouse When should we expect this to arrive on NPM?

@newhouse When should we expect this to arrive on NPM?

Fix is in 0.2.1 available now. @benhickson