Crashing during search - Memory Exhausted?

What version of OR-tools and what language are you using?
Version: v8.1
Language: python 3.8.3
Which solver are you using (e.g. CP-SAT, Routing Solver, GLOP, BOP, Gurobi)
CP-SAT
What operating system (Linux, Windows, ...) and version?
Windows 10
i5-9300H
16GB memory
What did you do?
Steps to reproduce the behavior:

execute python script with model and solver

What did you expect to see
Expected to execute until script reached max_time_in_seconds.
What did you see instead?
It just stops after the 2nd bound after starting search and exits python.  Seems to be memory-related, as I'm also getting resource-exhausted errors in Windows event viewer.
Make sure you include information that can help us debug (full error message, model Proto).
Output from log_search_progress:
Parameters: max_time_in_seconds: 3600 log_search_progress: true num_search_workers: 8
Optimization model '':
#Variables: 707500 (3 in objective)
 - 119 different domains in [-3480,18588000] with a largest complexity of 2.
 - 9 constants in {0,1,10,100}
#kBoolOr: 560079 (#literals: 1677029)
#kIntMax: 3957
#kIntProd: 3
#kLinear1: 198841 (#enforced: 136375)
#kLinear2: 18114 (#enforced: 11012)
#kLinear3: 46
#kLinearN: 93075 (#enforced: 30111)
*** starting model presolve at 0.55s
Merged 474872 into 398474 cliques
- 184389 affine relations were detected.
- 180749 variable equivalence relations were detected.
- rule 'TODO variables: only used in encoding.' was applied 577 times.
- rule 'at_most_one: removed literals' was applied 52392 times.
- rule 'at_most_one: transformed into max clique.' was applied 1 time.
- rule 'bool_and: always false' was applied 1659 times.
- rule 'bool_and: fixed literals' was applied 2009 times.
- rule 'bool_and: non-reified.' was applied 2019 times.
- rule 'bool_or: always true' was applied 54051 times.
- rule 'bool_or: fixed literals' was applied 54045 times.
- rule 'bool_or: implications' was applied 3445 times.
- rule 'bool_or: only one literal' was applied 2024 times.
- rule 'bool_or: removed enforcement literal' was applied 11047 times.
- rule 'bool_or: singleton' was applied 53809 times.
- rule 'deductions: 698621 stored' was applied 1 time.
- rule 'enforcement literal not used' was applied 16 times.
- rule 'false enforcement literal' was applied 1008 times.
- rule 'int_abs: converted to equality' was applied 317 times.
- rule 'int_abs: propagate domain x to abs(x)' was applied 3640 times.
- rule 'int_abs: store abs(x) == y' was applied 3640 times.
- rule 'int_prod: linearize product by constant.' was applied 3 times.
- rule 'linear: always true' was applied 1765 times.
- rule 'linear: dual fixing' was applied 5 times.
- rule 'linear: empty' was applied 346 times.
- rule 'linear: fixed or dup variables' was applied 1336 times.
- rule 'linear: infeasible' was applied 317 times.
- rule 'linear: negative clause' was applied 1606 times.
- rule 'linear: negative equal one' was applied 51362 times.
- rule 'linear: negative reified and' was applied 68695 times.
- rule 'linear: positive at most one' was applied 2980 times.
- rule 'linear: positive clause' was applied 13004 times.
- rule 'linear: positive reified and' was applied 57649 times.
- rule 'linear: reduced variable domains' was applied 11254 times.
- rule 'linear: remapped using affine relations' was applied 20499 times.
- rule 'linear: simplified rhs' was applied 89452 times.
- rule 'linear: singleton column' was applied 59778 times.
- rule 'linear: size one' was applied 123022 times.
- rule 'linear: variable substitution 0' was applied 1004 times.
- rule 'linear: variable substitution 1' was applied 454 times.
- rule 'objective: variable not used elsewhere' was applied 2655 times.
- rule 'presolve: iteration' was applied 1 time.
- rule 'true enforcement literal' was applied 3030 times.
- rule 'variables: detect fully reified value encoding' was applied 52404 times.
- rule 'variables: detect half reified value encoding' was applied 175868 times.
Optimization model '':
#Variables: 390655 (13214 in objective)
 - 130 different domains in [-8,176] with a largest complexity of 2.
#kAtMostOne: 108098 (#literals: 440379)
#kBoolAnd: 9501 (#enforced: 9501) (#literals: 290376)
#kBoolOr: 413498 (#literals: 1629965)
#kIntMax: 3640
#kLinear1: 21071 (#enforced: 21071)
#kLinear2: 10920 (#enforced: 7280)
#kLinearN: 11501 (#enforced: 7861)
*** starting Search at 31.42s with 8 workers and subsolvers: [ auto, lp_br, pseudo_cost, no_lp, max_lp, core, rnd_lns_auto, var_lns_auto, cst_lns_auto, rins/rens_lns_auto ]
#Bound  60.56s best:inf   next:[27200,10297000] init
#Bound  84.36s best:inf   next:[27270,10297000] init

Python application error from Windows Event Viewer:
Faulting application name: python.exe, version: 3.8.3150.1013, time stamp: 0x5ebc7702
Faulting module name: ucrtbase.dll, version: 10.0.19041.546, time stamp: 0x43cbc11d
Exception code: 0xc0000409
Fault offset: 0x000000000007287e
Faulting process id: 0x47d0
Faulting application start time: 0x01d6fa3edd3f9808
Faulting application path: C:\Program Files\Python38\python.exe
Faulting module path: C:\WINDOWS\System32\ucrtbase.dll
Report Id: 242daa72-5542-478b-9598-2f6c646151fe
Faulting package full name:
Faulting package-relative application ID:

Resource-Exhaustion-Detector error in Windows Event Viewer:
Windows successfully diagnosed a low virtual memory condition. The following programs consumed the most virtual memory: python.exe (18384) consumed<PHONE_NUMBER>4 bytes, sublime_text.exe (9172) consumed 660381696 bytes, and sqlservr.exe (7384) consumed 622186496 bytes.

Anything else we should know about your project / environment

yes. Not much we can do.
You can try reducing the number of workers, at the cost of solving performance.

You can look at your model, trying to simplify it. Or break it in multiple pieces.


Stop running prettify during regen_all for java files

Code should be readable enough as-is, prettify is just slow and makes --dry-run execution not fully express what needs to be run.

I assume we can still format java source file manually

You can if you want, however in this particular case these are part of zap_regen_all, so any re-formatting would fail the zap validation check. This means we expect people to not try to merge formatted files for these codegen files.
If something looks ugly, the jinja template should be updated. Expectation is that jinja is flexible enough to make good looking code (except probably overly long lines).


Allow to define the path of the shell in app preferences

This PR allows user to define the path of the shell used in Lens terminal.

Fixes #482

@ixrock added some changes based on your review comments. PTAL.

Thank you @nevalla for taking this on.  The work is greatly appreciated.

@nevalla Please resolve conflicts

Conflicts resolved @jakolehm @Nokel81 PTAL again.


Cannot read property 'close' of null

Visual Studio Code Version : [ 1.5.3 ]
Code Sync Settings Version : [ 2.3.0 ]
Operating System : [ Windows 10 ]
Occurs On: [Download]
When I setup sync for the first time, I commonly invoke download settings which in tern prompts for git token and gist id.  Instead, I just get "Cannot read property 'close' of null".
I am not seeing any console output, not sure where I grab that.

oh yes! i forget to add that
Fixed in 2.3.1 :).
Let me know if its not working

Confirmed fixed, thanks!


Move setuptools to 35.x

fixes #477

Coverage remained the same at 72.344% when pulling f0d109bbf6a615ed36f66776df144b14be759224 on arcivanov:issue_477 into 0e5fae4a0a8db6511975da1c9bd1d45ccb539fcb on pybuilder:master.


Convert dict keys to list in acme module

Hi! I've found one more place where we need to convert dict_keys to a plain list (related to saltstack/salt#56243).

Nice! thanks :)


Converted log collection form to Angular

The log collection form is the 3rd form that deals with FileDepot and now undergoing AngularJS conversion.
The other two forms Schedule Editor and Diagnostics Database are already converted to AngularJS.
https://bugzilla.redhat.com/show_bug.cgi?id=1217348

@brandondunne This PR should fix the issue that you were seeing with log collection.

@AparnaKarve One concern:  Selecting a "RedHatDropbox" depot should not prompt for depot_name or uri.
Everything else appears to be working.

@brandondunne Ensured that Depot Name and Uri are hidden for "Red Hat Dropbox".
Please verify. Thanks.

The UI also used to show a text box for "support case" on Red Hat Dropbox, sorry I forgot about that.
Also, the FileDepot that was created is of the right type, but it has the wrong values.  Are you sending blank strings?
=> #<FileDepotFtpAnonymousRedhatDropbox id: 165, name: "", uri: "ftp://", created_at: "2015-05-04 19:52:12", updated_at: "2015-05-04 19:52:12", type: "FileDepotFtpAnonymousRedhatDropbox", support_case: nil>

Are there any tests to go along with this?  Remembering all of these things and ensuring everything is tested by clicking on it is very error prone. :worried:

Good point @brandondunne, we definitely need tests for the new converted areas to ensure they remain testable going forward.

@brandondunne I verified that the UI still shows the text box for "support case" on Red Hat Dropbox.
Please confirm if you see it.
I also fixed the JS that was sending blank param values.
Since the testing around this is so UI-centric, I have added new Jasmine specs for a few functions to check if only the necessary params have values in it and the rest are null so that they do not end up at the backend.

Things appear to be ok clicking around in the UI.
Tested:

Entering edit screen for a zone without log collection configured
Setting log collection type for Red Hat Dropbox
Entering edit screen for a zone configured for log collection
Changing to a different log collection type.
Validate button calls the correct model to validate credentials
Saving changing depot type
Canceling edit
Available fields change based on the type

@dclarizio @AparnaKarve do we have tests for the several hundred lines of javascript added in this PR?

@jrafanie Yes, there are Jasmine tests added for the JS code
Check out -
log_collection_form_controller_spec.js
miq_db_backup_service_spec.js
miq_service_spec.js

Great, thanks @AparnaKarve, I guess I'm blind... not sure why I didn't see them. :+1:

No worries @jrafanie , it happens to the best of us.


[Feature] add support for celltype = 'checkbox' and 'radiobutton' in  exportVTableToExcel

What problem does this feature solve?
Currently export for checkboxes only works with CSV export.
Also - it would be very usefull to have an option to localize the exported boolean value. Checkbox might make sense in UI, but in Excel some users might prefer seeing "Yes/No" (or whatever other custom value) instead of "True/False".
What does the proposed API look like?
Export API is fine as it is.
Localization can be implemented as a general arrow function that takes export-ready cell value and modifies it if neccessary.
Like:
formatExportOutput((cell) => {
 if (cell.cellType === 'checkbox')
 {
 cell.value = cell.value ? 'Yes' : 'No';
 }
 return cell;
});

This is a very good suggestion! We will schedule it into our development plan.


Add support for Python code snippet Record Transformations

This would run similar to XSLT transformations.
Doesn't seem that complicated from a high-level.  Could operate much like the python validations scenarios where they are passed an instance of each record as input with record.xml (etree node) and record.raw (raw XML string).
Simplest output would be XML string.
Wrap this in a UDF function.

Done.


Fix multiple connect() not to call multiple observe()

Current ConnectableSignal.connect() introduces multiple observation between source and subject so that event replicates multiple times.
Fix to observe only once.

Check fails.... Please check this out.

Travis is not configured correctly.


patchReactNativeWeb doesn't work on Windows

Describe the bug
patchReactNativeWeb doesn't work correctly on Windows.
This seems to be due to patchReactNativeWeb not correctly handling \ as a file path separator. It looks like this should mostly be fixable just by replacing \/ in the regex with [\\/] here (although I haven't tested that so might be other code which doesn't handle windows file separators either) https://github.com/tamagui/tamagui/blob/master/packages/static/src/patchReactNativeWeb.ts#L12
To Reproduce
Try to run the next-expo-solito starter on Windows.
Environment (please complete the following information):

OS: Windows
Browser: N/A
Version: 1.0.1-beta.57

Made that change in beta 59, feel free to open another if it breaks in some other way.


Update aws-java-sdk-kms to 1.12.437

About this PR
📦 Updates com.amazonaws:aws-java-sdk-kms from 1.12.435 to 1.12.437
Usage
✅ Please merge!
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

⚙ Adjust future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "com.amazonaws", artifactId = "aws-java-sdk-kms" } ]

Or, add this to slow down future updates of this dependency:
dependencyOverrides = [{
  pullRequests = { frequency = "30 days" },
  dependency = { groupId = "com.amazonaws", artifactId = "aws-java-sdk-kms" }
}]

labels: library-update, early-semver-patch, semver-spec-patch, commit-count:1

Superseded by #195.


Backport 0.15: log submariner component's version on startup

Signed-off-by: cyclinder<EMAIL_ADDRESS>(cherry picked from commit fb660d93634eb7b42d17b1d4834a13aec1864476)

This doesn't backport cleanly to 0.14. Do we want backports to branches other than 0.15?


test build

Coverage increased (+0.8%) to 70.267% when pulling 15ae14fcd51917d4b799fa56ad9a34d24f53b72e on andrewjdawson2016:Test into d744b1231aadf6316c399c66fd2d6a0ea3685211 on uber:master.


Api last seen

I recommend adding last seen timestamp to output of /api/get_player_status?id={id} when user is offline

The latest_activity column in the users table could be used for this.

The latest_activity column in the users table could be used for this.

Yeah but still this option would be nice via api, I don't think it's much to implement because its just taking data from one column as you said.

That’s cmyui’s point - he’s giving you a pointer on to how to implement it yourself.

That’s cmyui’s point - he’s giving you a pointer on to how to implement it yourself.

Oke, I'll do it myself.


[Question]: Can you explain the derivation of the TTC?

Hi,
Thanks for sharing your work! Can you explain how did you deduce the TTC equation in line https://github.com/davisbo/NHTTC/blob/2139ebcf7e4d9ac89a389c98a3d4302a6b9179a4/src/sgd/ttc_sgd_problem.cpp#L80
?
Best regards,
Bruno

Hello--
Here's a write-up of the TTC solve.  Section 1 shows the basics of the quadratic solver, and Section 2 shows the modifications to the solve in Section 1 we do for numerical speed considerations.
Let me know if anything still doesn't make sense.
TTC_solution.pdf
--Bobby

Dear Bobby,
Thank you so much for the quick and detailed reply. I'll check it later but I guess it should be fine ;)
Best regards,
Bruno


Element switches

Use /* */ comments - my bad on this one
Fix a mistake in strutil.c I made, the existing table initialisation was a bit confusing as there were multiple lengths but only the shortest was used. Reading the comments about Y and Z atoms makes it clearer.
Many linear table lookups can (should) be replaced with switches on the atomic number. These are the simple ones, is_centerpoint_elem_KET() is a nice example.

There are a few more in strutil/ichi_bns but needs explanation of what was going on so will do those separately.

Hi @johnmay,
This seems like an extension to the last pull request, and again looks fine.
I expect that there will be an additional performance gain since for loops have been swapped with case statements.
Thanks again.


[add-resource] New Plugin/Theme

I would like to add my new plugin/theme to the Grav Repository.
Here are the project details: https://github.com/normanwink/grav-darkadmin
It basically adds a CSS override for the Grav Admin Plugin to match the MacOS Mojave update and save your eyes at night.

Added to GPM


Qualys VM v2 data connector, workbook , detection

Fixes #
Original PR raised by pbankar28: Added pagination support and flatten the data. by pbankar28 · Pull Request #969 · Azure/Azure-Sentinel (github.com)

Updated data connector and workbook, detection queries as per new changes.

Proposed Changes

@pbankar28 , As per latest Qualys V2 changes created new data connector, workbook and detections without impacting existing one.
Can you please test and review this PR. let me know if any changes required. Thanks!

@pbankar28 , Can you please review and approve this PR ? Thanks!

@pbankar28 : Could you please review the changes and provide sign-off?
This is blocking us from check-in... Thanks!!!


Add Catalyst specific Lightning Kokkos class

Context: Catalyst needs to build a class wrapping the Lightning Kokkos class. Here we are moving the logic from Catalyst to the Lightning repository.
Description of the Change: Moving code from Catalyst to this repository and updating the build system to build against Catalyst.
Benefits: Catalyst wheels will build faster.
Possible Drawbacks: Our build system now relies on headers coming from Catalyst. It is unclear if this may cause a deadlock in the future because of our cyclic dependencies (PennyLane, PennyLane Lightning, Catalyst). Chances are small because we don't rely on Catalyst wheels or build it from scratch.
Related GitHub Issues:

Catalyst files were moved from here.
I only updated the copyright date, but we might want to return to this later and review these files.

Tests are still needed.


WIP: Support injection via constructor for service dependencies

Allows to avoid boilerplate when services are declared through factory methods but only pass parameters to the constructor.
    @Provides
    DynamicCallContextTracker create(@FromConstructor DefaultDynamicCallContextTracker service) {
        return service;
    }

The new FromConstructor annotation indicates that this parameter must be create directly from the constructor of the corresponding type, instead of being looked up.
This allows replacing the imperative configure setups:
    void configure(ServiceRegistration registration) {
        registration.add(DynamicCallContextTracker.class, DefaultDynamicCallContextTracker.class);
    }

Superseded by https://github.com/gradle/gradle/pull/29764


Update input-datetime.json

Enabled by default in Firefox 56 (the current Nightly): https://blog.nightly.mozilla.org/2017/06/12/datetime-inputs-enabled-on-nightly/

Thanks!


right click paste issue

monaco-editor version: 0.X.Y
Browser:
OS:
Playground code that reproduces the issue:

Duplicate of https://github.com/microsoft/vscode/issues/82604


running hugectr with multi nodes

Is there any whole tutorial  about running hugectr with multi nodes ?
I have try this:
Follow the examples(https://github.com/NVIDIA/HugeCTR/tree/master/samples/dcn2nodes) , what have done is:
Build an mutlinode  support images:

base on the dockerfile in hugectr
install hwloc2.2.0
install ucx-1.8.0
install openmpi4.0.3 withe ucx support
install mpi4py 3.0.3
build ctr :  cmake -DCMAKE_BUILD_TYPE=Release   -DSM=70  -DENABLE_MULTINODES=ON   ..

Run hugectr  with two  NVlink supported    8*V100(32G) phyical machines.

Start command is:
export  SSH_PORT="xxx"
export NP="2"
export WORK_DIR="/data/dcn_data/"
export HOSTS="ip1:1,ip2:1"
export ARGS=" ./bin/huge_ctr --train ./data/dcn-dist.json  "
cd   $WORK_DIR
bash  start_dist.sh

start_dist.sh:
set -x
mpirun --bind-to none  --allow-run-as-root -np $NP -H  ${HOSTS} -x LD_LIBRARY_PATH=${LD_LIBRARY_PATH}  -x LIBRARY_PATH=${LIBRARY_PATH} -x PATH=${PATH} -wdir ${PWD} --mca plm_rsh_agent "$PWD/ssh_resolver.sh" --mca btl_tcp_if_include  ib0   $ARGS > logs.txt 2>&1 &
ssh_resolver.sh:
#!/bin/bash
HOSTNAME=$1
shift
ARGS=$*
ssh -p "$SSH_PORT" "$HOSTNAME" "$ARGS"
My question is:
Is my mpirun command is correct ? Should I specfic ucx in mpirun?How hugectr use the ucx 、hwloc ? And how can I user Inifiniband \ RDMA to accelerate hugectr?
For example ,the ucx command looks like:
mpirun -np 2 -mca pml ucx -x UCX_NET_DEVICES=mlx5_0:1 ./app
https://github.com/openucx/ucx

My dockerfile looks like:
FROM   hugectrbase:0.0.1
#  build by: https://github.com/NVIDIA/HugeCTR/blob/master/Dockerfile

# install ssh  hwloc
RUN   apt-get install -y --no-install-recommends   net-tools  sysstat  wget libnuma-dev   build-essential         curl  ca-certificates    openssh-client openssh-server

# install hwloc2.2.0
RUN cd /tmp &&  wget  https://download.open-mpi.org/release/hwloc/v2.2/hwloc-2.2.0.tar.gz && \
tar -zxvf  hwloc-2.2.0.tar.gz && cd hwloc* && ./configure && make && make install && rm  -rf /tmp/*

ENV  UCX_DIR=/usr/local/ucx
ENV  LD_LIBRARY_PATH=$LD_LIBRARY_PATH:$UCX_DIR/lib
ENV PATH=$PATH:$UCX_DIR/bin
# install ucx
RUN cd /tmp && wget https://github.com/openucx/ucx/releases/download/v1.8.0/ucx-1.8.0.tar.gz && tar xzf ucx-1.8.0.tar.gz &&\
 cd ucx-1.8.0 &&   ./autogen.sh && ./contrib/configure-release --prefix=${UCX_DIR} &&\
  make -j8 install  && rm -rf /tmp/*

# install openmpi
# https://github.com/openucx/ucx/wiki/OpenMPI-and-OpenSHMEM-installation-with-UCX
RUN   mkdir -p  /tmp/openmpi && \
    cd /tmp/openmpi && \
    wget https://download.open-mpi.org/release/open-mpi/v4.0/openmpi-4.0.3.tar.gz --no-check-certificate && \
    tar zxf openmpi-4.0.3.tar.gz && \
    cd openmpi-4.0.3 && \
    ./configure --enable-orterun-prefix-by-default  --enable-mca-no-build=btl-uct   --with-cuda=/usr/local/cuda  --with-ucx=${UCX_DIR} && \
    make -j $(nproc) all &&\
    cd /tmp/openmpi/openmpi-4.0.3 && \
    make install && \
    ldconfig && \
    rm -rf /tmp/*

# install mpi4py
RUN apt-get install -y libopenmpi-dev  &&  python3 -m pip install  -i  https://pypi.tuna.tsinghua.edu.cn/simple  --no-cache-dir    mpi4py

# set ssh
RUN cat /etc/ssh/ssh_config | grep -v StrictHostKeyChecking > /etc/ssh/ssh_config.new && \
    echo "    StrictHostKeyChecking no" >> /etc/ssh/ssh_config.new && \
    mv /etc/ssh/ssh_config.new /etc/ssh/ssh_config

# get hugectr code and build hugectr
RUN cd / && git clone https://github.com/NVIDIA/HugeCTR.git && cd HugeCTR && git submodule update --init --recursive \
 && mkdir build && cd build &&  cmake -DCMAKE_BUILD_TYPE=Release   -DSM=70   -DNCCL_A2A=ON  -DENABLE_MULTINODES=ON  \
 &&   make -j  \
 && rm -rf ./git

WORKDIR /HugeCTR

Hi, Thanks for trying HugeCTR for multi-node.
The HugeCTR mainly use UCX to communicate between nodes, which directly calls UCX(UCP) API to exchange data between GPUs from different nodes. The OpenMPI is only used to communicate the information that needed to set up the UCX runtime environment(i.e. UCP address etc.), so it is not performance critical(as long as nodes can use OpenMPI to communicate, it's Okay). The HugeCTR use dedicate UCX context to communicate the data, so it will not interfere with the built-in UCX context within the OpenMPI runtime environment. In short, OpenMPI is used to create the processes on different nodes(Currently, HugeCTR requires 1 process per node) and communicate metadata to set up connection for UCX. UCX will take care of the data transfer.
The HugeCTR use HWLOC to detect the number of CPU package(i.e. CPU socket) in your node. Then it will create a UCX context per CPU socket(HWLOC will be used to bind each UCX context to its target CPU socket). When performing communication, each GPU will directly send and receive data via its affinity UCX context(i.e. the UCX context within the same CPU socket as this GPU). If your UCX is built with CUDA support, it should automatically select the fastest network to perform the communication from GPU(i.e. it will prefer InfiniBand/RDMA network over the TCP network automatically if there are RDMA-enabled network adapters on the same CPU socket with your GPUs).  In short, you don't have to specify anything about locality and network for "mpirun", HugeCTR already bind affinity for you. As long as your RDMA network is well-installed and UCX is CUDA-supported, UCX will utilize GPUDirect RDMA automatically(RDMA network should be on the same CPU socket with GPU to enable GPUDirect RDMA). Of coarse, you can still specify "-x UCX_NET_DEVICES=mlx5_0:1"  to manually restrict the network used by UCX if you think the UCX is not using the correct/optimal network.
Because the multi-node environment might be very different for different user(i.e. some cluster may use slurm), HugeCTR doesn't provide a standard docker for multi-node. Also, the mpirun command line maybe different for different cluster environment. Generally, you should provide the information to mpirun to access and create processes on specified host(i.e. -H and -np etc.). Locality and network-related command lines are not needed. I think your command line is Okay.

Update: In v2.2 release, the default communication library used by HugeCTR is NCCL, so UCX and HWLOC will not be used by default. NCCL will also automatically detect topology and select the optimal approach to communicate between GPUs in both intra-node and inter-node environment. So, again, you don't need to specify anything about locality and network for "mpirun".

Update: In v2.2 release, the default communication library used by HugeCTR is NCCL, so UCX and HWLOC will not be used by default. NCCL will also automatically detect topology and select the optimal approach to communicate between GPUs in both intra-node and inter-node environment. So, again, you don't need to specify anything about locality and network for "mpirun".

Hi, I want to know how does NCCL compare to UCX's or Gossip's performance in both intra-node and inter-node environment? Is there relevant test data? :)


trying to downcast (Int32 | Nil) <- Int32 (Exception)

Hey,
I must be the biggest noob who ever came here, by advance, my apologies if I waste your time (I check, bug doesn't look to be reported yet).

Crystal / Debian version:

Crystal 0.28.0 [639e4765f] (2019-04-17)

LLVM: 4.0.0
Default target: x86_64-unknown-linux-gnu

Debian GNU/Linux 9.9 (stretch)

Code:

def bug
  while true
    puts "Enter an integer"
    begin
      foo = gets.not_nil!.to_i
      break
    rescue
      puts "error"
    end
  end
  puts foo
end

bug

Error message :

BUG: trying to downcast (Int32 | Nil) <- Int32 (Exception)
  from ???
  from ???
  from ???
  from ???
  from ???
  from ???
  from ???
  from ???
  from ???
  from ???
  from ???
  from ???
  from ???
  from ???
  from ???
  from ???
  from ???
  from ???
  from ???
  from ???
  from ???

Thanks for reporting. When the compiler says there's a bug, there's definitely a bug. No matter the user ;)

Reduced:
while true
  begin
    foo = 1
    break
  rescue
  end
end
foo


How to set a value in the hidden field before saving the form

Laravel Version: 5.5
PHP Version: 7.1.26
Laravel-admin: 1.6.9

Description:
Hello,
I tried to follow this example, but it did not work.
Error

Steps To Reproduce:

My Model

Table Artigo

Table Admin_users

Anyone have any tips on what I should do?

Try this:
$form->hidden('persion_id')->default(Admin::user()->persion_id);

Thank you @ichynul, it worked!


Bug fixing and now the video dashboard support multiples cameras

Solve bug fixing with the topics
Now video dashboard support multiples cameras

Closed because it's fused in another pull request


Dart Services API v2

This PR adds a new API version, utilising Protobuf to define the wire format content. It exposes both  Protobuf and JSON wire formats. The content of the Protobuf API has been setup to match the current v1 API as closely as possible.
This PR includes:

Adds the protobuf endpoints

api/dartservices/v2/analyze
api/dartservices/v2/compile
api/dartservices/v2/complete
api/dartservices/v2/document
api/dartservices/v2/fixes
api/dartservices/v2/version

Updated example app, upgraded to Dart 2 and usable with webdev, for exploring the new API
Refactored test suite, pulling out the Redis tests, and adding matching coverage for v1 and v2 of the API

The output from the new API v2 endpoints mostly match the similarly named endpoints under api/dartservices/v1/. The primary difference in output is that this version doesn't return empty collections. This is most visible with the analyze endpoint, where v1 will return the following structure for an empty analysis:
{
   "issues":[
   ],
   "packageImports":[
   ]
}

The new v2 API will instead return {}.

As to Protobuf using the dart toolchain from inside your included flutter repo, that's definitely broken. What does which dart from your nearest shell show?

Is it faster? 😃

@kevmoo It's step 1 of a multi-step process for weening ourselves off of package:rpc, which should make @mit-mit lots happier =) (Step 2 is https://github.com/dart-lang/dart-pad/pull/1501)
But no, it's not appreciably faster, as we are still sending JSON blobs back and forth for the time being. Even migrating from JSON to Protobuf for the wire format wouldn't buy us appreciable speed up, package:protobuf doesn't appear to compress String content from the network traces I've seen.

Cool. Just checking. Ditching pkg:rpc is good enough reason. :-)
On Mon, Mar 16, 2020 at 8:52 PM Brett Morgan<EMAIL_ADDRESS>wrote:

@kevmoo https://github.com/kevmoo It's step 1 of a multi-step process
for weening ourselves off of package:rpc, which should make @mit-mit
https://github.com/mit-mit lots happier =) (Step 2 is
dart-lang/dart-pad#1501 https://github.com/dart-lang/dart-pad/pull/1501)
But no, it's not appreciably faster, as we are still sending JSON blobs
back and forth for the time being. Even migrating from JSON to Protobuf for
the wire format wouldn't buy us appreciable speed up, package:protobuf
doesn't appear to compress String content from the network traces I've seen.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/dart-lang/dart-services/pull/484#issuecomment-599864344,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAAEFCWWASPY46554KR2UIDRH3XY5ANCNFSM4KXS3FVQ
.


Public Rss Bridge for the Community.

Dear All,
Excuses I am posting this message probably in the wrong location but I sent the 'owner' an email a while back and didn't get an answer. On the main GitHub page I read a request about providing public available Rss Bridge hosting for the community and so I created it and hereby the link :
Link : https://rssbridge.tomdings.com/
Hopefully the configuration I used is correct. If anything is done in the wrong way please let me know and I will change it immediately.

Nice detail ... The link mentioned above is hosted - currently - on 4 different servers in Germany, France, United States and Hong Kong. The moment I have a few minutes I will add some more hosting locations. Hopefully some people are happy with the service.

It is automatically updated the moment a newer release will be available at GitHub !
For now ... Enjoy your day!

Just added Canada and Russia for now.
Some others will be available later on.

Getting many times the notification about accessing / pulling the Rss Bridge website to update the Rss Feeds as fast as possible. Please do not worry a moment. Accessing the website every minute is totally not needed but if that's what you want ... Please go ahead.
Capacity enough to handle millions of requests in extreme short periods of time. Cloudflare is handling incoming requests - only service I use from them - and thanks to the HaProxy setups it is - almost - impossible to create system over-loads.

If in any situation capacity is increasing ... New servers are ordered, installed, configured and coming available fully automatically. And this situation is running like this for many years already. Enjoy the services!

I was thinking about some solution which helps you and other people maybe even more. Getting really a lot of customization requests since yesterday and - as always - I like to help everyone solving their issues :
Will create a service - announcing it at https://www.facebook.com/Free-WebServices-Social-Rss-Bridges-327883021177972/ -. Anyone who likes to have an - additional / extra / own - service based on the existing Rss Bridge application is able to request it. I will create the service and host it for free.
This way you will be able to use Rss Bridge the way you want it. Some link will be available with a version of the application with all custom solutions in it too. Of course more than a single request will be allowed and created if you want in an existing environment if you requested anything earlier.
Hopefully many of you are helped with this solution. For now enjoy your day!

Adding an addition now to store Rss Feed embedded media [photos / videos] on different storages.
This way Social Media providers are not able to see / create any statistics anymore based on the media content used from their platform. Tested it already and using it on another website already.
Website: http://mySocialFeeds.com/ [ Currently updating! ]

Screen dump to show how I monitor the Rss Feed embedded importing items real-time. Will make it public available very soon. Reading the address bar is not helping of course. Changed the location ;-)

If you are willing to share your server for everyone, please don't hesitate to add it to the list of public hosts on the Wiki (so far as I can tell you already did this). Of course, everyone is free to use these servers at their own risk.
Other than that we don't track each server, because there are hundreds if not thousands of servers by now. Tracking all of them here would overwhelm the issue tracker. If a bridge fails the error dialog will allow users to open an GitHub issue here. Other than that I suppose you should setup update notifications on your server, so we can focus on project development here.

I sent the 'owner' an email a while back and didn't get an answer

I don't know who you send the mail to, but the best way to get in contact with us is via this issue tracker. You can always ping someone using the @ mention like this: @MrCoding


Add max_message_chars to LLM

What is the problem that this fixes or functionality that this introduces? Does it fix any open issues?
This PR adds max_message_chars to the LLM class to make it available within Agents, reducing the reliance on global configuration.
Non-trivial design decisions
Note that I also added typing to some functions, and  as a result had to change some ternaries to if statements to satisfy mypy.
Other references
Part of https://github.com/OpenDevin/OpenDevin/issues/2758

Sorry, I'm actually going to close this in favor of a larger refactoring of the LLM class, please ignore!


Pass events for can-event

Fixes #1195

I agree. This doesn't break any other libraries where passing event arguments isn't possible anyway and it fixes an actual issue. Will go into 2.2, thanks!


Fix for large padding

As shown in this Codepen using Plotly.js which is wrapping d3-sankey (https://codepen.io/anon/pen/vvgYEx) when nodePadding is too large, nodes end up with negative heights. This PR fixes this by reducing the padding appropriately to use at most 2/3 of the total vertical space.

Hey, thanks for the suggestion and sorry for the delayed response. This PR includes the built files (which shouldn’t be checked in), and the implementation also mutates the value of py, whereas what we should be doing instead is using a different value for py while computing the layout, such that the specified sankey.nodePadding is preserved if the layout is called again (and no reduction in the padding is required). I’m going to close this PR and try to tackle this issue myself but if you are still inclined to contribute, please reopen this PR or submit a new one. Thank you!


A problem about fmt::sprint

I have already install fmt  in the directory /usr/local/include. But when I $make, it reported error:‘sprintf’ is not a member of ‘fmt’. What happens and how can I fix it?Thanks a lot if you could share some advice!

Hello,
You don't need to install libfmt, since I've already moved some of the core codes into the repo.

Hello,
You don't need to install libfmt, since I've already moved some of the core codes into the repo.

Thanks!


Can create win10/win11 with b1ls size successfully from Azure Portal

Hi team,
From the document b1ls is supported only Linux.
However, I can create win10/win11 VM with b1ls size successfully from Azure Portal.
Could you check if we need to update this document?

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 0cd2e24b-0fd3-d698-2840-3f8206933026
Version Independent ID: 832dc371-480a-c74a-e956-e1904473af31
Content: B-series burstable - Azure Virtual Machines
Content Source: articles/virtual-machines/sizes-b-series-burstable.md
Service: virtual-machines
Sub-service: sizes
GitHub Login: @rishabv90
Microsoft Alias: risverma

@brusetai
Thanks for your feedback! We will investigate and update as appropriate.

@brusetai
Thanks for bringing this to our attention.
I'm going to assign this to the document author so they can take a look at it accordingly.

@rishabv90
Can you please check and add your comments on this doc update request as applicable.

Thanks for your contribution to our documentation
We sincerely apologize for the delayed response. Unfortunately, we have been unable to review this issue in a timely manner. However, we are making overall enhancements to our content. We are closing this issue for now as there has been no activity for a while. If you feel that the problem persists, please respond to this issue with additional information.
?
Please continue to provide feedback about the documentation. We appreciate your contributions to our community.
#please-close


Feature/multiple choice filter

Closes: #24

Codecov Report

Merging #95 into master will not change coverage.
The diff coverage is 100.00%.

@@            Coverage Diff            @@
##            master       #95   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files            4         4
  Lines          211       226   +15
=========================================
+ Hits           211       226   +15

Impacted Files
Coverage Δ

django_property_filter/filters.py
100.00% <100.00%> (ø)

django_property_filter/filtersets.py
100.00% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 95ef1e9...9c07e34. Read the comment docs.


all: Updated the deprecated ioutil dependency

The ioutil package has been deprecated as of Go v1.16: https://go.dev/doc/go1.16#ioutil This commit replaces ioutil functions with their respective io/os functions.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Thanks for this, but we're currently not merging any massive renames/refactoring PRs, as we have a few bigger branches in line -- and merging this particular PR would create a lot of work merging those for no very good reason. We will make sure to migrate to the new package structure in good time.


[BUG] Always get deserialization errors in ContainerAppData

Library name and version
Azure.ResourceManager.AppContainers 1.0.0
Describe the bug
Trying to get a list of Container Apps using the SDK always seems to throw a deserialization error. Information on the exceptions is as follows.
System.UriFormatException
  HResult=0x80131537
  Message=Invalid URI: The format of the URI could not be determined.
  Source=System.Private.Uri
  Stack Trace:
   at System.Uri.CreateThis(String uri, Boolean dontEscape, UriKind uriKind, UriCreationOptions& creationOptions)
   at System.Uri..ctor(String uriString)
   at Azure.ResourceManager.AppContainers.ContainerAppData.DeserializeContainerAppData(JsonElement element)
   at Azure.ResourceManager.AppContainers.Models.ContainerAppCollection.DeserializeContainerAppCollection(JsonElement element)
   at Azure.ResourceManager.AppContainers.ContainerAppsRestOperations.<ListBySubscriptionAsync>d__6.MoveNext()
   at Azure.ResourceManager.AppContainers.SubscriptionResourceExtensionClient.<>c__DisplayClass39_0.<<GetContainerAppsAsync>g__FirstPageFunc|0>d.MoveNext()
   at Azure.Core.PageableHelpers.FuncAsyncPageable`1.<AsPages>d__4.MoveNext()
   at Azure.Core.PageableHelpers.FuncAsyncPageable`1.<AsPages>d__4.System.Threading.Tasks.Sources.IValueTaskSource<System.Boolean>.GetResult(Int16 token)
   at Azure.AsyncPageable`1.<GetAsyncEnumerator>d__6.MoveNext()
   at Azure.AsyncPageable`1.<GetAsyncEnumerator>d__6.MoveNext()
   at Azure.AsyncPageable`1.<GetAsyncEnumerator>d__6.System.Threading.Tasks.Sources.IValueTaskSource<System.Boolean>.GetResult(Int16 token)
   at System.Runtime.CompilerServices.ValueTaskAwaiter`1.GetResult()
   at Program.<<Main>$>d__0.MoveNext() (C:\Users\shibayan\source\repos\ConsoleApp60\ConsoleApp60\Program.cs):行 11
   at Program.<<Main>$>d__0.MoveNext() (C:\Users\shibayan\source\repos\ConsoleApp60\ConsoleApp60\Program.cs):行 11

I think the most likely cause is the part of the DeserializeContainerAppData implementation that treats OutboundIPAddresses as Uri. It appears that OutboundIPAddresses cannot be represented using the Uri class, since they are IP address-only values.
https://github.com/Azure/azure-sdk-for-net/blob/20d964afdfc27c3420623133c8dfc05bf12ce833/sdk/containerapps/Azure.ResourceManager.AppContainers/src/Generated/Models/ContainerAppData.Serialization.cs#L261
Expected behavior
The list of Container Apps can be obtained without any errors.
Actual behavior
An exception is always thrown in the deserialize method.
Reproduction Steps
Repro code
using Azure.Identity;
using Azure.ResourceManager;
using Azure.ResourceManager.AppContainers;

var armClient = new ArmClient(new AzureCliCredential());

var subscription = await armClient.GetDefaultSubscriptionAsync();

await foreach (var containerApp in subscription.GetContainerAppsAsync())
{
    Console.WriteLine(containerApp.Data.Id);
}

Environment
No response

@shibayan the 1.0.1 fixed this issue, thank you for reporting it.


bug: peerclose fires without emitting peerconnect

If a peer fails to connect [not sure why that happens yet], it will emit close, without ever emitting peerconnect
This case needs to be considered
code:
const map = {}
p2pcf.on('peerconnect', peer => {
  map[peer.id] = true
})
p2pcf.on('peerclose', peer => {
  if (map[peer.id]) {
    // handle
  } else {
    // this should never occur but does
  }
})

should there be a separate event for failed to init peer?

these connection errors are a bit weird, because other people can connect to that peer just fine, but I cant

ah yes, the peerclose event is being fired when a peer connection has been created but not necessarily established (it may have failed due to ICE.)
it can be hard to diagnose the problem without an understanding of WebRTC. the first step would be to get the ICE candidates attempted and report the browser types of the peers and the webrtc info (about:webrtc-internals in chrome, about:webrtc in firefox)

it's close to impossible to debug this in a ready application as you don't expose the peer as its starting to connect, we need a peercreate event or something like that
another issue is I ran into is that some people randomly disconnect with specific people with the error RTCError: User-Initiated Abort, reason=Close called

checking internals isn't really possible in electron

@gfodor I really am at my wits end

no clue why this happens

holy SHIT, this was a pain, essentially what happens is p2pcf detects a network change and dumps all peers, which must have some sort of race condition when connecting to ICE/TURN servers because they constantly change for some people which use IPv6, so the question is, is this network change stuff actually necessary with webrtc? for me turning it off fixed a solid 2/3rds of connect issues and doesn't seem to cause any other issues? I'm not sure

Ah thanks for investigating. The network change interval is there to help assist with recovery when you switch networks. It’s necessary due to the signalling method I use. My guess is that whatever is going on can be accounted for, can you describe in more detail what change is occurring that is triggering it and why? It should be possible to set a breakpoint on the line in the interval that purges the peers to see what condition changed. If this method is somehow not traceable to detect changes without false positives I’ll have to figure out another way.

If it’s coupled with ipv6 then we could ignore those in the reflexive ip set that it uses.

Oh and we can probably not drop the peers that are connected via TURN. Is the peer whose IP changed on a symmetric NAT?

I cut a branch that no longer forces any disconnects that will probably deal with this issue more gracefully. I have to test it to make sure it actually recovers still from a legit network change but for now you can probably use it to get past this issue.
https://github.com/gfodor/p2pcf/pull/12
Re: a peerstart event the tradeoff there is that due to the way this works there are scenarios where a lot of peers can get created that don't actually ever connect, and it's not an error. For example, if you join within a minute of someone leaving, you'll stlil see them in the poller and create a peer that silently dies and gets cleaned up. I decided against adding the event because I thought it might confuse people and they'll subscribe to the wrong event or think the fact that the peers end up not connecting is a bug.
That said, there is a use-case that I'd like to solve for where you want to know immediately when you connect if anyone else might be in the room. If the poller returns nothing, we know you are alone, but if it returns anything, we know you might not be alone. If this can fit into that problem that would be helpful in helping decide how to implement it well.

Are these two different scenarios?  1 where a connection won't succeed because of stale data and 2 where a network change causes an existing connection to disconnect?
If so, the second case could be handled by listening for the disconnected iceconnectionstate and then triggering an ICE restart.
Case 1 could probably be handled with a timeout that is cleared if the connection state ever reaches connected.

So I think I managed to find a better solution to this. I now just clear the candidates from the state of the worker upon a successful connection, so there's no risk of old candidates being passed to peers upon a network change + disconnect. Some of the reason things are in the state they are is because I was fighting with Workers KV, which is eventually consistent, so I was being a lot more conservative with dynamically changing the state given the risk of delayed arrival.
Re: ICE restarts, I decide to punt on those. The peers recover when there's a failure, but they have to wait out a full failure, not just a disconnect.
Merged https://github.com/gfodor/p2pcf/pull/12 and shipped 1.3.0

Dispatching and properly running an ICE restart would be a nice addition. It would require some modifications to tiny-simple-peer to handle the disconnect properly and a change to the p2pcf client to reset the state so it runs the full worker-based negotiation again.

can you describe in more detail what change is occurring that is triggering it and why?

console.error('network change', newUdpEnabled !== this.udpEnabled, newIsSymmetric !== this.isSymmetric, newDtlsFingerprint !== this.dtlsFingerprint, !retainedAnyReflexiveIps)

yielded true, false, false, true, but this is a sample size 1 of 10, so take it with a grain of salt
the end user was doing nothing, just sitting there watching console, no interactions with the app or OS, no other [significant] apps in the background etc

I think this issue should be fixed now so going to close. If another scenario comes up where it's desirable to have additional events regarding peer state please open another one - I will be probably updating start() to both await on the initial POST response and return a data structure describing the state of the room wrt existing peers.


[NEW] Insomni’hack 2025

Name: Insomni’hack
Website: https://insomnihack.ch/
Date(s): March 10-15 2025
Location: Lausanne, Switzerland
Twitter/Mastodon Handle<EMAIL_ADDRESS>Free: N

MErci !


Add Chess.com extension

Description
Adds a new extension for quickly starting games on Chess.com.
The extension offers the same list of common game types that Chess.com offers, so the 3 | 2 syntax should be familiar to users.
Clicking any of the options will open a URL in the user's default browser to immediately start a game with the selected settings.
Screencast

Checklist

[x] I read the extension guidelines
[x] I read the documentation about publishing
[x] I ran npm run build and tested this distribution build in Raycast
[x] I checked that files in the assets folder are used by the extension itself
[x] I checked that assets used by the README are placed outside of the metadata folder

Thanks for the approval @pernielsentikaer, great to see it live already! 🎉


ohlcv df needs to be flipped

thx for the code! (especially for the insight to divide timestamp by waitingtime :))
I noticed that the output of ohlcv_candles needs to be flipped (ohlcv_candles.iloc[::-1]) to get the last values with [-1] and [-2]
regards

Hi @cryptonaut1357 can you share your code I also notice this one resulting to indicators incorrect calculations.

To awnser the question how to flip cryptonaut1357 already said it but ill try to clear up with a sample
Original:
macd, signal, hist = talib.MACD(ohlcv_candles.close.values,                                         fastperiod=8, slowperiod=28, signalperiod=9)
Candles fliped:
macd, signal, hist = talib.MACD(ohlcv_candles.iloc[::-1].close.values,                                         fastperiod=8, slowperiod=28, signalperiod=9)

How to include different candles, for example heiken ashi candles ?

hi
how can ı change order ,when send buy 100 usd new order it while closing with sell order ı want continue 100 usd sell order
if open  buy 100 usd  order ,sell order will be 200 usd ,after buy order again will be 200 usd


Move StringArrayType, StringViewArrayBuilder, StringArrayBuilder & LargeStringArrayBuilder from functions/string/common.rs to a more common crate/module

Is your feature request related to a problem or challenge?
Currently the StringArrayType trait and the String*Builder structs are in the string crate however these are used in other crates (unicode, soon to include regex) and thus should be moved out to a more common location to not introduce needless dependencies between function crates.
Describe the solution you'd like
My first thought is to create a functions/string_common.rs file and move the above mentioned trait and structs to this file, update all code, remove crate dependencies and update any tests as required.
Describe alternatives you've considered
Leave things alone and allow the crate dependencies to stay.
Additional context
No response

Related to https://github.com/apache/datafusion/pull/12080

I haven't checked the others thoroughly, but with StringArrayType I believe we can remove it now and reuse it from arrow-rs here

take


invalid literal for int() with base 10: '3-iap1' when refreshing druid metadata

I'm trying to add a druid cluster to Caravel.  I can add it OK, but the metadata refresh is failing with "Error while processing cluster '<IP_ADDRESS>' invalid literal for int() with base 10: '3-iap1'".  My druid install is via Imply, and it seems that Caravel is barfing while trying to parse the version (0.8.3-iap1) because it isn't expecting the "-iap1".
After a cursory look at the code it may be around here: https://github.com/airbnb/caravel/blob/master/caravel/models.py#L1111 but i'm just guessing..
Ubuntu 14.04, Druid 0.8.3 (via Imply 1.1.0)

Now that I look at this more, the method I linked to above works OK to address this but version_higher() in the pip-installable package is older and does not address the trailing characters.  I updated it to the latest on github and it's working OK, so i'm closing this.


Additional log entries for studies

To have a better overview over how hal is used by the user so that certain studies can be carried out more smoothly, the following 2 log categories will be added:

Which specific widget the user currently has focus on (details widget, graph view, etc.)
Manipulations / selections through python code (e.g. when the user has created, modified, or deleted a gate or any other object that is accessible with python)

Update:
Implemented: Logging of the most important python functions.
Left to do: Logging of the "top-level" widget the user currently has focus on. (low priority.)


Intro should explain what Melange/Reason/Ocaml are and why they're worth learning

Right now the intro starts with the premise that the reader knows what Melange and Reason and Ocaml are and what they're for. But if the intended audience is React developers, they may not have a clear idea - it's worth being explicit here. Even many people familiar with Reason or Ocaml might not know what Melange is or be confused by its relationship to Reason (or by Reason's relationship to Ocaml, or by Reason's relationship to Rescript...).
Moreover, this is probably a good place to sell the curious React developer on the advantages of the ecosystem.
For example, look at PureScript by Example - the Introduction starts by saying

PureScript is a small, strongly, statically typed programming language with expressive types, written in and inspired by Haskell, and compiling to Javascript.
Functional programming in JavaScript has seen quite a lot of popularity recently, but large-scale application development is hindered by the lack of a disciplined environment in which to write code. PureScript aims to solve that problem by bringing the power of strongly-typed functional programming to the world of JavaScript development.

Especially in the internet age, when we might want to publish this to reddit/HN or whatever and get clicks from people who don't know what they're clicking on, answering this straightaway and "selling" the technology to them might be helpful.

@adamsmasher I tried to address it here: https://github.com/melange-re/melange-for-react-devs/issues/58, can you take a look?


Why Sine activation function as a network layer in use?

Thank you for your contribution!
I saw in the SinusodialRepresentationDense layer that the Sine activation function was passed as a network layer? Is there any benefit to doing this?
And what happens if I change it to normal function?
Thank you very much!

Nothing much happens. You can of course use it directly. Keras custom layers like LeakyRelu are however built for activation functions with arguments - here w0. So I used it as a layer.

Yes, it works fine as a normal function! I plan to extend it to RNN's network, for better signal processing. Thanks again!


1to1 mapping split issues

Hi Aproov,
there already was a question about one-to-one mapping between entities and relations in #5 . You shared the file with the suggested one-to-one mapping. But the issue is, there is one entity without a mapping and about 190 entities that have duplicated names there. Examples of duplicated names are john mclachlan, xing kong, belle vue, etc. An id with a missed name is Q11159396.
In the original paper you suggested using the following scheme of resolving such issues with duplicated names:

However, multiple entities can have identical canonical mentions; we disambiguate such enti- ties by appending the name with their 1-line description if available. In all other cases of identical canonical mentions we extend each mention with a unique id.

However, while the 1-line descriptions were provided for some entities, for one there was no such option, there no disambiguation scheme at all the file you shared.

Here I provide the file with an improved 1to1 mapping without the missed element and disambiguated entities by the scheme you described in the paper (e.g. for id Q8044536 duplicated name becomes xing kong_8044536).
But anyway, I got kind of confused with the mapping you share. There are also more (>300k) entities than overall in wikidata5m. Is the file you shared the same as you used for the verbalisation during your work on KGT5? And did I get and perform you disambiguation scheme in a right way?
Thank you in advance.

Hi @screemix , thanks for the detailed response.
Let me check my dataset dumps and i will get back to you in a few hours

For the results in the paper we used a slightly different mapping than this. I will upload that and share it with you, that should hopefully solve the issue. Please give me a couple hours for that, and I apologise for the delay

Please download following files for the updated mappings. These were the ones used to generate the final results reop
https://storage.googleapis.com/t5-kgc-colab/data/wd5m_aliases_entities_v3.txt
https://storage.googleapis.com/t5-kgc-colab/data/wd5m_aliases_relations_v3.txt
These files don't contain the issue highlighted above, but if you need other data as well please don't hesitate to raise another github issue

Please download following files for the updated mappings. These were the ones used to generate the final results reported in the paper
https://storage.googleapis.com/t5-kgc-colab/data/wd5m_aliases_entities_v3.txt https://storage.googleapis.com/t5-kgc-colab/data/wd5m_aliases_relations_v3.txt

Thank you! These mapping schemas are actually ok, I tested it and didn't find the issues I described above.


Add more types and functions to Apple

Updated!
cc @JohnTitor

@bors r+

:pushpin: Commit e7fa4138998a0ef514f8cbddd498faa781cc6dd6 has been approved by Amanieu

:hourglass: Testing commit e7fa4138998a0ef514f8cbddd498faa781cc6dd6 with merge 160a81ecd70ad232d910e73131ff57e9a98a5716...

:broken_heart: Test failed - checks-actions

I added cfg-attr like the other packed types. Can someone r+ again please? :)

@bors r+

:pushpin: Commit d8b000966b2f1bc9af99bb797fe75221b3b0a3d4 has been approved by Amanieu

:hourglass: Testing commit d8b000966b2f1bc9af99bb797fe75221b3b0a3d4 with merge d562a82cb82d16206891c49d526972f7444c2d88...

:boom: Test timed out

@bors retry

:hourglass: Testing commit d8b000966b2f1bc9af99bb797fe75221b3b0a3d4 with merge 03b03127fd6fe67db83a620b474ee848d10d9fe1...

:sunny: Test successful - checks-actions, checks-cirrus-freebsd-11, checks-cirrus-freebsd-12, checks-cirrus-freebsd-13
Approved by: Amanieu
Pushing 03b03127fd6fe67db83a620b474ee848d10d9fe1 to master...


ERROR:   Stream #1:0 -> #0:1 (copy)

Please follow the guide below

You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your issue (like this: [x])
Use the Preview tab to see what your issue will actually look like

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2019.03.18. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.

[x ] I've verified and I assure that I'm running youtube-dl 2019.03.18

Before submitting an issue make sure you have:

[x ] At least skimmed through the README, most notably the FAQ and BUGS sections
[x ] Searched the bugtracker for similar issues including closed ones
[x ] Checked that provided video/audio/playlist URLs (if any) are alive and playable in a browser

What is the purpose of your issue?

[x ] Bug report (encountered problems with youtube-dl)
[ ] Site support request (request for adding support for a new site)
[ ] Feature request (request for a new functionality)
[ ] Question
[ ] Other

The following sections concretize particular purposed issues, you can erase any section (the contents between triple ---) not applicable to your issue

If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:
youtube-dl -f bestvideo[ext=mp4]+bestaudio[ext=m4a]/best[ext=mp4]/best https://www.youtube.com/watch?v=HDwW9V85NOE --verbose
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-f', u'bestvideo[ext=mp4]+bestaudio[ext=m4a]/best[ext=mp4]/best', u'https://www.youtube.com/watch?v=HDwW9V85NOE', u'--verbose']
WARNING: Assuming --restrict-filenames since file system encoding cannot encode all characters. Set the LC_ALL environment variable to fix this.
[debug] Encodings: locale ANSI_X3.4-1968, fs ANSI_X3.4-1968, out ANSI_X3.4-1968, pref ANSI_X3.4-1968
[debug] youtube-dl version 2019.03.18
[debug] Python version 2.7.13 (CPython) - Linux-4.9.0-8-amd64-x86_64-with-debian-9.5
[debug] exe versions: avconv 3.2.12-1, avprobe 3.2.12-1, ffmpeg 3.2.12-1, ffprobe 3.2.12-1
[debug] Proxy map: {}
[youtube] HDwW9V85NOE: Downloading webpage
[youtube] HDwW9V85NOE: Downloading video info webpage
[youtube] {18} signature length 46.43, html5 player vflUi8DdH
[youtube] {137} signature length 46.43, html5 player vflUi8DdH
[youtube] {248} signature length 46.43, html5 player vflUi8DdH
[youtube] {136} signature length 46.43, html5 player vflUi8DdH
[youtube] {247} signature length 46.43, html5 player vflUi8DdH
[youtube] {398} signature length 46.43, html5 player vflUi8DdH
[youtube] {135} signature length 46.43, html5 player vflUi8DdH
[youtube] {244} signature length 46.43, html5 player vflUi8DdH
[youtube] {397} signature length 46.43, html5 player vflUi8DdH
[youtube] {134} signature length 46.43, html5 player vflUi8DdH
[youtube] {243} signature length 46.43, html5 player vflUi8DdH
[youtube] {396} signature length 46.43, html5 player vflUi8DdH
[youtube] {133} signature length 46.43, html5 player vflUi8DdH
[youtube] {242} signature length 46.43, html5 player vflUi8DdH
[youtube] {395} signature length 46.43, html5 player vflUi8DdH
[youtube] {160} signature length 46.43, html5 player vflUi8DdH
[youtube] {278} signature length 46.43, html5 player vflUi8DdH
[youtube] {394} signature length 46.43, html5 player vflUi8DdH
[youtube] {140} signature length 46.43, html5 player vflUi8DdH
[youtube] {171} signature length 46.43, html5 player vflUi8DdH
[youtube] {249} signature length 46.43, html5 player vflUi8DdH
[youtube] {250} signature length 46.43, html5 player vflUi8DdH
[youtube] {251} signature length 46.43, html5 player vflUi8DdH
[debug] Invoking downloader on u'https://r1---sn-25glen7l.googlevideo.com/videoplayback?id=1c3c16f55f3934e1&aitags=133,134,135,136,137,160,242,243,244,247,248,278,394,395,396,397,398&itag=398&source=youtube&requiressl=yes&mm=31,26&mn=sn-25glen7l,sn-4g5edned&ms=au,onr&mv=m&pl=21&ei=DfSgXN64JciOVLvlvpAP&susc=yt&initcwndbps=355000&mime=video/mp4&gir=yes&clen=5118066&dur=273.873&lmt=1540553334827877&mt=1554052029&fvip=1&keepalive=yes&c=WEB&txp=5511222&ip=<IP_ADDRESS>&ipbits=0&expire=1554073709&sparams=ip,ipbits,expire,id,aitags,source,requiressl,mm,mn,ms,mv,pl,ei,susc,initcwndbps,mime,gir,clen,dur,lmt&key=yt8&signature=99711965275DF87D55B75EED61BC29A3E061A5A6.92E457F701FF0154FF3BC5F331315F11C119A79E&ratebypass=yes'
[download] Bir_ay_dogar_ilk_aksamdan_geceden_Daglar_Kisimis_-_Cengiz_Ozkan-HDwW9V85NOE.f398.mp4 has already been downloaded
[download] 100% of 4.88MiB
[debug] Invoking downloader on u'https://r1---sn-25glen7l.googlevideo.com/videoplayback?id=1c3c16f55f3934e1&itag=140&source=youtube&requiressl=yes&mm=31,26&mn=sn-25glen7l,sn-4g5edned&ms=au,onr&mv=m&pl=21&ei=DfSgXN64JciOVLvlvpAP&susc=yt&initcwndbps=355000&mime=audio/mp4&gir=yes&clen=4351293&dur=273.925&lmt=1540549014261812&mt=1554052029&fvip=1&keepalive=yes&c=WEB&txp=5533432&ip=<IP_ADDRESS>&ipbits=0&expire=1554073709&sparams=ip,ipbits,expire,id,itag,source,requiressl,mm,mn,ms,mv,pl,ei,susc,initcwndbps,mime,gir,clen,dur,lmt&key=yt8&signature=453782F6F0B398FE8984AC0E1FB0EBEB1E1D5D64.3B5C586CEA07425B860260E848803C9F20D5C317&ratebypass=yes'
[download] Bir_ay_dogar_ilk_aksamdan_geceden_Daglar_Kisimis_-_Cengiz_Ozkan-HDwW9V85NOE.f140.m4a has already been downloaded
[download] 100% of 4.15MiB
[ffmpeg] Merging formats into "Bir_ay_dogar_ilk_aksamdan_geceden_Daglar_Kisimis_-_Cengiz_Ozkan-HDwW9V85NOE.mp4"
[debug] ffmpeg command line: ffmpeg -y -loglevel 'repeat+info' -i 'file:Bir_ay_dogar_ilk_aksamdan_geceden_Daglar_Kisimis_-_Cengiz_Ozkan-HDwW9V85NOE.f398.mp4' -i 'file:Bir_ay_dogar_ilk_aksamdan_geceden_Daglar_Kisimis_-_Cengiz_Ozkan-HDwW9V85NOE.f140.m4a' -c copy -map '0:v:0' -map '1:a:0' 'file:Bir_ay_dogar_ilk_aksamdan_geceden_Daglar_Kisimis_-_Cengiz_Ozkan-HDwW9V85NOE.temp.mp4'
ERROR:   Stream #1:0 -> #0:1 (copy)
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/youtube_dl/YoutubeDL.py", line 2052, in post_process
    files_to_delete, info = pp.run(info)
  File "/usr/local/lib/python2.7/dist-packages/youtube_dl/postprocessor/ffmpeg.py", line 512, in run
    self.run_ffmpeg_multiple_files(info['__files_to_merge'], temp_filename, args)
  File "/usr/local/lib/python2.7/dist-packages/youtube_dl/postprocessor/ffmpeg.py", line 235, in run_ffmpeg_multiple_files
    raise FFmpegPostProcessorError(msg)
FFmpegPostProcessorError:   Stream #1:0 -> #0:1 (copy)

If the purpose of this issue is a site support request please provide all kinds of example URLs support for which should be included (replace following example URLs by yours):

Single video: https://www.youtube.com/watch?v=HDwW9V85NOE

Description of your issue, suggested solution and other information
Hello,
I have a personal php script that allows me to download the youtube videos of my choice. I'm looking to get the video in the best possible format, in mp4. I noticed today that it doesn't work for a video.
My server is running under debian 9, latest version of youtube-dl and ffmpeg.
Thank you

Outdated ffmpeg.

I freshly installed it from homebrew and having the same issue @dstftw

Even
brew install ffmpeg --HEAD --fetch-HEAD --build-from-source

didn't fix it for me (macOS Mojave)
Which version of ffmpeg do I need?

No idea if this helps but I was getting this error when doing youtube-dl -f bestvideo+bestaudio --merge-output-format mp4 "<url>". Changing the --merge-output-format option to mkv worked.
This was on Mojave, latest youtube-dl and latest ffmepg, installed through Homebrew.

I am also getting this error when using the "default" profile, and after a lot of troubleshooting (and no changes in ffmpeg/python/youtube-dl versions), I was able to recreate and narrow down the issue. TL;DR--try disabling both "Embed thumbnail in audio file" and "Add metadata to file".
With both options enabled, I got the following result and 0 files downloaded:
[06/08/20 19:16:26] [debug] System config: []
[06/08/20 19:16:26] [debug] User config: []
[06/08/20 19:16:26] [debug] Custom config: []
[06/08/20 19:16:26] [debug] Command-line args: ['--newline', '--write-auto-sub', '-o', 'E:\\resources\\Watch\\%(title)s.%(ext)s', '-v', '--ignore-config', '--hls-prefer-native', '--embed-thumbnail', '--add-metadata', '--force-ipv4', 'https://www.youtube.com/channel/UCfpnY5NnBl-8L7SvICuYkYQ']
[06/08/20 19:16:26] [debug] Encodings: locale cp1252, fs mbcs, out cp1252, pref cp1252
[06/08/20 19:16:26] [debug] youtube-dl version 2020.05.08
[06/08/20 19:16:26] [debug] Python version 3.4.4 (CPython) - Windows-8.1-6.3.9600
[06/08/20 19:16:26] [debug] exe versions: ffmpeg 3.3.2, ffprobe 3.3.2
[06/08/20 19:16:26] [debug] Proxy map: {}
[06/08/20 19:16:26] WARNING: Requested formats are incompatible for merge and will be merged into mkv.
[06/08/20 19:16:26] ERROR: Only mp3 and m4a/mp4 are supported for thumbnail embedding for now.
[06/08/20 19:16:26] Traceback (most recent call last):
[06/08/20 19:16:26]   File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmp4z7swgz7\build\youtube_dl\YoutubeDL.py", line 2065, in post_process
[06/08/20 19:16:26]   File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmp4z7swgz7\build\youtube_dl\postprocessor\embedthumbnail.py", line 91, in run
[06/08/20 19:16:26] youtube_dl.postprocessor.embedthumbnail.EmbedThumbnailPPError: Only mp3 and m4a/mp4 are supported for thumbnail embedding for now.
[06/08/20 19:16:26]

With only "Add metadata to file" enabled, I got the following result and some files (47/999) downloaded. The "Requested formats are incompatible for merge" warning showed up 41 times, so I only included the warning once to keep it as concise as possible.
[06/08/20 19:26:47] [debug] System config: []
[06/08/20 19:26:47] [debug] User config: []
[06/08/20 19:26:47] [debug] Custom config: []
[06/08/20 19:26:47] [debug] Command-line args: ['--newline', '--write-auto-sub', '-o', 'E:\\resources\\Watch\\%(title)s.%(ext)s', '-v', '--ignore-config', '--hls-prefer-native', '--add-metadata', '--force-ipv4', 'https://www.youtube.com/channel/UCfpnY5NnBl-8L7SvICuYkYQ']
[06/08/20 19:26:47] [debug] Encodings: locale cp1252, fs mbcs, out cp1252, pref cp1252
[06/08/20 19:26:47] [debug] youtube-dl version 2020.05.08
[06/08/20 19:26:47] [debug] Python version 3.4.4 (CPython) - Windows-8.1-6.3.9600
[06/08/20 19:26:47] [debug] exe versions: ffmpeg 3.3.2, ffprobe 3.3.2
[06/08/20 19:26:47] [debug] Proxy map: {}
[06/08/20 19:26:47] WARNING: Requested formats are incompatible for merge and will be merged into mkv.
...
[06/08/20 19:26:48] ERROR:   Stream #1:0 -> #0:1 (copy)
[06/08/20 19:26:48] Traceback (most recent call last):
[06/08/20 19:26:48]   File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmp4z7swgz7\build\youtube_dl\YoutubeDL.py", line 2065, in post_process
[06/08/20 19:26:48]   File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmp4z7swgz7\build\youtube_dl\postprocessor\ffmpeg.py", line 512, in run
[06/08/20 19:26:48]   File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmp4z7swgz7\build\youtube_dl\postprocessor\ffmpeg.py", line 235, in run_ffmpeg_multiple_files
[06/08/20 19:26:48] youtube_dl.postprocessor.ffmpeg.FFmpegPostProcessorError:   Stream #1:0 -> #0:1 (copy)
[06/08/20 19:26:48]

This is the video that ultimately killed the job:
https://www.youtube.com/channel/UCfpnY5NnBl-8L7SvICuYkYQ
I tried re-running that video by itself but received the same error. Out of curiosity, I changed the profile from [default] to [mp4], re-enabled the problematic options--and got a different error complaining about AtomicParsley:
[06/08/20 20:14:08] [debug] System config: []
[06/08/20 20:14:08] [debug] User config: []
[06/08/20 20:14:08] [debug] Custom config: []
[06/08/20 20:14:08] [debug] Command-line args: ['--newline', '--write-auto-sub', '-o', 'C:\\Users\\dverm_000\\Desktop\\%(title)s.%(ext)s', '-f', 'mp4', '-v', '--ignore-config', '--hls-prefer-native', '--embed-thumbnail', '--add-metadata', '--force-ipv4', 'https://www.youtube.com/watch?v=Uf8QlLF2fIM']
[06/08/20 20:14:08] [debug] Encodings: locale cp1252, fs mbcs, out cp1252, pref cp1252
[06/08/20 20:14:08] [debug] youtube-dl version 2020.05.08
[06/08/20 20:14:08] [debug] Python version 3.4.4 (CPython) - Windows-8.1-6.3.9600
[06/08/20 20:14:08] [debug] exe versions: ffmpeg 3.3.2, ffprobe 3.3.2
[06/08/20 20:14:08] [debug] Proxy map: {}
[06/08/20 20:14:08] ERROR: AtomicParsley was not found. Please install.
[06/08/20 20:14:08] Traceback (most recent call last):
[06/08/20 20:14:08]   File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmp4z7swgz7\build\youtube_dl\YoutubeDL.py", line 2065, in post_process
[06/08/20 20:14:08]   File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmp4z7swgz7\build\youtube_dl\postprocessor\embedthumbnail.py", line 60, in run
[06/08/20 20:14:08] youtube_dl.postprocessor.embedthumbnail.EmbedThumbnailPPError: AtomicParsley was not found. Please install.
[06/08/20 20:14:08]

Ultimately, the files downloaded in every case, but these errors cause the entire job to grind to a halt. There are also leftover "duplicate" .mp4 files whose filesize is 0 bytes (generated for an operation that was unable to be completed?).
Hopefully this is helpful rather than annoying; I don't post too often so I'm unsure if this is the right way to go about it. I just wanted to share my own findings with this specific issue.

If --merge-output-format mp4 "<url>"
Then error
Because its original format is mp4,it doesn't need to change! Check it!

I'm still running into this issue even nowadays. I think it may be best to either have those two options (embedding metadata and embedding thumbnails) result in an automatic implied MKV merge format (perhaps warning the user in case that matters to that), or have more logic within the program keeping better track of which formats can and can't be merged together and choosing compatible ones accordingly.
I can't think of why it matters which of those two options are chosen, and one of them is a lot less work. Until one of them is chosen, people who want to embed metadata and/or a thumbnail will continue to run into this issue and be very confused, and it's a crapshoot whether they stumble upon this bug report and learn what's going on.

I found myself with the same problem and I could solve it changing the audio source.


[Addresses #11619] Remove blank lines in Configure Services for Razor and Mvc

Removed the blank lines in razor and mvc templates when there's no authentication options and added the lines back when there's authentication configured in creation.
Addresses #11619

Thanks @cjaliaga!

Absolutely! thanks for reviewing this out :)


Strange behavior on PV data but not sure where the problem occurs

I'm using this integration to read my Victron values into Home Assistant.
I'm using a Node-Red flow to insert the data into the Victron GX device to report the amount of solar of my complete system.
This is sometimes happening:

And the result is this in HA:

Not knowing where to start I'm posting this here but it can that this HACS solution is not doing anything wrong.

And this is haapinging almost every few days:

I will monitor in the next few days with edited code from Node-Red to exclude some settings and values.

I can confirm it is the latency of the response.
Problem is solved here by setting HA to check fewer.

Great to read that the cause has been found.
Unfortunately the gx device sometimes can't query/generate the response for an register read quickly enough.
Thereby, failing the request and causing the data to be poluted by 0 values.
Reducing the polling frequency and improving wifi connection stability/hard wiring the devices where possible reduces the amount of times this issue occurs.
The reason why you are seeing the random spikes in the statistics data of HA is due to a bug with the resetting of statistics data when a request fails and return an 0 value.
This causes the next datapoint for statistics generation to be based on the 0 value and thereby causing an massive spike of sudden solar energy being generated while the actual sequence could be 5000 - 0 - 5001 (resulting in a 5001 spike in the graph)

Makes sense! I will try to increase the interval of the HA towards Victron


Create RFC for Unified Token Usage for Sign-In with QR Code and GitHub

Description:
This issue ticket is created to initiate the discussion and development of a Request for Comments (RFC) document that outlines the implementation of a unified token usage system for Sign-In with QR Code and GitHub. The aim is to streamline and enhance the authentication process, providing users with a seamless and secure experience when accessing GitHub services.

please mention the ETA

please mention the ETA

ETA : 12 September 2023

#1503


Docker postgres

Docker-compose sets up container for Postgres

Looks like some .DS_Store files made their way into the repo, need to remove first then add to .gitignore

Looks like package-lock.json was changed without any packages installed, should revert it as it doesn't have any meaningful changes.


Logging location suggestion

Hi, just realised that this plugin logs to the home directory as a non-hidden file. Do you think it'll be better if logs go to the standard cache directory, like plugins such as nvim itself, lsp, null-ls, telescope and a few others? This path is vim.fn.stdpath("cache") .. "/" .. "null-ls.log". If you're happy with this change, I can make a PR for it :))

Yeah that is a great idea. Feel free to make the PR. Thanks.


add optional "storedValues" attribute for persistent indexes

Scope & Purpose
The feature is described in the docs PR in detail, so there is no separate PR description here.
Docs PR: https://github.com/arangodb/docs/pull/858

[ ] :hankey: Bugfix (requires CHANGELOG entry)
[x] :pizza: New feature (requires CHANGELOG entry, feature documentation and release notes)
[x] :fire: Performance improvement
[ ] :hammer: Refactoring/simplification
[x] :book: CHANGELOG entry made

Related Information

[x] Docs PR: https://github.com/arangodb/docs/pull/858

Testing & Verification

[x] This PR adds tests that were used to verify all changes:

[x] Added new integration tests (shell_client, shell_server)

In ArangoSearch we have similar concept called "storedValues", would be nice to use similar term

In ArangoSearch we have similar concept called "storedValues", would be nice to use similar term

The index lookup values (a.k.a. "fields") are also stored in the index.
I don't think "storedValues" is a good term, because it someone implies that the other values (in "fields") are not stored. The same is true for arangosearch by the way.
Maybe there is even a better term... Anyway, it is just naming, and changing it later (before merging) will be easy.

@jsteemann naming is also important for inverted index, currently we use term storedValues similar to views. So we have to agree on naming to be consistent.

As a suggestion: we have a PR https://github.com/arangodb/arangodb/pull/14240 I hope to be merged soon. This PR introduces a CoveringData abstraction for the index callbacks. Could we wait for #14240 to be merged and use the same abstraction here? So callback will not "know" about index projections  storage schemes.

Setting this to draft state until merge of #14240.


kind:VSecMSecret

We need a custom resource that can pull from a local (in-cluster) or external (federated cluster) VSecM and generate a Kubernetes Secret.
The Operator that does it will have a special clusterSPIFFEID and it would be able to securely talk to a VSecM Safe that it's configured to talk to as if it is VSecM Sentinel.
The interaction between the operator and VSecM Safe will be doubly encrypted since the secrets might be passing across the wire too.
apiVersion: vsecm.com/v1alpha1
kind: VSecMSecret
metadata:
  name: database-credentials
  vsecmSafeURL: https://path/to/vsecm/safe/api/endpoint
  secretType: k8s|vsecm
spec:
  refreshInterval: 1h
  target:
    name: database-credentials  # name of the k8s Secret to be created
  data:
    - key: username
      ref: "databaseCredentials.cocaCola.data.username"
    - key: password
      ref: "databaseCredentials.cocaCola.data.password"
  labels:
    - key: app
      ref: databaseCredentials.cocaCola.labels.app
  annotations:
    - key: env
      ref: databaseCredentials.cocaCola.annotations.env

Note: this means, we might not need the VSecM Relay Client and VSecM Relay Server, especially for use cases that require creation of Kubernetes Secrets only.
Note++: If the remote cluster has VSecM installed, we can also create VSecM Secrets there.

From the dupe story:
thinking out loud:
This is a custom resource that can act as if you are using VSecM Sentinel; ideally it will talk to VSecM Sentinel since sentinel is the only entry point to the system.
It would be visible only to cluster admins;
it would reconcile whatever the VSecMSecret defines as a command.
In practice a VSecMSecret will create either a secret in VSecM Safe, or on Kubernetes, or both.
If the secret exists, it will update it;
if it does not, it will create it.
when the secret is changed by someone else, it will reconcile the secret back to its former value.
Of course, the security of VSecMSecret will be paramount in this case.
This will be an optional feature (as it might impact, and maybe even reduce) the security of the overall system, while increasing convenience.
This needs a careful design, and a technical spec before starting the coding work.


pgroll: init at 0.4.4

Description of changes

Package pgroll
Things done

Built on platform(s)

[X] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[X] sandbox = true

[X] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[X] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
24.05 Release Notes (or backporting 23.05 and 23.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[X] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

Superseded by https://github.com/NixOS/nixpkgs/pull/302822
However that PR doesn't have these meta attributes and doesn't install shell completions, feel free to open another PR for adding those


After installation of RPi-Jukebox PCM5102a DAC is silent, but works fine before

Hi,
I have a problem with generic chinese PCM5102a module and Raspberry Pi 3A+, which looks exactly like this one:
https://www.instructables.com/id/High-Quality-Music-Player-and-Internet-Radio-With-/
I've connected it the same way as it is mentioned in the link, had a clean Raspbian Stretch install, enabled dtoverlay:
dtoverlay=hifiberry-dac in /boot/config.txt and disabled (commented) #dtparam=audio=on .
After that
aplay -l showed correct card:
**** List of PLAYBACK Hardware Devices **** card 0: sndrpihifiberry [snd_rpi_hifiberry_dac], device 0: HifiBerry DAC HiFi pcm5102a-hifi-0 [] Subdevices: 1/1 Subdevice #0: subdevice #0
I can hear output of speaker-test ran like so:
speaker-test -D default -c 2 -twav
Then, I download and run install script from github: stretch-install-spotify.sh
As audio interface I've put sndrpihifiberry and entered Spotify credentials when asked.
Script succeeds, I can use Jukebox on the web, browse through my Spotify account, but NO SOUND.
speaker-test -D default -c 2 -twav plays silence as the Jukebox on the web.
I've read through Troubleshooting section, disabled GPIO-buttons, restarted, had at least 3 clean installs (one with firmware & packages upgrade) from scratch - nothing worked. Sound is always not there after installing RPi-Jukebox and aplay -l output is also the same as before installation.
I succeeded once playing some music via DAC & Jukebox when I started installation script second time and accidentally stopped it somewhere in the middle. After that I had no web UI (it returned 404), but I was able to access Iris on port 6080 and was able to play music from Spotify.
Unfortunately, after next clean install this success were gone :(
I've checked through stretch-install-spotify.sh script and to my understanding there is not much things that can corrupt working audio interface, at least speaker-test should work fine.
So, I suppose that some of the third-party packages that are being installed somehow corrupt the working state of DAC.
I did an experiment running speaker test in one terminal window and starting stretch-install-spotify.sh in second one. Sound from first window were coming all the way through until installation succeeded and I needed to restart Raspberry Pi.
Now, I run out of ideas how to fix/track which package is destroying the sound, but I'm open to suggestions and ready to help if needed.

Look up in this wiki thread
https://github.com/MiczFlor/RPi-Jukebox-RFID/wiki/External-Non-USB-Audio-DAC-ES9023
Suddenly it will works by your phonibox. I have trouble also with my DAC. I think if the startupsound is co0ming, this work by me. Than it will not kill this program and the soundcard is not avaiable for mpd.

Unfortunately this didn't worked for me, tried wiki thread on a clean install with working speaker test.
To experiment, I've started to execute setup steps manually and found out that speaker test doesn't work  after I install mopidy (even before RPi-Jukebox) which is super strange. Any ideas why?
Going to open issue at mopidy's github.

Do you use GPIO buttons? Please check for collisions in the wiki

Thank you, after I've changed mapping for GPIO buttons everything worked fine. Wiki text is misleading, since it uses phrase "we now use different than classic mapping", but in script uses classic pin mapping :(


Provide case id directly to pod controllers

Recent upstream changes removed the case object from the global scope. We still need the case id though, so the plan is to add the case id to the view context, and then pass it directly to the angular controllers in the template (rather than attaching it to the global scope).

@miltontony @rudigiesler @KaitCrawford ready for review
@imsickofmaps ping

:+1: once Travis is happy.

Still :+1:


Enhance Memory Save Feedback and User Guidance

Implement a clear and obvious confirmation method to inform users when a memory is saved, and also provide guidance on how to save a memory.

If a member edit a memory directly and saves the memory using disk icon. No indication that memory is saved, disk icon remains same.

Related to #424 I have completed part of this one - I'll snag the code to grab the following functionality for the quill:

[ ] on quill select or double-click in content, QUILL ACTIVATES (enlarge and color)

if clicked when activated blocks editing and returns to normal, NO SAVE

[ ] DISKETTE will show checkmark when saved then fade back to disk after 2secs


VT - Self-Report Feeds submitted via Mobile App?

Problem Statement
We received an inquiry submitted via Smartsheet webform from Andrew Gross from the Vermont Department of Health.  Engineering (I think James) sent Andrew a spreadsheet via Metabase with senders.  He is asking if we could send him another spreadsheet with more detail such as senders (Lifepoint (Ellume, iHealth)) sending to ReportStream and other other senders sending via Mobile App.
What you need to know
I did a search for Lifepoint as a Sender to reportstream and did not find any results for the state of VT.  However, I need to confirm for other senders that send via Mobile App.  I do not know which senders send via Mobile App.
Actual Email Inquiry:
"Per my previous inquiries into self-report result feeds, I am looking for just a bit more info on senders/feeds - I've received some spreadsheets displaying senders who use Simple Repot, Report Stream, etc. Would there be any way to show if there are senders using these services that are mobile apps (ie Ellume, iHealth, etc)?"
Thank you for your help!
Acceptance Criteria
-Confirm which Self-report feeds are being submitted via Mobile App.
-Create Metabase Report filters out for test results sending to VT where the sender is a Self-Report mobile app submission.
To Do
Assign an Engineer
Additional Comments
If applicable, add screenshots, links, etc. to further explain the ticket

@sliu1000 we don't have any way to tell senders are using mobile Apps.  I think, we need to close this ticket.

@oslynn Thank you for the information. I'll let VT POC know.


dynamic/fake not honoring the patch type -> json doc error

Having a hard time unit testing a Patch operation using a dynamic fake. If I run the code against a real cluster (using the dynamic client, not fake), things work aok, but in unit tests when trying to create a JSONPatch operation it fails always with "invalid JSON document".
It seems to be coming from pkg/util/strategicpatch/patch.go
Looks to me like our use of JSON Patch is not being honored since the patch type is not being used anywhere, and seems like instead it's trying to unserialized into a map[string]interface{} and it fails since JSON patch is an array of patch operations.
https://github.com/kubernetes/client-go/blob/master/dynamic/fake/simple.go#L334
Or, am I holding it somehow wrong and this is supposed to work?
Thanks in advance!

yes, that's a bug. the patch type should definitely be included in the fake patch action, and the case PatchActionImpl should switch on the known patch types.

I can take a look at implementing this.

I can take a look at implementing this.

Thanks.  @p0lyn0mial you've been in the dynamic client.  Are you up for a review?

FYI, I was struggling a bit getting docker set up so I could run the hack update deps, but there are still breakages, but just curious about the general direction while I work on the breakages.

@p0lyn0mial you've been in the dynamic client. Are you up for a review?

yes :)

So, it seems like just running the hack script as per here is not enough:
https://github.com/kubernetes/community/blob/master/contributors/devel/godep.md
Trying to figure out what else needs to change...
"Saving deps in staging repos
Kubernetes stores some code in a directory called staging which is handled specially, and is not covered by the above. If you modified any code under staging, or if you changed a dependency of code under staging (even transitively), you'll also need to update deps there:
./hack/update-staging-godeps.sh
Then commit the changes generated by the above script."


Adding chevron to filter selection in Explore

Probably add a 'chevron' to the filter selection in Explore. I missed this option because there was no clear GUI indication. Also, there is a small overlap between the world filter and the selector, especially when clicking on it as it adds a shadow.

You're right, as usual. Fixed in the next version.


nor2 cell completed

Completed nor2_1, nor2_2, nor2_4, and nor2_8. All L, W, and transistor counts are consistent with the efabless library. Resolved width issue by correctly placing transistors in parallel (not series)

I understand everything except the fingers comment. Say for nor2_8, would you want all the transistors on the same level then? One line of transistors, with A's and B's grouped together?

Whatever you feel looks the best. I just want all fingers to be next to each other, and in the same orientation in the schematic.

I just pushed the changes you asked for, I made schematics cleaner and optimized placement of transistors

Thanks for all your help! Please observe the final changes that I made to improve the readability: https://github.com/sifferman/sky130_schematics/releases/latest

I see the changes now. I assumed you would want transistors of the same configuration paired together (SD vs DS). I'll keep this formatting in mind for future cells

Oh, I see. Yeah, that's not really important.


espnow_ota_initator_scan hang problem

Hi, I'm trying to test the OTA function, however, I've found that if call espnow_ota_initator_scan function at:
https://github.com/espressif/esp-now/blob/e5a13ba19f12727b9544e1dbd04639bf5016a4d8/components/ota/espnow_ota_initiator.c#L77
It will hang for few seconds, and no other threads can run, is there anyway to get around this problem? Thanks!

Blocks happen at xQueueReceive in espnow_recv( wait ticks is not 0). To get around this problem, use  vTaskDelay instead of wait ticks, as following:
        vTaskDelay(recv_ticks);
        // for (; espnow_recv(ESPNOW_TYPE_OTA_STATUS, recv_addr, recv_data, &recv_size, &rx_ctrl, recv_ticks) == ESP_OK; recv_ticks = 100) {
        for (; espnow_recv(ESPNOW_TYPE_OTA_STATUS, recv_addr, recv_data, &recv_size, &rx_ctrl, 0) == ESP_OK; (vTaskDelay(100))) {

Be careful for other thread process espnow_recv(ESPNOW_TYPE_OTA_STATUS...)

Blocks happen at xQueueReceive in espnow_recv( wait ticks is not 0). To get around this problem, use vTaskDelay instead of wait ticks, as following:
        vTaskDelay(recv_ticks);
        // for (; espnow_recv(ESPNOW_TYPE_OTA_STATUS, recv_addr, recv_data, &recv_size, &rx_ctrl, recv_ticks) == ESP_OK; recv_ticks = 100) {
        for (; espnow_recv(ESPNOW_TYPE_OTA_STATUS, recv_addr, recv_data, &recv_size, &rx_ctrl, 0) == ESP_OK; (vTaskDelay(100))) {

Be careful for other thread process espnow_recv(ESPNOW_TYPE_OTA_STATUS...)

@ljy770 Thank you for the help and point this out!
This issue may closed


New Tractus-X project contributor for @ds-crehm

Before requesting the project contributor role, please make sure, that you:

Make yourself familiar with the Eclipse Foundation project roles: https://eclipse-tractusx.github.io/docs/oss/contributor-committer
Make ourselves familiar with prerequisites, like a signed ECA: https://eclipse-tractusx.github.io/docs/oss/getting-started
Check the committer list of our project and highlight at least one of them on this issue, since every committer
can add project contributors: https://projects.eclipse.org/projects/automotive.tractusx/who

Necessary Information
Email address to add<EMAIL_ADDRESS>Committers, that could take over: @mkanal @ds-mwesener
Please make sure, that you accept the invitation you receive from GitHub, after you have been added as project contributor.

Hi @mkanal and @ds-mwesener,
could you overtake this invitation?
Thanks in advance

Hi @FaGru3n currently I cannot see him within the organisation. As far as I know you added them to the organization and we add the users to the project, correct?

Hi @ds-mwesener
this issue https://github.com/eclipse-tractusx/sig-infra/issues/402 was for the invite to Catena-X ng but with this new issue it is regarding to ETX

HI @FaGru3n could you please explain how to add a user to the tractus-x organization? In the past the system team did that part for us. Afterwards we were able to add the user to the eclipse contributor group.

HI @FaGru3n could you please explain how to add a user to the tractus-x organization? In the past the system team did that part for us. Afterwards we were able to add the user to the eclipse contributor group.

simply speaking for catena-x ng the system-team can invite people into the organisation.
The Eclipse Tractus-X GitHub Org is manged by Eclipse Foundation to we as committer can add new contributor on the eclipse project site and in the background an eclipse bot will invite new contributors into the GitHub organisation.
So if you can add @ds-crehm as contributor, he will get an invite to the eclipse-tractusx GitHub organisation.

Hi @ds-mwesener added him as contributor into our eclipse project, so he will get an invite to join the eclipse tractus-x organisation.

process is also described on the website and on the handbook.
Info:
Every committer can add new contributors to the the eclipse project and then the new contributor will be invited to the GitHub organisaion.
Please review and after successful invitation, issue can be closed.

Successfully done.


added dependencies and dev-dependencies badge to readme.md

closes #90

Codecov Report

Merging #91 (bbcf50f) into develop (9d5a2b8) will not change coverage.
The diff coverage is n/a.

@@            Coverage Diff            @@
##           develop       #91   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files           21        21
  Lines          242       242
  Branches        11        11
=========================================
  Hits           242       242

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 9d5a2b8...bbcf50f. Read the comment docs.


Deployment request for Algen chain

Chain Name
Algen L1
Chain ID
8911
RPC URL
https://rpc.algen.network
Block Explorer URL
https://scan.algen.network
Deployment Funds
Yes

Done, thanks!


[Question] Any way to update the cluster's configuration post deployment?

Is there any way to update the aksedge-config.json to either update the cluster's IP Range configuration, memory, CPU count or others properties even if 'New-AksEdgeDeployment' cmdlet was already executed?
Maybe this is a planned feature?

Hi @JulesP96,
Thanks for reaching out. Unfortunately, there's no way to change the VM configurations after the VM is deployed. However, this is a feature that we are planning to introduce in our future updates.
Thanks,
Francisco

@fcabrera23 Could we at least get full documentation in the 'how-to' section on how to increase e.g. the memory of a node in single node deployment?

Hi @JMayrbaeurl,
We are still considering providing a PS cmdlet to update configurations. In the meantime, all configurations must be set during deployment. Please check the Deployment configuration JSON parameters for all the available settings.  Also, adding @SummerSmith  who will continue to help with this repo.
Thanks,
Francisco

Today, the only way to change resource configurations on the VM is via redeployment. The ability to edit a VM's footprint after deployment is on the roadmap. Will update via release notes when we get to that.


ci: Some tests misusing assertTrue for comparisons fix

Fixes #7240

@code-review-doctor do you know why the tests fail?

Thanks @fsbraun 👏


Don't refetch tags on time range modification

Currently, each time we modify the query time range, we make another call to populate the list of measurements and tags. This is a weird UX.
We should pick a reasonable default time range (1w?). If the user picks a range that exceeds 1w, then we can make another call to update the list.

cc @e-dard

@desa alternatively what about an explicit UI element to "refresh filters" or something?

@e-dard we could try to fit something like that in. My only concern would be cramming the UI full of very specific actions that are hard to educate the user on.


Write code for edit word functionality

We should have the necessary methods that will allow the user to edit a word.

We will close this issue since this feature is not included in the stories list we sold.


Support for self-hosted API

Hey,
I don't see any way to use the CLI with a self-hosted API for Keygen. It'd be neat to be able to override the API base URL so that one can use this handy CLI on self-hosted :)
Thanks!
Charlie

You’re right — a --host flag would be nice.

Or an environment variable so users don't have to tack an extra arg onto each command? Would also be useful when scripting since you could use the same script for various projects and read the host from a .env file.

We can do it the same way --account, --product, and --token work: defaulting to an environment variable if one exists.