Installation problem of new environment(ubuntu20.04...)

Hello, Thank you for sharing this interesting project!
I have installed the VICTRE pipeline using Ubuntu 16.04 and worked well.
But It doesn't work out in a new environment( Ubuntu 20.04, NVIDIA RTX 3090, Cuda 11.2, CuDNN 8.1.0).
Can I possibly get some help with this?

How should I modify the vtk version in BreastPhantom and BreastCompress? Is vtk6 not available in Ubuntu 20.04?

In X-ray imaging, the following error appeared.

MC-GPU_v1.5b.cu: In function ‘int main(int, char**)’:
MC-GPU_v1.5b.cu:1169:33: warning: ‘%04d’ directive writing between 4 and 10 bytes into a region of size between 3 and 252 [-Wformat-overflow=]
1169 |       sprintf(file_name_output_num_p, "%s_%04d", file_name_output, num_p);   // Create the output file name with the input name + projection number (4 digits, padding with 0)
|                                 ^~~~~~~~~
MC-GPU_v1.5b.cu:1169:33: note: directive argument in the range [0,<PHONE_NUMBER>]
/usr/include/x86_64-linux-gnu/bits/stdio2.h:36:31: note: ‘__builtin___sprintf_chk’ output between 6 and 261 bytes into a destination of size 253
36 |   return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1,
|        ~^~~~~~~~~~~
could you give me some advice or any help?
Thanks & Regards,
Ahyeong Lee

Hi Ahyeong,
I hope our software works well for your application.
The BreastPhantom and BreastCompress programs were developed with the library versions listed in the documentation and we recommend that you use those versions. The program might work in other versions, but we do not have the resources to test the compilation in new versions of Linux. You could write a comment below if you figure out how to compile in Ubuntu 20.04, to help other users with the same problem.
It looks like the compilation message in MCGPU is a warning, not an error. I have not seen it before but it should not have any effect, as long as your file name is smaller than 250 characters. Probably the issue would be resolved if you change the code "char file_name_output_num_p[253];" to "char file_name_output_num_p[261];" in line 1162.
Best regards!

hello!
Thank you for your answers.
I installed breastPhantom and breastMass using a VICTRE_PIPELINE!

breastCompress

1-1) But breastCompress doesn't work. (I have tried adding the Febio path using the -f flag and downloaded febio-2.9.1)
The error message is
sh: 1: /home/ay/FEBio-2.9.1: Permission denied
Generating voxelized compressed breast...
Cannot read FEBio output file
1-2) and when using febio-2.3.1, the following message came out.
Writing FEBio simulation file...
Running FEBio compression modeling...
Illegal instruction (core dumped)
Generating voxelized compressed breast...
Compressed breast thickness = 151 mm
Assigning Tissues
################################################################################
FINISHED MESHING ITERATION 3 of maximum 18
################################################################################
Total bytes read = 96593939

MCGPU

2-1) Using VICTRE-MCGPU
After I changed the code in line 1162.
I ran the simulation and the error message came out.
!!WARNING!! The selected GPU is connected to a display and therefore CUDA driver will limit the kernel run time to 5 seconds and the simulation will likely fail!!
You can fix this by executing the simulation in a different GPU (select number in the input file) or by turning off the window manager and using the text-only Linux shell.
CUDA error at MC-GPU_v1.5b.cu:2990 code=13(cudaErrorInvalidSymbol) "cudaMemcpyToSymbol(voxel_data_CONST, voxel_data, sizeof(struct voxel_struct))"
2-2) Using VICTRE_PIPELINE
I ran the command in VICTRE automatic pipeline installation.( compile 4. MCGPU projection - select GPU architecture: 5. Ampere: RTX 30X0, RTX A6000, Tesla A100)
The error message came out. But the file is already installed in place.
compile with MPI support? (y/n): yIn file included from MC-GPU_v1.5b.cu:364:
./MC-GPU_v1.5b.h:110:12: fatal error: mpi.h: No such file or directory
110 |   #include <mpi.h>
|            ^~~~~~~
compilation terminated.
Can I  get some help with this?
Kind regards.
Ahyeong Lee

Hi Ahyeong, sorry for the delay.
Let me try to help you.
1-1: It looks like FEBio has no executable permissions, make sure it has the correct chmod permissions (you can do chmod o+rx on the folder and executable file where you have FEBio)
1-2: Here at least it looks like it finds the executable but it fails, could it be an out of memory issue? FEBio uses a lot of RAM memory depending on the phantom size, I recommend you try a smaller phantom (try the example on the VICTRE_PIPELINE, it is a very small phantom).
2-1: You will have to try this on a different GPU or disconnect the GPU from the monitor to log in via terminal. Give it a try on this code sample, it might help you set up your environment: https://colab.research.google.com/drive/1g8bwH_nuVRn3xJcoqP-zT7bz8kY4Nuqz?usp=sharing
2-2: Say no to compiling with MPI support and try again. It should at least compile. MPI is only needed if you have multiple GPUs in the same workstation.
I hope it helps!


Support client hints

Client hints are pretty cool. We could potentially use it for switching DPR, for instance.

Implemented in eb00b7d


rebuild devstack.org's stack.sh on push to master

pushes to master should automatically rebuild stack.sh docs in the gh-pages branch

Jenkins is now running the following:
rm -rf docs || true
git clone -b gh-pages git@github.com:cloudbuilders/devstack.git docs
shocco stack.sh > docs/stack.sh.html
shocco exercise.sh > docs/exercise.sh.html
cd docs
if ! git diff-index --quiet HEAD --; then
  git commit -a -m "jenkins update of docs"
  git push
fi


[core-http] Add support for headers having original casing during deserialization.

Packages impacted by this PR
@azure/core-http and its dependents
Issues associated with this PR
Fixes #22881
Describe the problem that is addressed by this PR
node-fetch forces a lowercase normalization of header names coming over the wire, but storage has scenarios where this is undesirable (see #8117).
Until we get storage moved over to the new pipeline, we would like advanced consumers to be able to preserve header casing via a custom HttpClient.
This PR addresses the issue by ensuring we pass the normalized (rather than the original) header casing to the deserialization policy which always hardcodes the lowercase version of the name.
Are there test cases added in this PR? (If not, why?)
Yes! Two new cases, one for normal responses and one for error responses.

API change check
API changes are not detected in this pull request.


Discrepancy between the R function pin_write and the python counterpart  pin_read when using arrow (feather) type

In R:
folder <- pins::board_folder(path = "pins")
pins::pin_write(folder, mtcars, "mtcars", type = "arrow")

Would create an arrow::write_feather() file.
While, if we try to read back in python:
import pins
board = pins.board_folder(path = "pins")
board.pin_read("mtcars")

we got the error: NotImplementedError: No driver for type arrow
In drivers.py, there is the condition :
elif meta.type == "feather":
import pandas as pd
returnpd.read_feather(fs.open(path_to_file))

Which should (maybe) be:
elif meta.type == "arrow":
import pandas as pd
returnpd.read_feather(fs.open(path_to_file))

Or maybe, on the R side, while using pin_write, the metadata type should be "feather" instead of "arrow" (?)

Thanks for raising--does this PR fix the issue for you? https://github.com/rstudio/pins-python/issues/135
I'm out this week, but will circle back next week if it needs more work!

Hi,
Thank you for considering the request and for the work done.
Now we can read an "arrow" typed data coming from R:
# Write pins in R
board <- pins::board_folder(path = "pins")
pins::pin_write(board, mtcars, type = "arrow")

# pins read in python
import pins
board = pins.board_folder(path = "pins")
cars = board.pin_read("mtcars")
# Okay, everything works so far.

However, if we save the newly loaded data in python as a "feather" data type, we could not read it back in R because R expects an "arrow" type.
# pin write in python
board.pin_write(cars, "mtcars", type = "feather")

# Read in R
board <- pins::board_folder(path = "pins")
pins::pin_read(folder, "mtcars")

we get the following error:
Error in object_read():
! meta$type must be one of "rds", "json",
"arrow", "pickle", "csv", "qs", or "file", not
"feather".
Is there nothing else to do? Maybe you could agree between the R and python team about the appropriate name for this data structure ("arrow" or "feather"). Using two different names for (what seems to be) the same purpose is misleading.
In your opinion, should I open a new request on the R side of the pins package to explain the inconsistency?

Hey--based on the discussion in https://github.com/rstudio/pins/issues/605, it sounds like "arrow" is the name and extension apache-arrow project is steering people toward.
I can switch python pins to use pin type "arrow" for everything, and deprecate pin type feather (I originally thought we'd go the other way, and deprecate type "arrow" in R pins 😓).

Hi Michael,
Regarding the line in drivers.py , you always save the object into feather V2 (see here).
I do no know if I'm right, but according to the arrow documentation, feather V2 and Arrow IPC file format seem the same. Therefore as long as you do not leave the choice of the version when one saves the object info the feather ...uh... arrow format, both are correct.
Which one to choose? I kind of agree with you that using feather instead arrow brings more consistency with the pandas' functions (e.g., to_feather and read_feather), but the final decision is up to you, Rstudio teams.


downgraded to PythonCall 0.5.1

This package looks very promising. I just noticed that it downgraded my PythonCall.jl from 0.8.0 to 0.5.1.

Whoops, should be fixed now.


⚠ Bofrost.be has degraded performance

In 9accc45, Bofrost.be (https://www.bofrost.be) experienced degraded performance:

HTTP code: 200
Response time: 1378 ms

Resolved: Bofrost.be performance has improved in 0ce492e after 3 hours, 43 minutes.


Update rspec

Updated to use rspec 3
Removed deprecated rspec config and syntax (should -> expect)

Looks good! :+1:
I fixed the test settings on Codeship. The build should go green any minute now.


Libasync FileStream must createTrunc earlier

When no data is to be written/read, createTrunc must still create the file to avoid further file operations to fail.

Exactly!


api: adc: exists needs to handle number of channels

This is a bug in the kernel which will be fixed in future releases but for now we enable the ADC example to work.

Linking the kernel-issue here: https://github.com/tock/tock/issues/3375. Also marked that one a release blocker, such that we actually take care of that before the next release.


Flaky SALMON_TXIMPORT pipeline step

Description of the bug
The pipeline execution fails to complete with the following error message
Error executing process > 'NFCORE_RNASEQ:RNASEQ:QUANTIFY_STAR_SALMON:SALMON_TXIMPORT'

Caused by:
  Missing output file(s) `*transcript_tpm.tsv` expected by process `NFCORE_RNASEQ:RNASEQ:QUANTIFY_STAR_SALMON:SALMON_TXIMPORT`

Command executed:

  salmon_tximport.r \
      NULL \
      salmon \
      salmon.merged

  cat <<-END_VERSIONS > versions.yml
  "NFCORE_RNASEQ:RNASEQ:QUANTIFY_STAR_SALMON:SALMON_TXIMPORT":
      r-base: $(echo $(R --version 2>&1) | sed 's/^.*R version //; s/ .*$//')
      bioconductor-tximeta: $(Rscript -e "library(tximeta); cat(as.character(packageVersion('tximeta')))")
  END_VERSIONS

Command exit status:
  0

Command output:

    Michael I. Love, Charlotte Soneson, Peter F. Hickey, Lisa K. Johnson,
    N. Tessa Pierce, Lori Shepherd, Martin Morgan, Rob Patro Tximeta:
    Reference sequence checksums for provenance identification in RNA-seq
    PLOS Computational Biology

  A BibTeX entry for LaTeX users is

    @Article{,
      title = {Tximeta: Reference sequence checksums for provenance identification in RNA-seq},
      author = {Michael I. Love and Charlotte Soneson and Peter F. Hickey and Lisa K. Johnson and N. Tessa Pierce and Lori Shepherd and Martin Morgan and Rob Patro},
      year = {2020},
      journal = {PLOS Computational Biology},
      doi = {10.1371/journal.pcbi.1007664},
    }

  R version 4.0.3 (2020-10-10)
  Platform: x86_64-conda-linux-gnu (64-bit)
  Running under: Buildroot 2014.02

  Matrix products: default
  BLAS/LAPACK: /usr/local/lib/libopenblasp-r0.3.10.so

  locale:
  [1] C

  attached base packages:
  [1] parallel  stats4    stats     graphics  grDevices utils     datasets
  [8] methods   base

  other attached packages:
   [1] tximport_1.18.0             SummarizedExperiment_1.20.0
   [3] Biobase_2.50.0              GenomicRanges_1.42.0
   [5] GenomeInfoDb_1.26.0         IRanges_2.24.0
   [7] S4Vectors_0.28.0            BiocGenerics_0.36.0
   [9] MatrixGenerics_1.2.0        matrixStats_0.57.0

  loaded via a namespace (and not attached):
   [1] lattice_0.20-41        bitops_1.0-6           grid_4.0.3
   [4] jsonlite_1.7.1         zlibbioc_1.36.0        XVector_0.30.0
   [7] Matrix_1.2-18          tools_4.0.3            RCurl_1.98-1.2
  [10] DelayedArray_0.16.0    compiler_4.0.3         GenomeInfoDbData_1.2.4

Command error:

  The following objects are masked from 'package:base':

      Filter, Find, Map, Position, Reduce, anyDuplicated, append,
      as.data.frame, basename, cbind, colnames, dirname, do.call,
      duplicated, eval, evalq, get, grep, grepl, intersect, is.unsorted,
      lapply, mapply, match, mget, order, paste, pmax, pmax.int, pmin,
      pmin.int, rank, rbind, rownames, sapply, setdiff, sort, table,
      tapply, union, unique, unsplit, which.max, which.min

  Loading required package: S4Vectors

  Attaching package: 'S4Vectors'

  The following object is masked from 'package:base':

      expand.grid

  Loading required package: IRanges
  Loading required package: GenomeInfoDb
  Loading required package: Biobase
  Welcome to Bioconductor

      Vignettes contain introductory material; view with
      'browseVignettes()'. To cite Bioconductor, see
      'citation("Biobase")', and for packages 'citation("pkgname")'.

  Attaching package: 'Biobase'

  The following object is masked from 'package:MatrixGenerics':

      rowMedians

  The following objects are masked from 'package:matrixStats':

      anyMissing, rowMedians

  ColData not avaliable NULL
  reading in files with read.delim (install 'readr' package for speed up)
  1 2 3 4 5 6 7 8
  summarizing abundance
  summarizing counts
  summarizing length
  summarizing abundance
  summarizing counts
  summarizing length
  summarizing abundance
  summarizing counts
  summarizing length

Work dir:
  s3://nextflow-ci/work/90/55b41823223557b181047f49975bd9

Checking the work dir, the expected file is indeed missing
$ aws s3 ls  s3://nextflow-ci/work/90/55b41823223557b181047f49975bd9/
2022-08-18 00:40:24          0
2022-08-18 00:41:17          0 .command.begin
2022-08-18 01:44:34       3020 .command.err
2022-08-18 00:42:14       1650 .command.out
2022-08-18 00:40:24      13161 .command.run
2022-08-18 00:40:24        369 .command.sh
2022-08-18 00:42:05        232 .command.trace
2022-08-18 00:42:07          1 .exitcode
2022-08-18 00:42:05    2949039 salmon.merged.gene_counts.tsv
2022-08-18 00:42:06    5083106 salmon.merged.gene_counts_length_scaled.tsv
2022-08-18 00:42:06    5079756 salmon.merged.gene_counts_scaled.tsv
2022-08-18 00:42:06    3708791 salmon.merged.gene_tpm.tsv
2022-08-18 00:42:06   12550088 salmon.merged.transcript_counts.tsv

However, running the same script in an interactive manner, that file is created as expected
2022-08-18 06:05:22    2949039 salmon.merged.gene_counts.tsv
2022-08-18 06:05:22    5083106 salmon.merged.gene_counts_length_scaled.tsv
2022-08-18 06:05:23    5079756 salmon.merged.gene_counts_scaled.tsv
2022-08-18 06:05:23    3708791 salmon.merged.gene_tpm.tsv
2022-08-18 06:05:23   12550088 salmon.merged.transcript_counts.tsv
2022-08-18 06:05:24   14170950 salmon.merged.transcript_tpm.tsv

Any clue what it could be the problem?
Command used and terminal output
nextflow run nf-core/rnaseq -profile docker,test_full -with-report report-fusion.html --outdir 's3://nextflow-ci/results-fusion' -c geesefs.config -bg

### Relevant files

_No response_

### System information

_No response_

Worth mentioning, with test profile is ok, instead it fails when using test_full

Weird. That process ran through fine with -profile test_full when the automated tests were run on release.

This was using a CE generated on Tower via AWS Batch (fusion enabled).

Yehea, weird. What could be the cause of not producing *only& that result file? some missing input? we need a deductive troubleshooting

Yehea, weird. What could be the cause of not producing *only& that result file? some missing input? we need a deductive troubleshooting

Running locally the files in the work directory look different to the ones you reported above:
$ cd work/1f/da3116641ab0add9c00b583701d565
$ tree -a .
.
├── .command.begin
├── .command.err
├── .command.log
├── .command.out
├── .command.run
├── .command.sh
├── .command.trace
├── .exitcode
├── salmon
│   ├── RAP1_IAA_30M_REP1 -> /home/harshil/rnaseq/work/39/e3fb1202c5202129a6fed658ba7be4/RAP1_IAA_30M_REP1
│   ├── RAP1_UNINDUCED_REP1 -> /home/harshil/rnaseq/work/d0/1f3133a728306b1be2a724e850c75d/RAP1_UNINDUCED_REP1
│   ├── RAP1_UNINDUCED_REP2 -> /home/harshil/rnaseq/work/0e/6f1e9e5a26bb86032ca036094b2a7a/RAP1_UNINDUCED_REP2
│   ├── WT_REP1 -> /home/harshil/rnaseq/work/9f/d9318ae4bdea2f72409d78a5655911/WT_REP1
│   └── WT_REP2 -> /home/harshil/rnaseq/work/26/8a3b43ce39f24bd4d71a8acdf90fc4/WT_REP2
├── salmon.merged.gene_counts.tsv
├── salmon.merged.gene_counts_length_scaled.tsv
├── salmon.merged.gene_counts_scaled.tsv
├── salmon.merged.gene_tpm.tsv
├── salmon.merged.gene_tpm_length_scaled.tsv
├── salmon.merged.gene_tpm_scaled.tsv
├── salmon.merged.transcript_counts.tsv
├── salmon.merged.transcript_tpm.tsv
├── salmon_tx2gene.tsv -> /home/harshil/rnaseq/work/fb/fe4afdee7f83a0e780496f92b0f0aa/salmon_tx2gene.tsv
└── versions.yml

The 2 inputs required for this process is a nested directory called salmon and a file called salmon_tx2gene.tsv as defined here. I can't see any of those input files in the listing you sent above.

Looking into the .command.run the input files looks staged correctly
    mkdir -p salmon && ln -s /fusion/s3/nextflow-ci/work/6c/00efc9aab43aa8aff8517a5abc7d2a/H1_REP2 salmon/H1_REP2
    mkdir -p salmon && ln -s /fusion/s3/nextflow-ci/work/4c/0cc0b9fe3443983621cfe82e524ccf/K562_REP1 salmon/K562_REP1
    mkdir -p salmon && ln -s /fusion/s3/nextflow-ci/work/bb/f75fe6cd1c5d928b2c5731d9892d1c/GM12878_REP1 salmon/GM12878_REP1
    mkdir -p salmon && ln -s /fusion/s3/nextflow-ci/work/3b/4965b5aedea7d36923104102899591/GM12878_REP2 salmon/GM12878_REP2
    mkdir -p salmon && ln -s /fusion/s3/nextflow-ci/work/3a/32d8f5d19893ba8c466c4908e6eade/MCF7_REP1 salmon/MCF7_REP1
    mkdir -p salmon && ln -s /fusion/s3/nextflow-ci/work/dc/2021f406fa4100b7dd81dd9c070c46/MCF7_REP2 salmon/MCF7_REP2
    mkdir -p salmon && ln -s /fusion/s3/nextflow-ci/work/17/bea1c4db30b9325a290303c6721b58/H1_REP1 salmon/H1_REP1
    mkdir -p salmon && ln -s /fusion/s3/nextflow-ci/work/7a/0a54657d4e5c1ed513b1ea5a4b1585/K562_REP2 salmon/K562_REP2
    ln -s /fusion/s3/nextflow-ci/work/87/78aa2c561173a5bf29f0858a53c880/salmon_tx2gene.tsv salmon_tx2gene.tsv

even weirder, re-running manually it produces all expected outputs

Considering that the .command.log file is not copied either I've concluded it's a pipeline task issue, but something failing in the unstaging on result files


[Feature]: Support PaddingMode NONE in 3D

The dimensions of a 3D image change after Affine registration. Is this related to padding and if yes how can we fix it?

Hi Vasilis, could you elaborate on how you apply the affine transformation in order to resample your moving source image?
The PaddingMode only relates to how the finite input source image tensor is implicitly padded when sampling at locations outside the source image domain. It does not impact the sampling grid of the warped output image. The sampling grid of the spatially transformed image is usually determined by the sampling grid of the fixed target image, or the SpatialTransform.grid() respectively as specified during initialization of the spatial transform.
In case of the ImageTransformer (and equally deepali.modules.SampleImage) this is the target argument of the spatial transformer init function.
https://github.com/BioMedIA/deepali/blob/c47ac8cf81ce0978b3095d79592fcd1f017e23c6/src/deepali/spatial/transformer.py#L127

That's odd indeed. What is the code you use to apply the spatial transform?

Here is the piece of code for the affine multi-resolution registration and the warping:
source = tranformed_images[0]['wat'][tio.DATA]
target = ts['wat'][tio.DATA]

transform_affine = multi_resolution_registration(
    target=target,
    source=source,
    transform=spatial.FullAffineTransform,
    optimizer=(optim.Adam, {"lr": 1e-3}),
    loss_fn=lambda a, b, _: sim_loss(a, b),
    device=device,
    levels=3,
    iterations=1000
)
transform_affine = transform_affine.cpu()
source = tranformed_images[0]['wat'][tio.DATA]
target = ts['wat'][tio.DATA]

transform_affine = multi_resolution_registration(
    target=target,
    source=source,
    transform=spatial.FullAffineTransform,
    optimizer=(optim.Adam, {"lr": 1e-3}),
    loss_fn=lambda a, b, _: sim_loss(a, b),
    device=device,
    levels=3,
    iterations=1000
)
transform_affine = transform_affine.cpu()

I see. The change in image size is probably caused by the multi-resolution pyramid. The sizes are adjusted such that doubling the size going from a coarser to the next finer level will eventually yield the closest size at the finest resolution to the given input image size. This is to enable efficient subdivision of a FFD control point grid.
The demo function would probably have to adopted a bit to account for this such that the output has the expected size. This can be done by passing the desired output image grid as target to the ImageTransformer used to apply the obtained transform. The transform.grid() is not identical to the input target.grid() here, but it's the former that's used when the image transformer is created as in ImageTransformer(transform).
Can you try changing the final transformer to ImageTransformer(transform, target=target.grid()) instead?

I've just merged a change which allows the sampling grid of the transformed image (output of ImageTransformer) to have a different normalized coordinate domain in world space than the spatial transform itself.


on GCP the configure-director resource step config-opsman-auth fails

on GCP the configure-director resource step config-opsman-auth fails with error
could not execute "configure-authentication": could not determine initial configuration status: could not make request round trip: Get https://opsman.hoppers.io/login/ensure_availability: dial tcp: i/o timeout
after adding the ip address and hostname to /etc/hosts file script runs to completion.
do note the curl command as part of check-opsman-dns task is successful in resolving against DNS and maps to correct IP.
from the concourse container;
# nslookup opsman.hoppers.io
Server:		<IP_ADDRESS>
Address:	<IP_ADDRESS>#53

Non-authoritative answer:
Name:	opsman.hoppers.io
Address: <IP_ADDRESS>

Since I have to run this step manually I cannot proceed to the last task in the resource to configure-director

Hi @phopper-pivotal.
It's interesting indeed given that the address resolves. Let me see if I understand the mitigative action:

The concourse job failed.
The opsman entry got added to /etc/hosts on the hijacked docker container
Running the script manually from the docker container with spliced /etc/hosts has succeeded.

Is this correct? If, so I have a few questions:

Was the job re-run from concourse? Did re-running of the same concourse job fail the same way?
Is it possible that opsman.hoppers.io record was set in the DNS within 5 minutes before the job ran?
Is the issue reproducible at present?

@oozie that is correct. once I modified the /etc/hosts to map host to IP address it worked. However I cannot move on to the next step of the pipeline/job to fully configure the ops director and apply changes. so I'm stuck at the moment.
yes. running the same job repeatedly results in same error and is reproducible.
could not execute "configure-authentication": could not determine initial configuration status: could not make request round trip: Get https://opsman.hoppers.io/login/ensure_availability: dial tcp: i/o timeout
DNS was set 24-hours before running that job of the pipeline.
feel free to hit me up on slack as well.

The first nameserver on the docker container does not resolve at all nameserver <IP_ADDRESS>

@oozie you can close this ticket. <IP_ADDRESS> is the bosh director. it appears it no longer existed so rebuild concourse deployment from previous terraform state.
step passes.

Thanks @phopper-pivotal


Missing examples of situations where Microsoft won't use voice recognition data

There is following statement in the document: "For example, Microsoft won't use the data in the following situations:" but it does not mention any situations.
Can we get some examples?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 9ec8f04d-0386-3141-ff03-0149589fe876
Version Independent ID: 2dd04344-50a7-7214-fc5f-0f92eafcf8ac
Content: Tenant Administration control for voice recognition (voice profile) in Teams Rooms - Microsoft Teams
Content Source: Teams/rooms/voice-recognition.md
Service: msteams
GitHub Login: @serdars
Microsoft Alias: v-mahoffman

Hi @Larryngolog, thank you for your feedback.
@v-mahoffman, could you kindly help here?

@v-mahoffman, could you kindly help here?

@v-mahoffman, could you kindly help here?

@dstrome and @SerdarSoysal hope all is well. Is this something you can help us with? Thanks!

@dstrome and @SerdarSoysal hope all is well. Is this something you can help us with? Thanks!

@dstrome and @SerdarSoysal hope all is well. Is this something you can help us with? Thanks!


uni-app vue2 hmr doesn't work well

When you edit some component/page in H5 mode, the hmr doesn't work well, because only the component/page which you are editing is considered as a source change by webpack's HotModuleReplacementPlugin, so the class names update, but the style in App.vue doesn't.
Here is a workaround:
I patch the webpack using the patch-package.
Find the module.hotUpdate = records.moduleHashs[identifier] !== hash; in /node_modules/webpack/lib/HotModuleReplacementPlugin.js, replace it with:
module.hotUpdate = records.moduleHashs[identifier] !== hash || (function () {
  const g = identifier.split('!')
  return g[g.length - 1].includes('src/App.vue?vue&type=style&index=0&lang=css&') && g[0].includes('css-loader')
})();

This will force webpack to always consider App.vue as new file.

So the meaning is, is this the Vue2 webpack hmr solution?

It’s a hack trick… I write this for others who want to workaround the hmr problem.


The call to get_match_history_by_puuid_v3 throws exception

🐛 Bug Report
When calling the method get_match_history_by_puuid_v3 we now get an exception.
🔬 How To Reproduce
Steps to reproduce the behavior:
Code sample
  File "C:\Users\ander\Documents\repos\valstats\valstats.py", line 190, in get_game_history
    response = valo_api.get_match_history_by_puuid_v3(region=auth.region, puuid=user_id, size=10, game_mode=typ)
  File "C:\Users\ander\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.11_qbz5n2kfra8p0\LocalCache\local-packages\Python311\site-packages\valo_api\endpoint.py", line 88, in wrapper
    return self._get_endpoint(*args, **kwargs)
  File "C:\Users\ander\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.11_qbz5n2kfra8p0\LocalCache\local-packages\Python311\site-packages\valo_api\endpoint.py", line 154, in _get_endpoint
    return self.parse_response(response, response.content)
  File "C:\Users\ander\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.11_qbz5n2kfra8p0\LocalCache\local-packages\Python311\site-packages\valo_api\endpoint.py", line 179, in parse_response
    result = msgspec.json.decode(content, type=return_type)
msgspec.ValidationError: Expected `int`, got `float` - at `$.data[0].players.all_players[0].economy.spent.average

Environment
Python 3.11.9
valo_api==2.0.7
Screenshots
📈 Expected behavior
The call should succeed and return the same payload as before.
📎 Additional context
This used to work a couple of weeks ago. It seems the returned payload has changed format.

Should be fixed by #1168


Restart the chef-client when rotating logs

The original call is a reload [1].  This makes the chef-client crash during logrotate because of  chef/chef#4578 . A restart is the prescribed workaround for this in Chef-client 12.19+.  The workaround is no longer needed on chef-client 13.2+.
[1] https://github.com/chef-cookbooks/chef-client/blob/master/attributes/default.rb#L180

So. restarting the chef-client doesn't necessarily mean it can start back up again :(
cat /var/log/chef/client.log
[2018-04-01T06:35:22-04:00] FATAL: Chef is already running pid 43711
[2018-04-01T06:35:22-04:00] WARN: Chef RFC 062 (https://github.com/chef/chef-rfc/blob/master/rfc062-exit-status.md) defines the exit codes that should be used with Chef.  Chef::Application::ExitCode defines valid exit codes In a future release, non-standard exit codes will be redefined as GENERIC_FAILURE unless `exit_status` is set to `:disabled` in your client.rb. (CHEF-2) at /opt/chef/embedded/lib/ruby/gems/2.3.0/gems/chef-12.19.36/bin/chef-client:26:in `<top (required)>'.
Please see https://docs.chef.io/deprecations_exit_code.html for further details and information on how to correct this problem.


fix issue #701

@bqpd ready for the swiftest of reviews
closes #701

my fault -- thanks for fixing!


Add the behavior to prevent exceeding the specified free disk space

See #4
This feature estimates the free disk space in the destination folder before saving screenshots to cancel the save operation.
Note that this behavior depends on the following ranges.
0 Disable feature.
1-99 Percentage of free disk space to cancel the save operation.
100- Number of free disk space (in megabytes) to cancel the save operation.
For this feature to work properly, you must specify values for all enabled screenshot kinds.

Build https://ci.appveyor.com/project/cot6/reshade-addons/builds/50383659/artifacts
Please be sure to make a backup of your screenshot add-on configuration file (ReShade_Addon_Screenshot.ini) before testing builds from this branch.
The configuration files are located in the same folder as the ReShade DLL and the add-on files.

Build https://ci.appveyor.com/project/cot6/reshade-addons/builds/50383986/artifacts


dns cache: support per interface dns resolution

Description: there exist certain environments where it is important for DNS resolution to be different per available network interface, e.g., mobile devices where a resolved address for a home wi-fi network might not be valid on a cellular network.
This feature request covers two parts:

Allow for interface specification on dns resolver queries: this needs further investigation to understand what is available in the Apple APIs used in the apple dns resolver, and in c-ares for the c-ares based resolver.
Allow the DNS cache to specify interfaces on cache look ups. This might be implemented in one of two ways:

DNS Cache per interface: with independent host lists. Rough sketch of this implementation option via @mattklein123:
- Allow the proxy filter to attach to more than 1 DNS cache (names must be unique).
- Allow the DFP cluster to attach to more than 1 DNS cache (names must be unique). Cluster must maintain parallel host sets for each attached cache since the host names will be the same.
- Allow the cache to be selected using metadataMatchCriteria(), since this can be supplied in stream info (and set via the interface selection filter). It is also supplied via LbContext, so can be used by the cluster.
- The retry options predicate will also need to be able to change the match criteria, but that is pretty simple.
One cache with ability to tag and query hosts by hostname,interface pairs.

cc @alyssawilk @RyanTheOptimist

Had an interesting discussion with the folks over at google (@alyssawilk @RyanTheOptimist @DavidSchinazi).

There is a general hypothesis that utilizing https://github.com/envoyproxy/envoy/pull/18165 will bring most of the benefits we might be able to get with having per interface entries. The only slight difference might be that with this feature, relevant entries would be in the cache already when a network change occurs resulting in slight performance improvement.
This feature would be novel in the sense that chrome does not do this today. It only flushes the cache on network changes


add Fibonacci Fast Ruby

@Thuva4 I thought this repository was for beginner coders (also targetting hacktoberfest), isn't it?


Question of inference

Hi mkshing, you mention "In the inference phase, you need to input ids to the model by using model.forward() so that you cannot use model.generate() attribute. ".  Possible to elaborate more on this part? I dont really know the difference of :

using model.forward(input_ids)
using model(input_ids)

Thanks for help

Hi! I believe there’s actually no difference because model() redirects to model.forward() eventually.


I get "Error in processx::run: System command error" when using orca inside Docker

I am using orca inside a downloadHandler function in an R-Shiny app inside Docker. When I click on the download button to generate and dowonload a plot I get disconnected from the session. Moreover, on the log file I get:
Warning: Error in processx::run: System command error
I am using xvfb-run to run orca with a script like this:
xvfb-run -a /squashfs-root/app/orca "$@"
Here is a minimal example of the shiny app:
library(shiny)
library(plotly)

ui <- fluidPage(
         downloadButton('plot_download', 'Download plot')
)
server <- function(input, output) {
  output$plot_download <- downloadHandler(
    filename = function(){
        plot_file_name<-'plot.png'
    },
    content = function(file) {

      path_split<-unlist(strsplit(file,'/'))

      download_path<-paste(path_split[1:length(path_split)-1],collapse='/')

      p <- plot_ly(x = 1:10, y = 1:10, color = 1:10)

      withr::with_dir(download_path, orca(p, path_split[length(path_split)]))

    })}
shinyApp(ui = ui, server = server)

Moreover, when I use orca in the R terminal inside Docker to generate the same plot, it works.
 If I use the CRAN version and I try to download the plot, I get an error message saying that I need a mapbox token.
I really appreciate any help on this.

https://github.com/ropensci/plotly/issues/1437#issuecomment-450675463
might help you and us debug.

ropensci/plotly#1437 (comment)
might help you and us debug.

Hi etpinard, thanks for the reply.
When I run system("which orca") in the R terminal inside Docker I get:
/usr/bin/orca
When I run system("orca") I get:
Plotly's image-exporting utilities

  Usage: orca [--version] [--help] <command> [<args>]

  Available commands:
  - graph [or plotly-graph, plotly_graph]
    Generates an image of plotly graph from inputted plotly.js JSON attributes.
    For more info, run `orca graph --help`.
  - serve [or server]
    Boots up a server with one route per available export component
    For more info, run `orca serve --help`.

I added the flag debug=TRUE to my R-shiny app like this:
withr::with_dir(download_path, orca(p, path_split[length(path_split)], debug=TRUE) )
But I get the same error message in the log file as before:
Loading required package: ggplot2

Attaching package: ‘plotly’

The following object is masked from ‘package:ggplot2’:

    last_plot

The following object is masked from ‘package:stats’:

    filter

The following object is masked from ‘package:graphics’:

    layout

Listening on http://<IP_ADDRESS>:45137
Warning: Error in processx::run: System command error
  [No stack trace available]

So I am guessing that the log file is not capturing any debug messages from the orca function. Do you have any other idea of how could I further debug this?

Moreover, after running the example with orca() in the R terminal inside Docker using the debug flag, I get a message like this:
>p <- plot_ly(x = 1:10, y = 1:10, color = 1:10)
>withr::with_dir('var/log/', orca(p, 'plot.png', debug=TRUE))

No trace type specified:
  Based on info supplied, a 'scatter' trace seems appropriate.
  Read more about this trace type -> https://plot.ly/r/reference/#scatter
No scatter mode specifed:
  Setting the mode to markers
  Read more about this attribute -> https://plot.ly/r/reference/#scatter-mode
created index-31de0e3a-817c-4d4e-9a60-1a9e23b4ead6.html for plotly-graph component
gpu process crashed - false
          Chrome version 59.0.3071.115
          Electron version 1.8.4
gpu process crashed - false
          Chrome version 59.0.3071.115
          Electron version 1.8.4
exported plotx, in 437.799923 ms
-
  leaving window open for debugging
|
done with code 0 in 439.87 ms - all task(s) completed

I hope this helps clarify the issue.

Thanks for all the info @0navarro !
Running orca with xvfb should be enough to solve the gpu process crashed issues:
https://github.com/plotly/orca#linux-troubleshooting-headless-server-configuration

Thanks for all the info @0navarro !
Running orca with xvfb should be enough to solve the gpu process crashed issues:
https://github.com/plotly/orca#linux-troubleshooting-headless-server-configuration

I am already running orca with xvfb, using a shell script that runs the extracted orca AppImage. So, when I run  cat /usr/bin/orca I get:
xvfb-run -a /squashfs-root/app/orca "$@"

Ok. Have you tried to export a graph using orca in your docker container outside the R interface?

Ok. Have you tried to export a graph using orca in your docker container outside the R interface?

I just ran an example. When I run:
orca graph '{ "data": [{"y": [1,2,1]}] }' -o fig.png --debug=T
I get:
created index-43ff78e2-f9de-4a2d-a7b6-413e0889e22e.html for plotly-graph component
exported fig, in 756.871099 ms

  leaving window open for debugging

done with code 0 in 758.36 ms - all task(s) completed

@0navarro It seems like the command ran successfully: done with code 0 in 758.36 ms - all task(s) completed. Do you still have an issue?

@0navarro It seems like the command ran successfully: done with code 0 in 758.36 ms - all task(s) completed. Do you still have an issue?

Hi antoinerg, thank you for your reply.
Unfortunately, I still have the issue. While the command above ran successfully, when I try to use orca within my shiny app within Docker, I get the error mentioned in my post.
When I run orca within Docker either with the R interface or with the terminal, it works fine. However, I get the error when I try to use orca within Docker within my shiny app.
Any insight on this is highly appreciated.

Hi,
I ran into a similar problem. In my case there was a problem with the input-filename in the orca function.
The error occurs when you try to save the outputfile into a path which not exists. If there is a path in the filename, orca try to write into that, relatively to the current working directory.
I don't know your setup but are you sure that path_split[length(path_split)]  is just the filename without any path? The right operator to give an absolute path is -d , which you can add via more_args.
orca(p,filename, more_args = c("-d",path_to_output ))
I tried your minimal example in a docker-container without problems.
Here my Dockerfile maybe it helps:
FROM openanalytics/r-base

# system libraries of general use
RUN apt-get update && apt-get install -y \
    sudo \
    pandoc \
    pandoc-citeproc \
    libcurl4-gnutls-dev \
    libcairo2-dev \
    libxt-dev \
    libssl-dev \
    libssh2-1-dev \
    libssl1.0.0

# system library dependency for the euler app
RUN apt-get update
RUN apt-get install -y libmpfr-dev

RUN R -e "install.packages('remotes', repos='https://cloud.r-project.org/')"

RUN R -e "remotes::install_github('ropensci/plotly')"

RUN R -e "remotes::install_github('rstudio/shiny',ref='v1.1.0')"

RUN R -e "install.packages(c('processx'), repos='https://cloud.r-project.org/')"

# install orca
RUN apt-get update -y
RUN apt-get install -y libudunits2-dev libproj-dev libgeos-dev libgdal-dev
RUN apt-get install -y libgtk2.0-0 libgconf-2-4 xvfb fuse desktop-file-utils

RUN wget -q -O - https://dl-ssl.google.com/linux/linux_signing_key.pub | apt-key add -
RUN sh -c 'echo "deb [arch=amd64] http://dl.google.com/linux/chrome/deb/ stable main" >> /etc/apt/sources.list.d/google-chrome.list'
RUN apt-get update -y
RUN apt-get install -y google-chrome-stable

RUN wget https://github.com/plotly/orca/releases/download/v1.2.1/orca-1.2.1-x86_64.AppImage -P /home
RUN chmod 777 /home/orca-1.2.1-x86_64.AppImage
RUN /home/orca-1.2.1-x86_64.AppImage --appimage-extract
RUN printf '#!/bin/bash \nxvfb-run --auto-servernum --server-args "-screen 0 640x480x24" /squashfs-root/app/orca "$@"' > /usr/bin/orca
RUN chmod 777 /usr/bin/orca

# copy the app to the image
RUN mkdir /root/shiny
COPY app.R /root/shiny

EXPOSE 3838

CMD ["R", "-e", "shiny::runApp('/root/shiny',port=3838, host = '<IP_ADDRESS>')"]

Hello!  I'm having a similar issue on a headless Ubuntu machine where I'm trying to set up orca to make plotly figures offline:
xvfb-run -a orca graph --verbose test_fig.json
Fontconfig warning: "/etc/fonts/fonts.conf", line 100: unknown element "blank"
gpu process crashed - false
          Chrome version 73.0.3683.121
          Electron version 5.0.1

The process just hangs there after printing this message.  orca --version is 1.2.1.  Happy to provide any additional information.

Hello, I finally figured it out.
The problem was that the default user that runs the shiny app from the server, shiny, did not have access to the files in  /squashfs-root/app/orca. At first I didn´t notice this because the message in the log file does not give any clue about permissions.
Anyway, I fixed the issue by running chown shiny:shiny -R /squashfs-root/ . I hope this helps.


explorer.onReveal

fixes https://github.com/microsoft/vscode/issues/83639
I am not happy with this PR, just creating it as work in progress.
Issues:

The experience is not that nice when autoReval is turned on and onReveal has non default value
Description of onReveal setting not clear enough

Ah, I was going to write an extend comment on that issue, but never got to, due to the lack of time. Let me quickly jot down something less thorough.
I think the issue here runs deeper than autoselection on reveal. Looks like windows and linux just handle selection behavior differently in explorer-like things.

In windows, holding shift and pressing arrow down adds the next item to the current set of selected items. That is, file selection is sticky. This is what VS is currently using.
In linux, holding shift and pressing arrow down  creates new selection. That is, file selection is not sticky and works like seleciton in the text editor: holdig shift and moving the cursor expands and shrinks selection, letting shift go and moving the cursor clears selection. This is what I am accustomed to, and what I, subjectively, find more intuitive and easier to use

For windows-style selection, it makes sense to select and item on reveal, as otherwise shift + arrow down won't select the current item. For linux-style, it does not.

Thanks for the feedback.
This is tree specific selection behavior. Fyi @joaomoreno (who is currently on vacation)
I am not a big fan of having a OS specific tree behavior, especially since changing it might break the muscle memory of our users. However, let's wait and see @joaomoreno feedback

Yeah, I fully agree that changing a default would be horrible, and that making it platform-dependent is also a bad idea. I personally would find a flag to control this behavior useful (which would be similar in spirit to "window.titleBarStyle"), but I don't know if that would be useful for enough of other users :)


Possibility for users to fill up certain groups multiple times

First of all, an outstanding package, congratulations.
Is it possible to do in the current package (or add to the package) a way for the users to fill up certain groups of fields multiple times?
For example, if we want to collect previous job experiences, we don't know how many they have. Something like this:

Hello @raphaelarias ,
Thanks for the compliments. I very appreciate that.
In theory, it would be possible to fill up. I assume you have the data already, then just simply pass it to the v-model of Vue Form Builder. Therefore, the form will be filled up to certain fields based on your need.
Let me know if it can't work like that (also, more detail would be great)
Thanks.

Hello @sethsandaru
In this case, we don't have the data, but it would be nice to give the user the option to add this type of field, so when the end-user is filling up the form, they can click a + button to add more fields (or group of).

Hello @raphaelarias ,
Ahh, I know what you want now. It's actually a feature from the<EMAIL_ADDRESS>(I called it as Dynamic Section) which basically let the users to +/- the same section to input more data.
For @2.0.0 it hasn't had that feature yet. I'm still thinking of a good approach to make that happens. At least @2.2.0, it should be available.
Thanks.


Destroy borrowed resources during cleanup

My attempt to fix #291

I've been working on something that takes this to a much further degree. The one major takeaway I've had is that you don't want this to be always true. It seems in line with the current implementation though. But this current implementation needs a lot more power to handle even more complex pooling scenarios.


Add --linelength option support

Hello,
I noticed the missing support for the --linelength option of cpplint. This PR adds a configuration field for that specific option.
Today the line length limit of 80 characters is quite obsolete, most C++ developers agree on the fact that with moderns IDE, an increased line length actually improves code readability.
Thank you in advance for taking that into consideration.

Beautiful, Thanks!


Tables and lists need garbage collection.

Need to be able to generate a collect function for each list and table subtype.

Tables are partially garbage collected now, there is still a potential memory leak when modifying the value of a table.

Lists are now garbage collected when they drop out of scope.
Still might need to deal with cases when updating indexes.


video_capture demo freezes when pressing any key instead of closing

macos M2 Pro v13.2.1
official binary distribution
OpenCV version: 0.80
rustc 1.69.0 (84c898d65 2023-04-16)

When running code similar to the example video_capture, the application freezes entirely instead of shutting down when pressing any key. There is some code that runs afterwards as the camera is only supposed to pop up one time only. I'm assuming this is the cause but, perhaps I'm not shutting down the window properly. I've tried altering it to instead use destroy_window and destroy_all_windows before the break but it still fails.
Not sure how to proceed from here.

Any luck?


Updates CHANGELOG and version for 1.11.0

Changes proposed in this PR

filling in the CHANGELOG information for this release
bumping the version (in two separate commits)

Why are we making these changes?
We would like to release the latest batch of enhancements.

@DaoWen any feedback on this?

@DaoWen have you had a chance to review this?


[SW-642] Fix transactions displaying in different subaccounts

popup.9c70b4d7.js:1 Uncaught (in promise) TypeError: Cannot read properties of undefined (reading 'slice')


Modify DS_REGENERATE_SSH_KEYS to remove host keys at build, as well as install script to generate host keys at boot

It was found that the existing script does not correctly regenerate keys on startup, even when enabled. This PR modifies the task to delete host keys on the rootfs before it is packed up, ensuring no keys make it to the generated tarball. Additionally, a startup script is installed to the target to run on every boot which simply calls ssh-keygen -A which will generate keys if they do not exist. This is not much different than the previous implementation save for it is run every boot rather than only run when /ssh_regenkeys is present on disk. The -A flag will only generate keys if they do not exist, the script will do nothing once keys are in place on the target.

What if any reasons are there to have sshd installed and not always generate keys at first boot?

What if any reasons are there to have sshd installed and not always generate keys at first boot?

Personally, I can't think of any. But my goal was to make as minimal of an impact as possible which was to modify what already existed to instead remove keys and then install a script to ensure keys are generated.
If we always removed keys, then we would always want to install that startup script which could be an unexpected gotcha from the current behavior.


Support wildcards in target

Support a wildcard suffix for targets with the -only and -omit options.  Don't allow -only wildcard targets that do not match any targets.  Group tests if multiple wildcard targets match the same actual target so all matching tests are used.

2 tests failed ;)

Just ran first test locally. If I say -only Test* and I have disabled target in the scheme with name TestSomething, TestSomething is run =/


subpage feedback

Documentation feedback

Page title: Subpage
Page URL: https://crate.io/docs/fake/en/latest/subpage.rst
Source: https://github.com/crate/crate-docs-theme/blob/master/docs/subpage.rst

cc @crate/docs

this is my feedback for the subpage

this was a test. please ignore


Blazor. Dynamically created component

Hello everyone!
I'm working on a library, which fully generates Blazor-based component type in the runtime(by using Reflection.Emit). It produces type inherited from the ComponentBase, with it's own BuildRenderTree method logic, fields, properties and so on.
I want to render this generated component on some specific route.
At this moment i'm using approach with additional class component with code like this:
[Route("customView")]
    public class CustomView : ComponentBase
    {
        [Inject]
        public ICustomViewTypeProvider TypeProvider { get; set; }

        protected override void BuildRenderTree(RenderTreeBuilder builder)
        {
            builder.OpenComponent(0, TypeProvider.GetCustomViewType());
            builder.CloseComponent();
        }
    }

So, it ships in form of Razor Component library and to use it in the Blazor server side application i need to provide additional parameter to app Router - AdditionalAssemblies="new[] { typeof(CustomView).Assembly }" -
to allow user to navigate to my customView route and see my generated component.
So the main question - is how to properly use and render such generated type in the Blazor applications? Any better ways how to handle such flow?

Thanks for contacting us.
This is not a scenario we support at the moment. Hopefully the community can help you out with this, so leaving this issue open for some time in the Discussions milestone.


Set xterm peer dependency to ^3.6.0

I think the character joiner API was only available in 3.6 (or at least announced in)

I see we had the same thought 😄


Add iphoneX handling

Please provide enough information so that others can review your pull request:
Explain the motivation for making this change. What existing problem does the pull request solve?
Prefer small pull requests. These are much easier to review and more likely to get merged. Make sure the PR does only one thing, otherwise split it.
Test plan (required)
Demonstrate the code is solid. Example: The exact commands you ran and their output, screenshots / videos if the pull request changes UI.
Make sure you test on both platforms if your change affects both platforms.
The code must pass tests and shouldn't add more Flow errors.
Code formatting
Look around. Match the style of the rest of the codebase.

Hi @AnthonyChanHK01 - thanks for the PR but if you don't fill the template it's actually really hard for us to properly understand what you are trying to accomplish.
That said, for handling the iPhone X we'll use #2833.

@AnthonyChanHK01 I see you're updating the icons here. Can you explain your motivation for that and maybe open a separate pr for that?

Closing because no answer about this in over 19 days.


WIP:Make New-Item -Force overwrite on Junction

PR Summary
When performing New-Item <itemname> -Type Junction -Value <path> -Force, it will fail with "<path> cannot be removed because it is not empty.".
This has been resolved by moving the Child Item check from before force is checked, to the else condition of the force check.

PR Context
This PR aims to fix #17656.
PR Checklist

[ ] PR has a meaningful title

Use the present tense and imperative mood when describing your changes

[ ] Summarized changes
[ ] Make sure all .h, .cpp, .cs, .ps1 and .psm1 files have the correct copyright header
[ ] This PR is ready to merge and is not Work in Progress.

If the PR is work in progress, please add the prefix WIP: or [ WIP ] to the beginning of the title (the WIP bot will keep its status check at Pending while the prefix is present) and remove the prefix when the PR is ready.

Breaking changes

[ ] None
OR
[ ] Experimental feature(s) needed

[ ] Experimental feature name(s):

User-facing changes

[ ] Not Applicable
OR
[ ] Documentation needed

[ ] Issue filed:

Testing - New and feature

[ ] N/A or can only be tested interactively
OR
[ ] Make sure you've added a new test if existing tests do not effectively test the code changed

Tooling

[ ] I have considered the user experience from a tooling perspective and don't believe tooling will be impacted.
OR
[ ] I have considered the user experience from a tooling perspective and opened an issue in the relevant tool repository. This may include:

[ ] Impact on PowerShell Editor Services which is used in the PowerShell extension for VSCode
(which runs in a different PS Host).

[ ] Issue filed:

[ ] Impact on Completions (both in the console and in editors) - one of PowerShell's most powerful features.

[ ] Issue filed:

[ ] Impact on PSScriptAnalyzer (which provides linting & formatting in the editor extensions).

[ ] Issue filed:

[ ] Impact on EditorSyntax (which provides syntax highlighting with in VSCode, GitHub, and many other editors).

[ ] Issue filed:

Making this WIP as my build environment is unhappy so I'll be testing off the build artifact. 😅

You could look
Describe "Hard link and symbolic link tests" -Tags "CI", "RequireAdminOnWindows"
in FileSystem.Tests.ps1

Please add a test.

I added a simple overwrite test, but ideally I would like a way to verify that the object created is actually new and to throw an error if it is not.
In a FAT32 or EXFAT FS I would just compare the creation date by epoch, but afaik Windows doesn't store the milliseconds in item creation 😐. Is there a way you would recommend to compare the first and second junction to verify the second is actually new?

You could use another target in second New-Item and check that target is changed after first command.

@microsoft-github-policy-service agree [company=""]

@microsoft-github-policy-service agree


sessions

How did you get exactly 12 000 lines per file? Seems a bit sus...  We know the myo sampling frequency is around 200 samples per second but it tends to vary upto 1 or 2 samples per second. This should be reflected in the measurements. My guess would be you used sample counting to determine the supposed time instead of measuring time separately and determining the label based on the elapsed time. Everything else seems fine thought, so I'll merge the commit.


⚠ Bofrost.hr has degraded performance

In dd81992, Bofrost.hr (https://www.bofrost.hr) experienced degraded performance:

HTTP code: 200
Response time: 2536 ms

Resolved: Bofrost.hr performance has improved in b82cdbb after 6 minutes.


Didact UI changes

https://github.ibm.com/Developer-Playground/work-items/issues/192

https://github.ibm.com/Developer-Playground/work-items/issues/187


Forced tunneling and prefix filtering

Two questions:

If OnPrem advertises 0/0, would that get propagated to the other circuit?
Can one filter out the prefixes that get advertised to the other circuit vs. what gets advertised to Vnet? For example, Baltimore announcing prefixes A and B to the Vnets, but only prefix A to San Francisco?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 1c2e5cb1-6388-4944-b2bb-c98152c5fe65
Version Independent ID: 841a4807-a4b3-4d4d-31e8-a25c540f3bfc
Content: Azure ExpressRoute Global Reach
Content Source: articles/expressroute/expressroute-global-reach.md
Service: expressroute
GitHub Login: @cherylmc
Microsoft Alias: cherylmc

@hajjat Thanks for the feedback. We are actively investigating and will get back to you soon.

Hello, posted on the FAQ but I can't seem to find it so here goes on the Global Reach page...
Does Global Reach support any type of QoS model? If it does, can you elaborate? If not, will the connection preserve if not honor QoS markings for traffic traversing the connection?

Ok. I see I unintentionally added this as a comment to the forced tunneling and prefix filtering ask. I'll try again as a separate question.

@hajjat could you elaborate on your first question a bit more?
routes are shared via BGP. You can configure custom routes on your VNET and on-premise environments.

@hajjat there is currently no way to filter prefixes at this time. Please leave your feedback Here if you would like us to add this feature.
We will now proceed to close this thread. If there are further questions regarding this matter, please tag me in your reply. We will gladly continue the discussion and we will reopen the issue.


Broken link to latest Kubernetes documentation

This is a Bug Report

Problem:
https://v1-14.docs.kubernetes.io/docs/ hyperlinks to the latest documentation, except that the link is actually to https://v1-14.docs.kubernetes.io/docs/ (because the href is null).
(oops!)
Here's the markup:

	 Kubernetes v1.14
	  documentation is no longer actively maintained. The version you are currently viewing is a static snapshot. For up-to-date documentation, see the
	 latest version.

Proposed Solution:
Fix the link so that it takes readers to https://kubernetes.io/docs/
Page to Update:
https://v1-14.docs.kubernetes.io/docs/

@sftim I can't reproduce -- Chrome on Mac Mojave. Markup on the site looks OK too (no null href):

            Kubernetes v1.14
            documentation is no longer actively maintained. The version you are currently viewing is a
            static snapshot. For up-to-date documentation, see the
            latest version.

Leaving my previous comment in place, but correcting it. Yup, reproduced. Given it's the latest version minus only one, seems a fairly high priority -- also bc seems likely that if we don't fix it'll repro for the next released version.

/priority important-longterm

/kind bug

Revised the issue description as v1.16 is now out.


Add missing assemblies to ZIP package

Forge crashed on me because ICSharpCode.SharpZipLib.dll was missing. I also noticed that FParsecs assemblies aren't included, too.

Thanks


Add context getter to RenderingDevice

The classic equivalent was lost in the split of rendering architecture. It's still useful in cases where dealing directly with the driver is desirable.

Thanks!


blogTitle not working

Have you read the Contributing Guidelines on issues?

[X] I have read the Contributing Guidelines on issues.

Prerequisites

[X] I'm using the latest version of Docusaurus.
[X] I have tried the npm run clear or yarn clear command.
[X] I have tried rm -rf node_modules yarn.lock package-lock.json and re-installing packages.
[ ] I have tried creating a repro with https://new.docusaurus.io.
[X] I have read the console error message carefully (if applicable).

Description
blogTitle not working
Someone at the end of this thread seems to have a similar issue: https://github.com/facebook/docusaurus/discussions/5119
Reproducible demo
No response
Steps to reproduce
  presets: [
    [
      'classic',
      {
        blog: {
          routeBasePath: "/",
          blogTitle: "Blog",
        },
      } satisfies Preset.Options,
    ],
  ],

Expected behavior
I want the title of the page to be: "Blog | Foo"
Actual behavior
The blogTitle is not showing, I get the config title twice: "Foo | Foo".
Your environment

Public source code:
Public site URL:
Docusaurus version used: 3.2.1
Environment name and version (e.g. Chrome 89, Node.js 16.4):
Operating system and version (e.g. Ubuntu 20.04.2 LTS):

Self-service

[ ] I'd be willing to fix this bug myself.

Hello I tried when creating a minimal repo and I can't reproduce your issue
https://stackblitz.com/edit/github-srzyqm?file=docusaurus.config.js

Hey OzaklOne thanks for the stackblitz, I tried running it but I get the following error: error An unexpected error occurred: "Failed to fetch dependencies: -<EMAIL_ADDRESS>

From what I tried and understand, when you are in blog only mode blogTitle is not the title of the page anymore, blogTitle is the title of the page when routeBasePath is not set to '/' because title will take the priority over blogTitle and indeed on the route / of your website you will have title twice so by default 'My blog | My blog'

Yes that looks like we have this historical behavior in the theme:
function BlogListPageMetadata(props: Props): JSX.Element {
  const {metadata} = props;
  const {
    siteConfig: {title: siteTitle},
  } = useDocusaurusContext();
  const {blogDescription, blogTitle, permalink} = metadata;
  const isBlogOnlyMode = permalink === '/';
  const title = isBlogOnlyMode ? siteTitle : blogTitle;
  return (
    <>
      <PageMetadata title={title} description={blogDescription} />
      <SearchMetadata tag="blog_posts_list" />
    </>
  );
}

I'd consider it a bug because that looks wrong to me.
Having a blog homepage at / does not mean a site only contains a blog. You might have a blog at the root of your site and yet have docs.
I'm not sure how we'll fix it yet, but this will likely be done as part of a global siteTitle breaking-change PR where we change other things as well.

@slorber I would like to work on this, can you please help with the expected behaviour?


Storing Requests and Presenting on a Dashboard

Is there any way for this to be extended to store all the requests and present them on a user friendly dashboard (I have users who aren't that tech savvy)?

Really hard to say because there could be dozens of 'environment' specific constraints that may or may not work for you... eg you redirect all the output from this container to a log file and then find some way of exposing it via a web dashboard like this one?
Another way could be if that was part of this solution itself, but ideally if something exists then it's a middleware that someone else has already implemented (I would not want to have to maintain a middleware), very similar to the recent Prometheus pull request — the Prometheus metrics show up at the /metrics path — so I can imagine some kind of /dashboard endpoint that shows all the requests/responses together. A morgan web log viewer? Not finding many good results on that.


Implementing ed25519ph

Implementing Partial update Signatures using the Ed25519 Pre-Hash version.
I tried to follow the most that I could the current code style and design, but please review and let me know any changes you see fit.
Thank you

Hi @ektrah , can you have a look on this PR?

Looks overall quite good, thank you very much!
As I understand it, Ed25519 and Ed25519ph are two separate algorithms. So, I don't think that the Ed25519ph class should be a sub-class of Ed25519. I've taken the liberty to separate them in your branch and made a few other minor improvements along
the way.
Using the same struct IncrementalSignature for both signing and verification is both nifty and a bit error-prone. Nifty because it is identical except for the last step. Error-prone because the user has to pass in the algorithm of the key in the first step and the key itself in the last step. I think it would be better if the key was passed in at the first step. What do you think about making two structs out of this?
Could you also add the new features to the documentation?

Documentation updated. I was a bit confused with the SignatureAlgorithm2. Please review

Looks very good, thank you!
I removed the Algorithm parameter from the Initialize method since the key already contains the algorithm, and made some minor improvements to the documentation.
Merging.


add support for fish parser

this seems to be the next logical step in the roadmap
@quentinlintz could I please take this up XD?

Yes for sure, thanks again!! Also looking for interesting and cool ways to display the top commands too, so let me know if you happen to have any ideas there. I might cut v0.2.0 today or tomorrow and then the fish parser could be part of v0.3.0 👍🏻

Thanks @quentinlintz !
yeah sure I'll let you know if something comes to mind :)
Do we have a discord/slack channel for this project? feel like it would be easier to discuss stuff there, what do you think?

I think that could be a good idea, any other feature ideas that come to mind that would take substantial effort? I was planning on making another Reddit post about cmdtop, if it gets more attention I'll create a Discord or Slack for better communication 😄

Thanks maybe we make a post on reddit and get some feedback to work on this XD

Thanks again, this can be closed. I should install the fish shell and test it out to investigate if the output is as accurate as the zsh and bash parsers. I honestly don't know much about how fish works 😅

True true, I'll get some time this week to test it more as well....once we're thorough about it all we can make a release :)


How to convert list of refs to list of instances

As advised by the documentation we used references all over the store and normalized the model at the "root" (in the example it's the root but in the app it's not) of our store but when accessing subobjects this gives us a list of references and it appears that there is no function in the library allowing this.
Am I doing this wrong or do I need to create a function to resolve all the references ?
Here is a sample of my code :
// root store
@model("TwoU/RootStore")
export class RootStore extends Model({
    themes: prop<Array<Theme>>(() => []),
    contexts: prop<Array<Context>>(() => []),
    scenarios: prop<Array<Scenario>>(() => []),
}) {
    @modelAction
    getContextsWithTheme(themeId: TypeTheme['themeId']): Array<Context> {
        return this.themes.find(t => t.themeId === themeId).contexts; // TS error at this point because it's a list of refs and not a list of contexts
    }

    @modelAction
    getScenariosWithContext(context: TypeContext): Array<TypeScenario> {
        return this.scenarios.filter(s => s.context.current.contextId === context.contextId)
    }
}

// theme model/store
@model("TwoU/Theme")
export class Theme extends Model({
    title: prop<string>(),
    themeId: prop<number>(),
    contexts: prop<Array<Ref<Context>>>(() => []),
}) {}

export const themeRef = rootRef<Theme>("themeId", {});

Thanks for your help.

You need to resolve the references using current / maybeCurrent
return this.themes.find(t => t.themeId === themeId).contexts.map(c => c.current /* or .maybeCurrent */);


feat: drag'n'drop files

[x] Drop Files and Folders
[x] Move files and folders by drag and dropping them
[x] Move multiple files ^^

License: MIT
Signed-off-by: Henrique Dias<EMAIL_ADDRESS>

@hacdias everything seems to be working fine 👌
I just think we should hint that it's possible to drag and drop files to upload them, but not sure how 🤔

I'm merging this to master. If there is anything that can be improved, we can do it on another PR 😄


stage0: create required directories instead of requiring stage1 to have them.

The directories we require to exist inside stage1 are:

/rkt/status
/rkt/env
/opt/stage2

But instead, we could create them when running rkt, document that the paths above are reserved for rkt and drop their creation in build system for our stage1 images.

sgtm :)

Why do you prefer the paths to be created dynamically when a pod is started instead of creating the paths in the stage1 ACIs? If they already exist in the ACIs, that will be less directories to create in the overlay fs upper directory.

BTW, I beieve /rkt/status is required. I tried removing it from stage1-fly.aci and I get this error:
2016/01/18 18:15:11 error setting up stage1: error touching status dir: chtimes /var/lib/rkt/pods/run/383aa0ea-8715-40da-904a-af245a5dda09/stage1/rootfs/rkt/status: no such file or directory

So https://github.com/coreos/rkt/blob/master/Documentation/devel/stage1-implementors-guide.md is wrong right now.


Data savings mode

no vote count
no reply count

Duplicated by https://github.com/dluvian/voyage/issues/64


Req: Upload files to the code interpreter

It would be amazing to be able to upload files and store them in the same Minio as the code-api.
This way we would be able to send a csv file and analyze it.
Also possibly upload a text file as well, for analysis.

+1 for this idea


Switch LMDB to ledgerwatch/lmdb-go for consistency with TG

Codecov Report

Merging #102 (2a92d94) into master (dc7ac9a) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #102   +/-   ##
=======================================
  Coverage   82.37%   82.37%
=======================================
  Files          52       52
  Lines        4108     4108
=======================================
  Hits         3384     3384
  Misses        724      724

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update dc7ac9a...2a92d94. Read the comment docs.


Update 60-custom.just.readme.md to put new kargs in the correct section

the new kargs were added to set-kargs-hardening, not set-kargs-hardening-unstable

whoops, thanks!


add order reports

Make a list of requirements for ordering. Example for Gibson:

primers
pipette tips
plates
reagents (ex gibson mix)

CSV probably easiest. Add column/attribute to Reagents/Species for a link to source

half the way there with Protocol.input(). Will add file output if/when needed


Uses sources.json from BoringSSL

This change undoes some hackiness that relied
on specifics of the BoringSSL build system to
generate source files. With the latest github
mirror of BoringSSL exports a sources.json
that lists all source code files. This change
makes use of that file.
I ran "./tools/buildgen/generate_projects.sh" and no changes are
generated with this change.
@lidizheng @jtattermusch

Locally sanity tests seem to be failing on format issues.  I'm trying to fix them.

Actually format issues looks like it is for an unrelated file: "./test/cpp/qps/json_run_localhost_scenarios.bzl"

Can you rerun the generation script? Sometimes I see the formatting complain of that file. If the complain persists, can you share the log?

Can you rerun the generation script? Sometimes I see the formatting complain of that file. If the complain persists, can you share the log?

I reran:  ./tools/buildgen/generate_projects.sh but sanity check (python tools/run_tests/run_tests.py --use_docker -j 16 -l sanity -c dbg) still fails locally.  It looks like it passed as part of CI though, so this might just be an environment issue on my side.

Going ahead to merge this PR since all tests in CI passes. I hope the BoringSSL optimization can be included in our next release. The time until next release should give us a chance to catch potential issue.

@emkornfield Awkwardly, the boringssl-with-bazel library is not available in google3. But the gen_build_yamp.py needs to be ran in both environments. Can you create a roll forward PR without directly depending on sources.json? Or we need to import the boringssl-with-bazel to third_party?

@lidizheng can you clarify if output is important or just a non zero exit code

The output is important. It generates the yaml file that both Bazel and Blaze reads.

Can you send directions on how to test in google3

@emkornfield There isn't a straightforward way to test this.
If a PR is merged. You can initiate an import by running /home/build/google3/third_party/grpc/copybara_import.sh. Its documentation is at go/grpc-import. This script imports newly merged code from GitHub to google3.
Or you can create a one PR import CL from go/grpc-cherrypick. It's a bit more complex, since it needs to get the ref commit hash for rebase. This approach only works for unmerged PRs.


Update sql-server-linux-active-directory-authentication.md

We should not give "mssql" user as an example of creating new user in AD. This seems to be creating confusion between mssql local user on Linux vs mssql user in AD. Some customers do not seem to read the fine print and simply create mssql user in AD.
I think replacing mssql with sqlsvc makes it clear to customer that this is service account we are talking about.

@krishnamsft20 : Thanks for your contribution! The author(s) have been notified to review your proposed change.

Thanks @krishnamsft20!
Hey @amvin87 - Can you please help with this?
#reassign:amvin87

Hey @amvin87 - Following up on this.

@VanMSFT  yes this looks good and hence approved it.


RPN loss very high?

❓ Questions and Help
Hi guys, thanks for this generalized object detection benchmark, but I met a very strange issue that sometimes rpn loss is very high (around 4-20) and it does not decrease during training while other losses is normal (around 0.001-0.01). I've checked many times to make sure it is not because of the requires_grad=False, the code of rpn is directly cloned from the master branch. I've tried to increase/decrease base learning rate, but it didn't work. Increase learning rate results in loss to be nan, while decrease it didn't reduce the rpn loss.
Also, this condition occured randomly, I haven't found a stable way to reproduce.
Any tips would be very helpful, thanks~

It is generally much harder to explain one instance of high loss. Better way is to visualize the predicted rpn boxes and your ground truth boxes. For that you need to keep track of which image you are training you can get it printed while running. Debug with visualization. BoxList class has many utility functions which allows you to draw the boxes easily.


Explore the possibility of showing the user promotion attempt locations

(Parent issue #44897)
When a promotion attempt fails, it would be nice to provide the user with pointers to both the line of code that attempted the promotion and the line of code that made the promotion fail, e.g. in this code:
f(int? i, int? j) {
  if (i == null) return; // (1)
  i = j;                 // (2)
  i.isEven;              // (3)
}

it would be nice for the error message generated at (3) to point to both (1) (the site of the promotion attempt) and (2) the site of the code that defeated promotion).  Currently we only point at (2).

Unassigning myself because I’m not actively working on this feature right now.


V0.38.0 Updated HTTPQL, both Automate pages, added a general Plugins …

…tab page in References, included index and sidebar listings.

Wrote all the errors we discussed about, realized it would cause a merge conflict with my previous branch, copied what I wrote, reverted the changes, pasted into a .txt file for later anddd DIDN'T SAVE THE TXT FILE. :')
It's all ready to go though. Will expand upon some topics, such as regex and the new Plugins page once I do some background reading.


python3Packages.pycardano: 0.9.0 -> 0.10.0

Description of changes
Version bump
Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
23.11 Release Notes (or backporting 23.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

@ofborg build python311Packages.pycardano

Result of nixpkgs-review pr 266956 at 0335f734 run on x86_64-linux 1

2 packages built successfully:

python310Packages.pycardano
python311Packages.pycardano


Include amendments in validations subscription

Current coverage is 69.60%

Merging #1616 into develop will not affect coverage as of c330d07

@@            develop   #1616   diff @@
=======================================
  Files           908     908
  Stmts         67393   67397     +4
  Branches          0       0
  Methods           0       0
=======================================
+ Hit           46909   46910     +1
  Partial           0       0
- Missed        20484   20487     +3

Review entire Coverage Diff as of c330d07

Powered by Codecov. Updated on successful CI builds.

:+1:  LGTM

Merged as fa02409c92d57012ca5f9df65054c9fa2a9ad68d


example.js tiny bug

There is a tincy tiny bug in the example.js:
The example looks like this:
art.font('Demo!', 'Doom', function(rendered){     console.log(art.style(rendered, 'blue_bg+red+blink+inverse')); });
But the implementation looks like:
AsciiArt.font = function(str, fontName, style, callback)
ie. In the example the "style" parameter is never set, causing things to behave unexpected.
Working example:
var style = null; // or use an actual style
art.font('Demo!', 'Doom', style, function(rendered){     console.log(art.style(rendered, 'blue_bg+red+blink+inverse')); });

Thanks for insight, but if you actually run the code you'll see it will work as the example is written.
The reason why is the following lines following the function header you point out:
if(typeof style == 'function'){
    callback = style;
    style = undefined;
}

If I've missed another case, please let me know otherwise I'll close this.


Modular-Series missing

Modular-Series missing in the 841_Div 2

Please approve the issue to me

Issue assigned to @whynesspower Thanks

Kindly merge the PR!

Issue solved! Thanks @whynesspower


MetricLists for updating multiple metrics at once

🚀 Feature
Motivation
I am using my own version of MetricLists in my personal workflow for some time now and it has proven to be very helpful in keeping code clean.
A MetricList wraps multiple metrics together and puts them on proper devices (much like a ModuleList). What makes it different is that  it also allows you to update all of them in one compute() statement and log all of them using one log() call.
Pitch
My dynamic inference model needs its val_acc tested in 32 different setups. Manually creating all the different Accuracy() metrics is ridiculous. ModuleList() helps to create them in batch but I still need to write helper functions to log() or compute() all of them separately.
Alternatives
See pitch.

Did not notice that there are MetricCollections now. Closing this issue as it basically implements this usecase.


Security in InfyOm | Securing API through API-Keys

Hey guys,
is there a plugin for securing up the API.
For example with API-Keys or user:password authentication?
Thanks for anyone who can help!
Best regards,
Grashee

you can you https://github.com/tymondesigns/jwt-auth for api authentication

@Grashee The aim of this package is not to lock users to specific security packages, you are free to use any package for your api security based on your need. The main goal of this package is to save time in api development.


Fixup for PR 2797

Reverse sense of <<= and >>= to be consistent with bt().
Don't use palindromic bit patterns in unittest.

Auto-merge toggled on

Thanks!

Thanks


build: use str instead of string

String was deprecated in nixpkgs.
It fails to build with unstable nixpkgs now: https://github.com/NixOS/nixpkgs/pull/247848

What about all the other occurrences, should they be replaced as well?

That's the only one in this repo :)

Oh.
Please also bump the year in the copyright line.


How to define parameters outside of the main Haiku Module.

Hi, I have a fixed value defined, like
self._memory = self._initialize_memory(....)    // creates jnp.zeros(shape)
Then, I pass this through a haiku initialization module
self._params, self._net_state =self.forward(init_rng, inputs, self._memory)
but I need to use a parameter during creation of self._memory to initialize it with a parameter. For this I create a parameter as self._memory_biases=hk.get_parameter(...) outside of self.forward  which needs to be passed to self._initialize_memory. This would get the error of ValueError: hk.get_parameter must be used as part of an hk.transform.
Do I need to bring self.initialize_memory inside self.forward?, I am not sure how to do it  in a way this is called once, as there is no concept of init like torch.
Thanks for any suggestion on how to implement this in Haiku.

Hi @rabeehk , you could create the value outside of Haiku and pass it around (the disadvantage of this approach is needing to pass around the memory tensor which may be cumbersome):
def f(memory, x):
  x, memory = SomeModule()(memory, x)
  return x, memory

f = hk.transform(f)

def initial_state(..):
  zero_memory = jnp.zeros(..)
  params = f.init(..)
  memory = zero_memory + params['some_module']['some_bias']
  return params, memory

def train_step(params, memory, x):
  out, memory = f.apply(params, None, memory, x)
  ..
  return params, memory

Do I need to bring self.initialize_memory inside self.forward?, I am not sure how to do it in a way this is called once, as there is no concept of init like torch.

The way to think about this, is "do you want Haiku to manage 'memory' for you" (e.g. do you want to use get_parameter/get_state to access it, do you want the value to end up in the params/state dictionaries). If you don't then please see my initial suggestion.
If you do , then you could model your memory as "state" in Haiku, then you can pass an initialiser to create the initial value and use set_state to update it. This has the advantage that Haiku will do the "plumbing" for you of this value.
class MyMemory(hk.Module):
  def get(self, initial_bias):
    def init(shape, dtype):
      return jnp.zeros(shape, dtype) + initial_bias
    return hk.get_state("memory", [], init=init)

  def set(self, x):
     hk.set_state("memory", x)

class MyModel(hk.Module):
  def __init__(self, memory: MyMemory, name=None):
    super().__init__(name=name)
    self.memory = memory

  def __call__(self, x):
    m = self.memory.get(x)
    return m + x

def f(x):
  memory = MyMemory()
  model = MyModel(memory)
  model2 = MyOtherModel(memory)
  return model(x) + model2(x)

f = hk.transform_with_state(f)
params, state = f.init(..)  # initial memory will be in 'state'
out, state = f.apply(..)    # updated memory will be in 'state'


Improved UI for dynamic variables

Fixes #611
Description

Changed: ui of variables from Button to Tag

Checklist
- [ ] I have made corresponding changes to the documentation.

[x] I have added the necessary label (patch/minor/major - If package publish is required).

Reviewers
@AbhayVAshokan _a

@gaagul _a Looks good to me. A few changes.

Let’s not override the default styles of neetoUI Tag. We can use a custom button component for this.
Please left align the sub headings
Use color: rgb(var(--neeto-ui-black)); for the sub heading
Update the sub heading margin bottom to 10px

After these changes

Current UI

@AbhayVAshokan _a Please verify, and let me know if style need to be improved.

Please update the hover state of items to match the design

Existing UI

Design

Update the focus visible styles of items. Currently we are using yellow outline. Let’s use the same hover style mentioned above.

Add user-select: none to the custom buttons.

@gaagul _A

@AbhayVAshokan _a I have made the above mentioned changes.

@praveen-murali-ind _a

@praveen-murali-ind _a I have made the changes.

@AbhayVAshokan @gaagul Looks good to me.


feat: add Algebra ℝ A instance given Algebra ℂ A

!bench

Quoting a private message:

Note: for #8991 this also works:
import Mathlib

variable {A} [Ring A] [Algebra ℝ A]
open Algebra TensorProduct

example : (leftAlgebra : Algebra ℂ (ℂ ⊗[ℝ] A)).complexToReal = leftAlgebra := rfl

I'd like to see this committed too. It can go in test/instance_diamonds.lean once #9037 goes in

bors d+

bors merge
Thanks!


buttons require color={false} when in titlebars

need to look at the interaction with those elements and decide if color="default" should be changed or if something else needs to happen

default color to false works better than trying to reset colors in weird ways


CLI tool reading support

Describe Your Suggestion
Just making this to let it be known that there is at least some demand for this feature

Understood, I'll get this done in the next major release :+1:
Still going to mark this as a duplicate of #43 though lol

Understood, I'll get this done in the next major release 👍
Still going to mark this as a duplicate of #43 though lol

oh okay
By the way I'm working on something right now and a CLI version of your tool will be super massively appreciated, cause i saw the vdc page for the vpk file format and i got instantly overwhelmed lol


Mock REST APIs locally

Describe the solution you'd like
I would like to mock REST APIs, not just GraphQL, locally.
Describe alternatives you've considered
Only mock the function locally and test the API only when it's pushed

Hi @tobiasfeil, Is you Rest API backed by a Lambda function? You could always mock the Lambda function by using amplify mock function <functionName>

Yes there's a Lambda behind it, that's true. I would just like to run the actual API to see the full scope of what it would look like in production and how it would handle different requests. But I understand if this is out of scope right now.

@tobiasfeil we will look into the viability of mocking for rest api I will mark this as an enhancement.

Thank you! This (and being able to secure REST APIs via access token) would be viable, since for now, for these two reasons, I've just decided to develop a REST API with SAM instead. It would be awesome to do all of this with Amplify.

Closing as a duplicate of #3399


Add jetstream pubsub component token based auth docs

What content needs to be created or modified?

Jetstream pubsub component docs need adaptions for token based auth.
Describe the solution you'd like

Add description on the new token setting
Where should the new material be placed?

The associated pull request from dapr/dapr, dapr/components-contrib, or other Dapr code repos

https://github.com/dapr/components-contrib/pull/2295
Additional context

closing this issue as it's been resolved


Support for binding expiration/rotation and notification of workloads ?

I'd like to learn how the service binding project suggest to handle binding credentials rotations.
In particular:

how a Provisionned resource indicates its secret expiration date and "renew-before" hint ?
what recommended pattern for a user to ask a Provisionned resource to renew its secret (e.g. to revoke it preventively ) ?

typically this requires an overlap of the the old and new secret. How would this be supported since the specs currently only describes a single .status.binding LocalObjectReference ?

how workloads can get notified of a renewed secret ?

would the servicebinding spec suggest implementation to support opt-in for restart of workloads similar to ?

As an inspiration, here is how the open service broker api supports binding rotations:

OSB specs extract
https://github.com/openservicebrokerapi/servicebroker/blob/master/spec.md#binding-metadata-object

Response Field
Type
Description

expires_at
string
The date and time when the Service Binding becomes invalid and  SHOULD NOT or CANNOT be used anymore. If present, the string MUST follow  ISO 8601 and this pattern: yyyy-mm-ddThh:mm:ss.sZ.

renew_before
string
The date and time before the Service Binding SHOULD be renewed. Applications or Platforms MAY use this field to initiate a Service Binding rotation  or create a new Service Binding on time. It is RECOMMENDED to trigger  the creation of a new Service Binding shortly before this timestamp. If  the expires_at field is also present, the renew_before timestamp MUST be before or equal to the expires_at  timestamp. Service Brokers SHOULD leave enough time between both  timestamps to create a new Service Binding including a buffer to enable  continuity. If present, the string MUST follow ISO 8601 and this  pattern: yyyy-mm-ddThh:mm:ss.sZ.

https://github.com/openservicebrokerapi/servicebroker/blob/master/spec.md#binding-rotation

Some Service Bindings are not valid forever. Especially credentials expire and have to be replaced at some point in time. The simplest form of exchanging a binding is to create a new Service Binding, make it available to the Application and remove and unbind the old one. In many cases, this requires a restart of the Application.
But this approach has a few downsides. First of all, from the Service Broker point of view, there is no continuity. The Service Broker doesn't know that the new binding is the successor of the old one. If state is attached to the old binding, the Service Broker is not able to transfer this state to the new binding. The second challenge is, that Platforms have to provide the binding parameters again to the successor binding. But Platforms do not necessarily store these parameter values. Without the values, a user has to provide them again and that prevents an automated rotation of Service Bindings.
Therefore, this specification defines means to rotate Service Bindings. A Service Broker can declare in the catalog per plan if it supports the creation of a successor binding by setting the binding_rotatable field to true. If the field is set to false or not present, the Platform MUST NOT attempt to rotate a Service Binding of this plan.
To create a successor binding, the Platform MUST provide a predecessor_binding_id field in the binding provisioning request. The value of this field MUST be the Service Binding ID of a non-expired Service Binding of the same Service Instance. The request creates a new Service Binding with a new binding ID. Both Service Bindings, the new and the old one, MUST both be valid in parallel until they expired or are deleted.

Is there prior art/ discussion on this topic I can refer to ?
Thanks in advance for your help.

@gberche-orange Hey there! I'll put in my two-cents that option 2 is where we've seen the most success.  The idea that an individual secret is immutable and you simply create new, uniquely named secrets that roll out using standard Pod behaviors has a lot of advantages.

At its core the Service Binding Core Specification is three things:

a way for services to advertise binding credentials
a way for a workload process to discover services bound to the container
a way to wire the binding credentials advertised by a service into a workload container

More advanced behavior can be built on top of this core, but is not covered by the spec. Not that we don't think those higher level experience are important, we started with a non-contentious core that can serve as a foundation to build upon as there is interest. That can either be done in open source or proprietary layers.
A service knowing when a credential is no longer used is a hard problem to solve since it implies knowledge of how the workload operates. For example, scale to zero workloads add a dynamic where any previous running pod could be restarted.
The core spec doesn't assume the implementation will be a controller activity participating in the cluster, although the reference implementation is such a controller. The logic to perform a binding is in a package independent of the controller lifecycle. A conformant implementation could just as easily be implemented in a CLI or other client that applies bound workloads to the cluster.
Some of the rollout behavior is specific to how the reference implementation works, we can document it there. We should also add docs about the reference implementation to the website.


displaylink cask broken

Apparently the download page changed, because the file I've downloaded is /Library/Caches/Homebrew/displaylink-2.3.php.
According to the cask, it's trying to download:
  url 'http://www.displaylink.com/support/file.php',
      :data => {
        'file' => "DisplayLink_Mac_#{version}.dmg",
        'folder' => 'publicsoftware'
      },
      :using => :post

But it looks like they've changed their download page to pull from:
  url 'http://www.displaylink.com/downloads/file.php',
      :data => {
        'file' => "DisplayLink_OSX_#{version}.dmg",
        'folder' => 'publicsoftware',
        'id' => '420'
      },
      :using => :post

Additionally the version has been bumped up to version 2.4 from 2.3. I don't have the new sha handy or I would put that here as well.

I was able to get the Cask to work locally by making the changes above, bumping the version to 2.4 and using the sha e3972ca00836c5a7ae03f85f0e43b7069673b3f3d9d30d6c68175ea077045637

Also got it working but it seems that you were one step ahead of me and also solved the issue by yourself. Well done. The fix however already was submitted in PR https://github.com/caskroom/homebrew-cask/pull/13433.


Expanded unit test examples in docs, especially for mocking the io libraries

Is your feature request related to a problem? Please describe.
Unit testing in DE is notoriously hard due to the number of cloud systems that need to be mocked (especially for exports). It's frustrating trying to figure out how to do unit testing within Mage's framework in relation to a number of external services (S3, BigQuery, Snowflake, etc...)
Describe the solution you'd like
Expanded examples of unit testing in the docs, especially for exporters and loaders (as those most often require mocking external services)
Describe alternatives you've considered
ChatGPT, StackOverflow, PyTest documentation
Additional context
https://mageai.slack.com/archives/C03HTTWFEKE/p1708625970983899

Yes, we doing this!!!

@wangxiaoyou1993 asked me to add the issue here.

Yes, because VCs like to count issues... as a sign of product adoption lol

Don't tempt me. Your backlog will explode


Initial load for Elastic APM telemetry component.

For reviewers: please confirm the component and its test are according to the Liquid Framework patterns.

Requested changes are done. Waiting for confirmation there is all right.

We're approving this Pull Request.
We will create the new pipeline to build, run tests and publish this new component to Nuget.
We may ask for more changes if the build process shows any problem.


Redis Connection to localhost:6379 Failed

I'm new Express, and just created a basic app and trying to integrate the Redis cache for Express from npm
When I install and add the module in the app, and run the appp it gives the error described on the screenshot.

Express Ver:   4.14.0

Are you running the Redis server on the same machine?
You can download it from https://redis.io/download

@bsyk
Sorry for a very late reply, but that solved my problem.

It would be great to suppress the crash if Redis is not started or installed, per this issue:  https://github.com/rv-kip/express-redis-cache/issues/84.  I tried wrapping the route() call in a try/catch but still it crashes the app if not available at startup.

@ZaeemR please close this issue


Different colors for different irc nicks

Hello
Can you give each user who types a different color? would be easier for readability.
Thanks

Are you talking about coloring the whole IRC message? Different nicks are already given different colors. If coloring the whole message is what you're talking about I think I originally decided against that because it resulted in a less readable and more intrusive result in the end.

I was talking about the nick name on the discord side. I will try to update then.

I don't think Discord supports colors in messages?

that I am not sure. I will attempt to look into as well.

Looking at https://discordapp.com/developers/docs/resources/channel messages support color apparently.
Between Timestamp and footer.

That's for embed objects.

This seems not doable at present, then, since I don't think using embed objects for each message would be a very useful step to take here? If people care about it sufficiently then we can probably reopen this at a later stage.

"ircNickColor": false, // Gives usernames a color in IRC for better readability (on by default)
Does this mean that the default (on) is false? Would someone please provide a screenshot for what coloured nicknames look like? Is it the name of the bot that changes or the nicknames themselves? I can't seem to see any differences in HexChat or AndChat. Thanks.