mmmagic does not install on v0.10.36 and v0.12.9

These are old versions of node I know, but I'm not in the position to update the software.
The readme says v0.10.0 or newer, but this doesn't seem to be the case.
output
[ozette@localhost dir]$ npm install --save mmmagic
npm http GET https://registry.npmjs.org/mmmagic
npm http 304 https://registry.npmjs.org/mmmagic
npm http GET https://registry.npmjs.org/nan
npm http 304 https://registry.npmjs.org/nan

><EMAIL_ADDRESS>install /home/ozette/node_modules/mmmagic
> node-gyp rebuild

make: Entering directory '/home/magissa/experimental/spudu/node_modules/mmmagic/build'
  CC(target) Release/obj.target/libmagic/deps/libmagic/src/apprentice.o
  CC(target) Release/obj.target/libmagic/deps/libmagic/src/apptype.o
  CC(target) Release/obj.target/libmagic/deps/libmagic/src/ascmagic.o
  CC(target) Release/obj.target/libmagic/deps/libmagic/src/cdf.o
  CC(target) Release/obj.target/libmagic/deps/libmagic/src/cdf_time.o
  CC(target) Release/obj.target/libmagic/deps/libmagic/src/compress.o
  CC(target) Release/obj.target/libmagic/deps/libmagic/src/der.o
  CC(target) Release/obj.target/libmagic/deps/libmagic/src/encoding.o
  CC(target) Release/obj.target/libmagic/deps/libmagic/src/fsmagic.o
  CC(target) Release/obj.target/libmagic/deps/libmagic/src/funcs.o
  CC(target) Release/obj.target/libmagic/deps/libmagic/src/is_tar.o
  CC(target) Release/obj.target/libmagic/deps/libmagic/src/magic.o
  CC(target) Release/obj.target/libmagic/deps/libmagic/src/print.o
  CC(target) Release/obj.target/libmagic/deps/libmagic/src/readcdf.o
  CC(target) Release/obj.target/libmagic/deps/libmagic/src/readelf.o
  CC(target) Release/obj.target/libmagic/deps/libmagic/src/softmagic.o
  CC(target) Release/obj.target/libmagic/deps/libmagic/src/fmtcheck.o
  CC(target) Release/obj.target/libmagic/deps/libmagic/src/strlcat.o
  CC(target) Release/obj.target/libmagic/deps/libmagic/src/strlcpy.o
  AR(target) Release/obj.target/deps/libmagic/magic.a
  COPY Release/magic.a
  CC(target) Release/obj.target/libpcre/deps/libmagic/pcre/pcre_byte_order.o
  CC(target) Release/obj.target/libpcre/deps/libmagic/pcre/pcre_chartables.o
  CC(target) Release/obj.target/libpcre/deps/libmagic/pcre/pcre_compile.o
../deps/libmagic/pcre/pcre_compile.c: In function ‘add_to_class’:
../deps/libmagic/pcre/pcre_compile.c:3479:28: warning: ‘od’ may be used uninitialized in this function [-Wmaybe-uninitialized]
       else if (oc >= start && od <= end) continue;
                            ^
  CC(target) Release/obj.target/libpcre/deps/libmagic/pcre/pcre_config.o
  CC(target) Release/obj.target/libpcre/deps/libmagic/pcre/pcre_dfa_exec.o
  CC(target) Release/obj.target/libpcre/deps/libmagic/pcre/pcre_exec.o
  CC(target) Release/obj.target/libpcre/deps/libmagic/pcre/pcre_fullinfo.o
  CC(target) Release/obj.target/libpcre/deps/libmagic/pcre/pcre_get.o
  CC(target) Release/obj.target/libpcre/deps/libmagic/pcre/pcre_globals.o
  CC(target) Release/obj.target/libpcre/deps/libmagic/pcre/pcre_jit_compile.o
  CC(target) Release/obj.target/libpcre/deps/libmagic/pcre/pcre_maketables.o
  CC(target) Release/obj.target/libpcre/deps/libmagic/pcre/pcre_newline.o
  CC(target) Release/obj.target/libpcre/deps/libmagic/pcre/pcre_ord2utf8.o
  CC(target) Release/obj.target/libpcre/deps/libmagic/pcre/pcre_refcount.o
  CC(target) Release/obj.target/libpcre/deps/libmagic/pcre/pcre_string_utils.o
  CC(target) Release/obj.target/libpcre/deps/libmagic/pcre/pcre_study.o
  CC(target) Release/obj.target/libpcre/deps/libmagic/pcre/pcre_tables.o
  CC(target) Release/obj.target/libpcre/deps/libmagic/pcre/pcre_ucd.o
  CC(target) Release/obj.target/libpcre/deps/libmagic/pcre/pcre_valid_utf8.o
  CC(target) Release/obj.target/libpcre/deps/libmagic/pcre/pcre_version.o
  CC(target) Release/obj.target/libpcre/deps/libmagic/pcre/pcre_xclass.o
  CC(target) Release/obj.target/libpcre/deps/libmagic/pcre/pcreposix.o
  AR(target) Release/obj.target/deps/libmagic/pcre/pcre.a
  COPY Release/pcre.a
  CXX(target) Release/obj.target/magic/src/binding.o
In file included from ../src/binding.cc:3:0:
../node_modules/nan/nan.h:328:47: error: ‘REPLACE_INVALID_UTF8’ is not a member of ‘v8::String’
   static const unsigned kReplaceInvalidUtf8 = v8::String::REPLACE_INVALID_UTF8;
                                               ^
magic.target.mk:103: recipe for target 'Release/obj.target/magic/src/binding.o' failed
make: *** [Release/obj.target/magic/src/binding.o] Error 1
make: Leaving directory '/home/ozette/node_modules/mmmagic/build'
gyp ERR! build error
gyp ERR! stack Error: `make` failed with exit code: 2
gyp ERR! stack     at ChildProcess.onExit (/usr/lib/node_modules/node-gyp/lib/build.js:267:23)
gyp ERR! stack     at ChildProcess.emit (events.js:98:17)
gyp ERR! stack     at Process.ChildProcess._handle.onexit (child_process.js:820:12)
gyp ERR! System Linux 4.1.13-100.fc21.x86_64
gyp ERR! command "node" "/usr/lib/node_modules/npm/node_modules/node-gyp/bin/node-gyp.js" "rebuild"
gyp ERR! cwd /home/ozette/node_modules/mmmagic
gyp ERR! node -v v0.10.36
gyp ERR! node-gyp -v v0.10.6
gyp ERR! not ok
npm ERR! weird error 1
npm ERR! not ok code 0

How did you install node? If you have to stay on v0.10, you should at least try installing the latest v0.10 release (v0.10.44 as of this writing) and retry the install. Otherwise if you do not strictly need v0.10, you should install a newer, more modern version of node.

I installed node through my package manager (yum) on fedora 21 (EOL). GCC version 4.9.2.
v0.10.36 seems to be the latest packaged version of node for this EOL fedora version, so i can't update thorugh yum, but I installed nvm which allowed me to get the latest stable node version.

My guess is that Fedora did not apply this patch to their external copy of v8 since they build with a shared, system copy of v8 instead of using what's bundled with node.
I'm glad to hear you found a solution though!


Using sort_by with a grouped data frame doesn't respect nils: option

While working with grouped data, I ran across what I believe is an issue. Grouped data doesn't appear to respect the option given to nils:
with_nil = DF.new(%{
  id: [1,1,1,2,2,2,3,3,3],
  data: [0.5, 1, nil, 0.7, 1, 0.9, 0.2, 0.2, 0.3]
})

DF.sort_by(with_nil, data, nils: :first) # works as you would expect

DF.group_by(with_nil, :id)
|> DF.sort_by(data, nils: :last) # nil value is still in the first position

Is this expected behavior, or something worth digging into further?

Yeah, it is a bug. I implemented a fix for that. Thanks for reporting!


Equirectangular cameras

Congrats on the awesome integration, it works great!
I wanted to ask if you plan to implement rendering with an equirectangular camera, I saw that it is present but it doesn't work, I also noticed that the FOV seems to be a bit buggy, you have to click on render view and viewport to update the setting.

Hi, the problem about the FoV is inherited from upstream NeRFStudio, so I recommend you submit an issue here.
About the equirectangular camera support, I will check it later.

Hi Zhensheng, did you have time to take a look at the equirectangular cameras?

Hi
i tested the equirectangular mode but without any success

I don't know if it whether the source images are in TIFF...

tried to modify that part of the script https://github.com/nerfstudio-project/nerfstudio/blob/main/nerfstudio/process_data/equirect_utils.py
and adding tif image management but still

and also


App get crashed on Heroku

Anyone know what is the correct way to deploy on Heroku?
My package.json looks like and idk what could be the reason cause locally my app builds correctly
{
   "build": "npm run gen:contentlayer && next build",
   "gen:contentlayer": "contentlayer build --config ./contentlayer.config.ts --verbose",
   "start": "next start -p $PORT",
}

Could you please provide more information which errors you're seeing? Ideally both error logs and a little video demo of the problem.

My error was that I had next-contentlayer as dev-dependency


Fix all typos I found in this repo.

Signed-off-by: Aaron.L.Xu<EMAIL_ADDRESS>

LGTM
Thanks!


pgcluu not graphing correctly data retrieved from pgbouncer 1.8+

Since version 1.8 of pgbouncer, the command 'show stats' changed output. Some fields have been added, others renamed. Therefore graphs coming out of pgcluu are not showing out as expected (pgbouncer queries duration and queries per second)
pgbouncer, 'SHOW STATS'
old output:
----------------------------------
database         | pgbouncer
total_requests   | 1
total_received   | 0
total_sent       | 0
total_query_time | 0
avg_req          | 0
avg_recv         | 0
avg_sent         | 0
avg_query        | 0
----------------------------------

new output:
----------------------------------
database          | pgbouncer
total_xact_count  | 20389
total_query_count | 20389
total_received    | 0
total_sent        | 0
total_xact_time   | 0
total_query_time  | 0
total_wait_time   | 0
avg_xact_count    | 0
avg_query_count   | 0
avg_recv          | 0
avg_sent          | 0
avg_xact_time     | 0
avg_query_time    | 0
avg_wait_time     | 0
----------------------------------

While i'm using crafted scripts to retrieve pgbouncer data on each backend, I noticed that pgcluu did not update its code since the release. (for the simple reason that the latest release of pgcluu is older than pgbouncer 1.8). (Therefore: cannot validate my changes, since i do not have a testbed)
I believe that this part of pgcluu code should be changed accordingly, in order to satisfy the new/changed fields:
		$all_pgbouncer_req_stats{$data[0]}{$data[1]}{total_requests} += $data[2];
		$all_pgbouncer_req_stats{$data[0]}{$data[1]}{total_received} += $data[3];
		$all_pgbouncer_req_stats{$data[0]}{$data[1]}{total_sent} += $data[4];
		$all_pgbouncer_req_stats{$data[0]}{$data[1]}{total_query_time} += $data[5];
		$all_pgbouncer_req_stats{$data[0]}{$data[1]}{avg_req} += $data[6];
		$all_pgbouncer_req_stats{$data[0]}{$data[1]}{avg_recv} += $data[7];
		$all_pgbouncer_req_stats{$data[0]}{$data[1]}{avg_sent} += $data[8];
		$all_pgbouncer_req_stats{$data[0]}{$data[1]}{avg_query} += $data[9];

as a side note, this is the mapping old-new fields:
total_requests        -> total_query_count
total_received        - > total_received
total_sent              -> total_sent
total_query_time    -> total_query_time
avg_req                 -> avg_query_count
avg_recv               -> avg_recv
avg_sent               -> avg_sent
avg_query_time     -> avg_query_time

Thanks for the report and especially for the mapping it saves me lot of time. Commit afdc0e7 adds the compatibility with pgbouncer 1.8. I have not tried with a live pgbouncer as I'm traveling so let me know if all is working for you.
I see also that there is two new interesting information about wait time, I will add a report to show the time waiting from the server.

Commit 9def072 adds reports about wait statistic, it also fix report on total stats that was not relative to the previous value collected. I finally found time to install pgbouncer 1.8 and test it, all might works as expected.

Good news, thanks for the report.


Use explicit ownership in Args class

Fixes #898

Okay, I am never going to understand clang-tidy. This code had some issues with memory allocations, but those issues were in master as well.
I rebased this branch and now it starts with a rewrite and some bugfixes of the spawn method.


[Bug]  error occurred: getaddrinfo

General

[X] I have updated to the latest version of MySpeed.
[X] My bug has not been reported yet.

The Bug
When I attempt to install myspeed in a docker environment following the guide I receive the following error:
Successfully connected to the database file
Integration "discord" loaded successfully
Integration "gotify" loaded successfully
Integration "healthChecks" loaded successfully
Integration "pushover" loaded successfully
Integration "telegram" loaded successfully
Integration "webhook" loaded successfully
Looking for network interfaces...
An error occurred: getaddrinfo EAI_AGAIN www.speedtest.net
An error occurred: getaddrinfo EAI_AGAIN librespeed.org

Docker info:
Client:
 Version:    25.0.3
 Context:    default
 Debug Mode: false
 Plugins:
  compose: Docker Compose (Docker Inc.)
    Version:  v2.18.1
    Path:     /usr/lib/docker/cli-plugins/docker-compose

Server:
 Containers: 5
  Running: 3
  Paused: 0
  Stopped: 2
 Images: 22
 Server Version: 25.0.3
 Storage Driver: overlay2
  Backing Filesystem: extfs
  Supports d_type: true
  Using metacopy: false
  Native Overlay Diff: true
  userxattr: false
 Logging Driver: json-file
 Cgroup Driver: cgroupfs
 Cgroup Version: 2
 Plugins:
  Volume: local
  Network: bridge host ipvlan macvlan null overlay
  Log: awslogs fluentd gcplogs gelf journald json-file local splunk syslog
 Swarm: inactive
 Runtimes: io.containerd.runc.v2 runc
 Default Runtime: runc
 Init Binary: docker-init
 containerd version:
 runc version:
 init version: de40ad0
 Security Options:
  seccomp
   Profile: builtin
  cgroupns
 Kernel Version: 5.15.150
 Operating System: OpenWrt 23.05.3
 OSType: linux
 Architecture: aarch64
 CPUs: 4
 Total Memory: 3.713GiB
 Name: Scotts_Magick_Box
 ID: 2cfd4953-9f1b-4792-b8bc-0d41ab72460a
 Docker Root Dir: /opt/docker
 Debug Mode: false
 Experimental: false
 Insecure Registries:
  <IP_ADDRESS>/8
 Live Restore Enabled: false

WARNING: No memory limit support
WARNING: No swap limit support

What device are you using to access the page?
In the browser
Which operating system is your MySpeed instance running on?
Linux

Fixed! Thanks for the help.

Same problem.
Whitelisted both domains. Used a prebuilt compose setup from casaos.
Couldn't connect to both domains and no setup possible.


Is there a plan to release the TQA dataset used to train CogVLM2-Video?

as mentioned as title, Is there a plan to release the TQA dataset used to train CogVLM2-Video?

It is possible that this data will be released in the future, but the timing is not guaranteed. You can use CogVLM2-Video to generate your own TQA data.

Is there a video training script?

Is there a video training script?

You can have a try with this fine-tuning code: https://github.com/modelscope/ms-swift/blob/main/docs/source_en/Multi-Modal/cogvlm2-video-best-practice.md


scap automation

https://github.com/PowerShellCrack/STIGSCAPWinTool

Add

[ ] Alt Creds

[ ] Remoting


Use std::thread in LedgerCleaner (RIPD-236).

This pull request removes what I think is the last use of beast::Thread in the code base.  The beast::Thread is replaced with a std::thread and a std::condition_variable.
My intention is that the external functionality is unchanged.
Reviewers: @seelabs, @JoelKatz. David, I need you as a reviewer since the LedgerCleaner is your baby, and I want to make sure I didn't mess something up by accident.

Current coverage is 48.86%

Merging #1377 into develop will decrease coverage by -0.01% as of c1d65e4

@@            develop   #1377   diff @@
=======================================
  Files           957     957
  Stmts         66020   66043    +23
  Branches          0       0
  Methods           0       0
=======================================
+ Hit           32270   32272     +2
  Partial           0       0
- Missed        33750   33771    +21

Review entire Coverage Diff as of c1d65e4

Powered by Codecov. Updated on successful CI builds.

:+1:

Addressed review comments (thanks @vinniefalco ).  Also rebased.

Renamed lambda pleaseExit() to shouldExit().

:+1: (though make sure the circleci failure is spurious)

I gave CircleCI a nudge and it passed the second time.

Removed the commit that moved the notify_one() calls outside the locks.

Rebased and addressed serious concerns identified by @JoelKatz.

:+1:

Merged as fa05ded88ea3d98ff925a16e45d76d646caa0fc9


Corrected misspelled word

Probably the most simplest of PRs lol, however, I couldn't ignore it. 😄

:shipit:

@jekyllbot: merge +minor.
Thanks @mariolopjr! Sorry for the delay in getting this merged.


Make a Filter permanent, for example, only shows persons on a media library card on Homeassisntant

Hi! It's not possible at all to fix a filter configuration, for example, to show a frigate card showing only persons.
Describe the solution you'd like
A yaml card configuration to set up a permanent filter, for example show only persons
Describe alternatives you've considered
An option on GUI to adjust the permanent filter
Additional context
I'd tried in multiple ways to fix a filter configuration in the card by labels.

This is not exactly what you're asking for, but perhaps is satisfactory solution. I searched for filter on the docs page and found:
https://github.com/dermotduffy/frigate-hass-card?tab=readme-ov-file#camera-frigate-configuration
It looks like you can set a limit to what the card shows in the YAML.
cameras:
  - camera_entity: camera.frigate_lorex_01_gate
    dependencies:
      cameras:
        - camera.frigate_lorex_02_turnaround
    frigate:
      labels:
        - person
  - camera_entity: camera.frigate_lorex_02_turnaround

incidentally, the "dependency" entry is one that I learned when looking for a similar solution to my use case of preserving the camera filter which shows two cameras. I ended up making one card for each side of the house which lists a primary camera, and a secondary camera as a dependency. The default view is clips. It shows the clip thumbnails for the two cameras mixed together and sorted by time.

im having this same issue -  For example if I set the frigate card to only show the snapshots media gallery, and then add in 4x cameras,  every-time the card is reloaded, the media filter settings go back to the default (ie of the 1st camera you added , so the other 3x are ignored).  (even making a brand new frigate card,  it keeps going back to just the 1x camera)
if you click the media filter drawer button on the right,  make your settings ,  then the gallery is updated.  but as soon as the page is reloaded it goes back to the default filter settings of just 1x camera.
I think an image can better show what im referring to - i want the snapshots gallery to show all cameras i have setup in the frigate card's settings:
any idea how to fix this (or to force the "Media Gallery" -> "Media Filter" settings in YAML ?)
thanks

@bob454522 did you try the YAML with the dependencies line like in my example above?
I'm pretty sure that makes it show extra cameras upon loading the page. In my use case I have a card that automatically loads 2 cameras into the filter which I believe is what you're looking for.

@patienttruth how about including all zones from all cameras?

[Issues cleanup] As @patienttruth mentions above, this should just work if there are dependencies set up between the cameras. To depend on all cameras, we'd use:
type: custom:frigate-card
cameras:
  - camera_entity: camera.hall_ondu
    dependencies:
      all_cameras: true

If this doesn't do what you are seeking, let me know what is missing? Thanks and good luck!

Please re-open if there is a specific piece of functionality you'd like implemented, and/or file a new issue being as specific as you can! Thanks and good luck.


RealArray append() Issue

Hi,
I am using this the append() method of RealArray when encountered the error:
execution was interrupted reason xc_bad_access (code=exc_i386_invop, subsode=0x0)
The code is in below:
import UIKit
import Upsurge
var n: RealArray = [1.0, 2.0, 3.0, 4.0, 5.0]
n.append(6.0)
Could you help to resolve this issue?  Thanks!

RealArrays are fixed-size. That means that you need to explicitly specify the capacity when you construct it. Try this:
let n = RealArray(capacity: 6)
n.append(1.0)
n.append(2.0)

you can also do this
var n: RealArray = [1.0, 2.0, 3.0, 4.0, 5.0, 0.0]
n.count = 5
n.append(6.0)

I added more info to the Readme file regarding this. Let me know if it helps.

Thanks a lot! It will be very helpful for the people who start to use the Upsurge.


Fix radios and checkboxes description spacing

Will resolve #293

 The space under the answer label and description is reduced when the description wraps on 2 lines. This should be consistent and remain as it is when on one line.


Reintroduce support for the -processor flag

The -processor flag was previously supported by J2ObjC, and seems to have been implemented using a JDT pre-processing step, that was since deprecated, even though CLI documentation still seems to support it.
I've attempted to re-implemented support for it using the existing javac-based pre-processing step, would love to get your feedback on it! (would attach a PR shortly)

PR: #1011

Right, it's just a bug and not a deprecated feature. No one previously noticed because most annotation processor jars have a ServiceLoader definition.

As you probably noticed, all j2objc does is forward annotation flags to its
Java compiler front-end. That used to be the JDT, which was more
complicated and buggy. Now we're using javac, and when converting
accidentally missed this flag.
On Thu, Nov 15, 2018 at 12:23 PM Omer Peleg<EMAIL_ADDRESS>wrote:

Right! Meant that it seemed to have been a result of something that looked
like a JDT deprecation
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/google/j2objc/issues/1010#issuecomment-439177645, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AC2kr8yw5At_YBhimsoaDW0BMxH2AKXjks5uvc1FgaJpZM4Yh8Ra
.

This is now fixed in master


ImportError: No module named 'pandas_plink.bed_reader'

I am encountering a similar problem to one that I believe has come up in the past.
I am using python 3.5.2 and pandas_plink 1.2.25, which was installed with pip.
I have tried this in a clean virtualenv
The full error message:
$ python -c "import pandas_plink; pandas_plink.test()"
=============================================== test session starts ================================================
platform linux -- Python 3.5.2, pytest-3.4.2, py-1.5.2, pluggy-0.6.0
rootdir: /home/user/analysis, inifile:
plugins: pep8-1.0.6
collected 10 items

pandas_plink/__init__.py .                                                                                [ 10%]
pandas_plink/bed_read.py .                                                                                [ 20%]
pandas_plink/builder.py .                                                                                [ 30%]
pandas_plink/conftest.py .                                                                                [ 40%]
pandas_plink/read.py .F

===================================================== FAILURES =====================================================
______________________________________ [doctest] pandas_plink.read.read_plink ______________________________________
056         1     1   rs2949420  0.0  45257  C  T  1
057         2     1   rs2949421  0.0  45413  0  0  2
058         3     1   rs2691310  0.0  46844  A  T  3
059         4     1   rs4030303  0.0  72434  0  G  4
060         >>> print(fam.head()) #doctest: +NORMALIZE_WHITESPACE
061                 fid       iid    father    mother gender trait  i
062         0  Sample_1  Sample_1         0         0      1    -9  0
063         1  Sample_2  Sample_2         0         0      2    -9  1
064         2  Sample_3  Sample_3  Sample_1  Sample_2      2    -9  2
065         >>> print(bed.compute()) #doctest: +NORMALIZE_WHITESPACE
UNEXPECTED EXCEPTION: ImportError("No module named 'pandas_plink.bed_reader'",)
Traceback (most recent call last):

  File "/usr/lib/python3.5/doctest.py", line 1321, in __run
    compileflags, 1), test.globs)

  File "<doctest pandas_plink.read.read_plink[5]>", line 1, in <module>

  File "/home/user/bio/lib/python3.5/site-packages/dask/base.py", line 143, in compute
    (result,) = compute(self, traverse=False, **kwargs)

  File "/home/user/bio/lib/python3.5/site-packages/dask/base.py", line 392, in compute
    results = get(dsk, keys, **kwargs)

  File "/home/user/bio/lib/python3.5/site-packages/dask/threaded.py", line 75, in get
    pack_exception=pack_exception, **kwargs)

  File "/home/user/bio/lib/python3.5/site-packages/dask/local.py", line 521, in get_async
    raise_exception(exc, tb)

  File "/home/user/bio/lib/python3.5/site-packages/dask/compatibility.py", line 67, in reraise
    raise exc

  File "/home/user/bio/lib/python3.5/site-packages/dask/local.py", line 290, in execute_task
    result = _execute_task(task, data)

  File "/home/user/bio/lib/python3.5/site-packages/dask/local.py", line 271, in _execute_task
    return func(*args2)

  File "/home/userl/bio/lib/python3.5/site-packages/pandas_plink/bed_read.py", line 6, in read_bed_chunk
    from .bed_reader import ffi, lib

ImportError: No module named 'pandas_plink.bed_reader'

/home/user/bio/lib/python3.5/site-packages/pandas_plink/read.py:65: UnexpectedException
======================================== 1 failed, 5 passed in 0.14 seconds ========================================

Thanks in advance for any help you may be able to provide

Hi @WillJStone , I just installed pandas-plink using pip in a Linux distribution having python 3.5 and it worked. I wonder if you saw any problem during the pip installation? It looks like the Python sources have been installed by the C extension has not been compiled.

Also, pip install --upgrade pip setuptools might also help.

I have successfully installed it on one of my machines, but it is still not working on the machine it needs to be on. There does not seem to be any issues when it installs, but at this point I figure it's a problem with the state of the machine itself. Thanks for the quick response!

Glad you've solved the problem =)


fix: don't set worse fixedDeltaTime

SteamVR sets the fixedDeltaTime to a worse value than may be manually set in the Time settings in Unity due to HMD refresh being slower than the time specified. If the fixedDeltaTime set by SteamVR would be set to a worse value than is currently chosen, then leave it where it is.

Responding to some old pull requests here. We do this so you can optionally sync the two. If that's not the behavior that makes sense for you application you can change the setting in SteamVR.settings.lockPhysicsUpdateRateToRenderFrequency.


[REACT VERSION] Add preloader screen to all the pages

The react version doesn't have the atom preloader screen for all the pages.

I want to work on this under JWOC


Reduce memory alloc

Before:
➜  workerpool git:(main) ✗ go test -bench . -benchtime=1000x -benchmem
goos: darwin
goarch: amd64
pkg: github.com/zaidsasa/workerpool
cpu: Intel(R) Core(TM) i7-4870HQ CPU @ 2.50GHz
BenchmarkWorkerPool-8               1000             54691 ns/op            2503 B/op        100 allocs/op
PASS
ok      github.com/zaidsasa/workerpool  2.256s

After:
➜  workerpool git:(reduce-memory-alloc) go test -bench . -benchtime=1000x -benchmem
goos: darwin
goarch: amd64
pkg: github.com/zaidsasa/workerpool
cpu: Intel(R) Core(TM) i7-4870HQ CPU @ 2.50GHz
BenchmarkWorkerPool-8               1000             24676 ns/op               9 B/op          0 allocs/op
PASS
ok      github.com/zaidsasa/workerpool  2.232s

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 95.18%. Comparing base (27ed00a) to head (e10afc2).

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files
@@            Coverage Diff             @@
##             main      #11      +/-   ##
==========================================
+ Coverage   93.10%   95.18%   +2.07%
==========================================
  Files           2        3       +1
  Lines          58       83      +25
==========================================
+ Hits           54       79      +25
  Misses          2        2
  Partials        2        2

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Unknown CPI "'Bosh::AzureCloud::AzureError' " error  encountered during Bosh Deployment

During our Bosh deployment in azure we encountered the following error message :
.
Failed: Unknown CPI error 'Bosh::AzureCloud::AzureError' with message 'status: Failed
http code: 200
request id: 2fd005bc-c0fd-496a-bfef-6e65d5e56d73
error:
{"code"=>"InternalExecutionError", "message"=>"An internal execution error occurred."}' (00:01:34)
Error 100: Unknown CPI error 'Bosh::AzureCloud::AzureError' with message 'status: Failed
http code: 200
request id: 2fd005bc-c0fd-496a-bfef-6e65d5e56d73
error:
{"code"=>"InternalExecutionError", "message"=>"An internal execution error occurred."}'
We can provide additional log files in a non public forum.
Thanks!

@cwackro Which CPI version are you using? Could you send the task logs to me<EMAIL_ADDRESS>

@cwackro It is an internal error when Azure internal components failover. After discussing with Azure feature team, CPI should handle this error but not throw this error.
I will create a PR for this.

It is fixed in the commit


Documentation - color example not working

Gemfile.lock: httplog (1.1.0)
When I use the example in the README:
config.color = {color: :black, background: :yellow}

I get the following error:
HTTPLOG CONFIGURATION ERROR: {:color=>:black, :background=>:yellow} is not a valid color

Full initialization:
if Rails.env.development?
  require 'httplog'
  HttpLog.configure do |config|

    # Enable or disable all logging
    config.enabled = true

    # You can assign a different logger
    config.logger = Rails.logger

    # I really wouldn't change this...
    config.severity = Logger::Severity::DEBUG

    # Tweak which parts of the HTTP cycle to log...
    config.log_connect   = true
    config.log_request   = true
    config.log_headers   = false
    config.log_data      = true
    config.log_status    = true
    config.log_response  = true
    config.log_benchmark = true

    # ...or log all request as a single line by setting this to `true`
    config.compact_log = false

    # Prettify the output - see below
    config.color = false

    # Limit logging based on URL patterns
    config.url_whitelist_pattern = /.*/
    config.url_blacklist_pattern = nil
  end
end

Thanks for reporting this. That was actually a bug in the implementation, which only accepted a single color, not the documented color hash. Fixed and released as v1.1.1, please update your gem.


Opensearch dual write

As discussed yesterday, what does the failure path look like? Could we have a failure subchain where failed writes can get either logged, or written to a Kafka queue or something?

My plans for failure retries was to either:

build a Retry transform, where failed messaged would be sent down the chain again for a specified number of times
build the retry functionality into the OpenSearchSink

When the retries fail, I think logging should be sufficient. Logging means that the failed writes to specific documents or indexes could be included in a reindex command after the Shotover dual writing operation is finished even. https://opensearch.org/docs/latest/im-plugin/reindex-data/


Simplest way to get actvations of certain layer during training.

Hello,
I would like to make a picture of the activations of a certain layer during training after every batch.
Let's say I would make a batch_end_callback and then do something and then dump the activations as an image to disk.
What would be the easiest way to go about this ?
Is this even possible ? If not, why not :)

See example/python-howto/monitor_weight

@juliandewit I usually measure the states of the mid-level inputs by inserting a CustomOp that intercept the gradient and activation. Like the following:
import ast
import mxnet as mx

def safe_eval(expr):
    if type(expr) is str:
        return ast.literal_eval(expr)
    else:
        return expr

class IdentityOp(mx.operator.CustomOp):
    def __init__(self, logging_prefix="identity", input_debug=False, grad_debug=False):
        super(IdentityOp, self).__init__()
        self.logging_prefix=logging_prefix
        self.input_debug = input_debug
        self.grad_debug = grad_debug

    def forward(self, is_train, req, in_data, out_data, aux):
        if(self.input_debug):
            logging.debug("%s: in_norm=%f, in_shape=%s"
                          %(self.logging_prefix, np.linalg.norm(in_data[0].asnumpy()), str(in_data[0].shape)))
        self.assign(out_data[0], req[0], in_data[0])

    def backward(self, req, out_grad, in_data, out_data, in_grad, aux):
        if (self.grad_debug):
            logging.debug("%s: grad_norm=%f, grad_shape=%s"
                          % (self.logging_prefix, np.linalg.norm(out_grad[0].asnumpy()), str(out_grad[0].shape)))
        self.assign(in_grad[0], req[0], out_grad[0])

@mx.operator.register("identity")
class IdentityOpProp(mx.operator.CustomOpProp):
    def __init__(self, logging_prefix="identity", input_debug=False, grad_debug=False):
        super(IdentityOpProp, self).__init__(need_top_grad=True)
        self.input_debug = safe_eval(input_debug)
        self.grad_debug = safe_eval(grad_debug)
        self.logging_prefix = str(logging_prefix)

    def list_arguments(self):
        return ['data']

    def list_outputs(self):
        return ['output']

    def infer_shape(self, in_shape):
        data_shape = in_shape[0]
        output_shape = in_shape[0]
        return [data_shape], [output_shape], []

    def create_operator(self, ctx, shapes, dtypes):
        return IdentityOp(input_debug=self.input_debug,
                          grad_debug=self.grad_debug,
                          logging_prefix=self.logging_prefix)

def identity(data, name="identity", logging_prefix=None,
             input_debug=False, grad_debug=False):
    return mx.symbol.Custom(data=data,
                            name=name,
                            logging_prefix=name,
                            input_debug=input_debug,
                            grad_debug=grad_debug,
                            op_type="identity")

We can insert such "identity" operator in the network, like
a = ...
a = identity(a)
b = mx.sym....(a)

You can control the inner behavior of the identity operator, like to print the norm + gradient norm, or saving the activations to the disk.
Another way is to group the activation layer and the final loss function together. Like the following:
mid_level_layer = ...
final_loss = ...mid_level_layer...

out = mx.sym.Group([final_loss, mx.sym.BlockGrad(mid_level_layer)])

We can then use the call_back function to save the second output.

Thank you VERY much for your answers.
As I was afraid it was a bit harder than expected but your solution seems workable.
I was aware of weight monitoring but the 2nd solution seems more appropriate for my specific problem.

Hello @sxjscience , Can you please explain in detail how to call back second output? I am new to MXNet and getting confused with the different approaches available. I have used mx.sym.Group[output_layer, fc_layer]. I would like to get the output of fc_layer which is an intermediate layer to my network.
Please help..


InfluxDBClient: Access to connection parameters

The most of connection parameters (ex: host, port, etc.) are declared private. Instead some others (use_udp and use_port) are public (see below):
self._verify_ssl = verify_ssl
self.use_udp = use_udp
self.udp_port = udp_port
self._session = requests.Session()
Why this difference?

bad consistency I'd say; there is effectively a way to enhance / correct that.

bad consistency I'd say

Yep, there was no specific reason.

Would you prefer host, port, .. to be public or for use_udp and use_port to be private?

I would say host and port to be public

I don't really mind. However moving use_udp to private could break some usage of the lib.

Moved both UDP params to private on #477, this is covered in test cases at the moment.
We should mention this in the new release to ensure smooth transition. If anything, we can add a property for the next release to help, but leave it to you @aviau to decide. Happy to improve where necessary


Adapt permissions to make productpage microservice work as non-root.

Minimal change to demo microservice to make the image also runnable for different users.
See #14667, the new image must still be consumed.

[APPROVALNOTIFIER] This PR is NOT APPROVED
This pull-request has been approved by: c0d1ngm0nk3y
To fully approve this pull request, please assign additional approvers.
We suggest the following additional approver: vadimeisenbergibm
If they are not already assigned, you can assign the PR to them by writing /assign @vadimeisenbergibm in a comment when ready.
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

samples/OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@esnible How to get a new version of this image tagged, so that it can be used in the demo? Currently istio/examples-bookinfo-productpage-v1:1.14.0

@c0d1ngm0nk3y: The following test failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

prow/integ-mixer-k8s-presubmit-tests.sh
fb27a47603e3f825893f225cc5b62c575ba0ff78
link
/test integ-mixer-k8s-presubmit-tests-master

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@frankbu Do you know the answer to https://github.com/istio/istio/pull/14943#issuecomment-503021908 ?

@c0d1ngm0nk3y do we want this to be istio/examples-bookinfo-productpage-v1:1.15.0?

I don't know about the versioning, but the issue is not solved until this is actually consumed. For me, this sounds like a minor adjustment. 1.14.X? If it is available, we can use it in the productpage deployment of the bookinfo.

We always update the version of all bookinfo images together, and we've tend to only update the minor version number, so this should be 1.15.0.
The images need to be built and pushed to dockerhub using this script: https://github.com/istio/istio/blob/master/samples/bookinfo/build_push_update_images.sh

@c0d1ngm0nk3y can you create a separate PR to update the YAMLs once we merge this? I can push the new images once this PR has been merged.

@c0d1ngm0nk3y can you create a separate PR to update the YAMLs once we merge this?

Just let me know...

/test integ-mixer-k8s-presubmit-tests-master

[APPROVALNOTIFIER] This PR is APPROVED
This pull-request has been approved by: c0d1ngm0nk3y, venilnoronha
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

samples/OWNERS [venilnoronha]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[APPROVALNOTIFIER] This PR is APPROVED
This pull-request has been approved by: c0d1ngm0nk3y, venilnoronha
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

samples/OWNERS [venilnoronha]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@c0d1ngm0nk3y: The following test failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

prow/e2e-simpleTests.sh
fb27a47603e3f825893f225cc5b62c575ba0ff78
link
/test e2e-simpleTests-master

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

/test e2e-simpleTests-master

@c0d1ngm0nk3y: The following test failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

prow/e2e-simpleTests.sh
fb27a47603e3f825893f225cc5b62c575ba0ff78
link
/test e2e-simpleTests-master

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@c0d1ngm0nk3y: The following tests failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

prow/e2e-simpleTests.sh
fb27a47603e3f825893f225cc5b62c575ba0ff78
link
/test e2e-simpleTests-master

prow/e2e-bookInfoTests-v1alpha3.sh
fb27a47603e3f825893f225cc5b62c575ba0ff78
link
/test e2e-bookInfoTests-envoyv2-v1alpha3-master

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

/retest

@c0d1ngm0nk3y: The following tests failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

prow/e2e-simpleTests.sh
fb27a47603e3f825893f225cc5b62c575ba0ff78
link
/test e2e-simpleTests-master

prow/e2e-bookInfoTests-v1alpha3.sh
fb27a47603e3f825893f225cc5b62c575ba0ff78
link
/test e2e-bookInfoTests-envoyv2-v1alpha3-master

prow/integ-security-local-presubmit-tests.sh
fb27a47603e3f825893f225cc5b62c575ba0ff78
link
/test integ-security-local-presubmit-tests-master

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@c0d1ngm0nk3y: The following tests failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

prow/e2e-simpleTests.sh
fb27a47603e3f825893f225cc5b62c575ba0ff78
link
/test e2e-simpleTests-master

prow/e2e-bookInfoTests-v1alpha3.sh
fb27a47603e3f825893f225cc5b62c575ba0ff78
link
/test e2e-bookInfoTests-envoyv2-v1alpha3-master

prow/integ-security-local-presubmit-tests.sh
fb27a47603e3f825893f225cc5b62c575ba0ff78
link
/test integ-security-local-presubmit-tests-master

prow/istio-unit-tests.sh
fb27a47603e3f825893f225cc5b62c575ba0ff78
link
/test istio-unit-tests-master

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@c0d1ngm0nk3y: The following tests failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

prow/integ-security-local-presubmit-tests.sh
fb27a47603e3f825893f225cc5b62c575ba0ff78
link
/test integ-security-local-presubmit-tests-master

prow/istio-unit-tests.sh
fb27a47603e3f825893f225cc5b62c575ba0ff78
link
/test istio-unit-tests-master

prow/e2e_pilotv2_auth_sds.sh
fb27a47603e3f825893f225cc5b62c575ba0ff78
link
/test istio_auth_sds_e2e-master

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@c0d1ngm0nk3y: The following tests failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

prow/integ-security-local-presubmit-tests.sh
fb27a47603e3f825893f225cc5b62c575ba0ff78
link
/test integ-security-local-presubmit-tests-master

prow/istio-unit-tests.sh
fb27a47603e3f825893f225cc5b62c575ba0ff78
link
/test istio-unit-tests-master

prow/e2e_pilotv2_auth_sds.sh
fb27a47603e3f825893f225cc5b62c575ba0ff78
link
/test istio_auth_sds_e2e-master

prow/release-test.sh
fb27a47603e3f825893f225cc5b62c575ba0ff78
link
/test release-test-master

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

/retest


Movie Search

movie_input: "Grown Ups"

Title: Grown Ups
Released: 25 Jun 2010
Director: Dennis Dugan
Actors: Adam Sandler, Salma Hayek, Kevin James
Runtime: 102 min
Genre: Comedy
Plot: In 1978, five 12-year-olds win a CYO basketball championship. Thirty years later, they gather with their families for their coach's funeral and a weekend at a house on a lake where they used to party. By now, each is a grownup with problems and challenges: Marcus is alone and drinks too much. Rob, with three daughters he rarely sees, is always deeply in love until he turns on his next ex-wife. Eric is overweight and out of work. Kurt is a househusband, henpecked by wife and mother-in-law. Lenny is a successful Hollywood agent married to a fashion designer with three kids and his two sons take their privilege for granted. Can the outdoors help these grownups rediscover connections or is this chaos in the making?


Tests

Before #14, I should setup some tests. These could include:

Testing PartZero should be easy.
Adding a small problem, that is solved with Ipopt or SCIP (former only needs the julia package, latter needs installation on windows)
Traits of geometries?

Closed by #22


Reduced plague units

Reduced amount of units produced by plague:

Necromancers 2 -> 0
Workers 2 -> 1
Ghoul 5 -> 2
Crypt Fiend 2 -> 2 (unchanged)
Abomination 1-> 2
Increased periodic spawn of zombies 30s -> 60s
Removed many villagers and houses that spawned zombies across the land

Stat changes for partial compensation:
Zombie:

Health 450->550
Attack base 20->24
Attack speed 2.7->2.6

Crypt Fiend

Health 750 -> 850
Attack base 25 -> 30
Attack speed 1.8 -> 1.7 cd

Ghoul

Attack base 11->13

@vampirika We discussed completely removing the periodic Zombie spawns and all of the villager mechanics, which I can do. Does that affect what you've done here negatively?

@YakaryBovine Oh okay might have missed that, thought we were just reducing it. Not particularly, although might want to give back a bit of strength on the spawns but we can add adjust that in later when we see what impact no zombies actually has.


feat(sdk): show cycle end date if plan change is not immediate

Pull Request Test Coverage Report for Build<PHONE_NUMBER>
Details

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 9.329%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
9543

Relevant Lines:
102296

💛  - Coveralls


Minor UI updates to point users towards alternative wallets

Goals
Improve the discoverability of alternative wallets

Decrease the vertical height of the A new era for new wallets.. section such that a user does not have to scroll to see part of the following section Decentralization means strength in numbers.

Under wallet.near.org has been discontinued. Explore a range of user-friendly wallets designed to meet your needs. Replace the Learn More button with a Discover Wallet button that is an anchor link to the section Find the right wallet for you.

Thank you for the great suggestions, @charleslavon.
Assigning to @nall-near for his thoughts.

Hey @charleslavon! I'll start with some context:
Original Ticket
Figma Link
This page has two states and serves two main purposes. There is a version to 1) transfer connected accounts if a user is still connected to wallet.near, and 2) a version when no accounts are connected, focused on discoverability vs transferring. It also serves to 1) inform users of the change + reason for the change to wallet.near (some users might come back after a long time) and 2) help users find a new wallet to manage their accounts.
Feedback on your requests:
Header: I chose this template based on some other pages floating around near.org, do you have a different one we could use that makes the rest of the page more discoverable, or should we just customize this one? I'm cool with updating this however you want, just strive for consistency :)
CTA to Discover Wallets: Great suggestion, had that in an earlier version actually. I'd like to keep learn more since the main header copy is about the transition, but I'll add a primary CTA to scroll to the wallets section.

Additional thoughts:

Should we direct users to ALL the wallets listed here? The wallets on this page reflect what is transfer-capable.
The compare wallets button takes users to a spreadsheet with an exhaustive list of features, maybe one day we could embed this content directly on our site (some old ideas here)
At a certain point, we should update this page even further away from "where is NEAR wallet?" content.

@nall-near  https://near.org/ecosystem is an example of a header image that is slightly smaller vertically, revealing a different style of content below without requiring a scroll.

listed here

I like that suggestion, perhaps we include a link to All Ecosystem Wallets someone on our wallet.near.org page.

@charleslavon I think this ticket it closed after speaking w/ @calebjacob, reviewing the figma and wallet.near.org
This pr 3128 seems to have handled the work

hey @jackson-harris-iii there is still design work to be implemented here.

For users with no existing wallet connection, when visiting wallet.near.org the Transfer Accounts button should be Explore Wallets which scrolls down to the Find the right wallet for you. section
The height on the initial view of wallet.near.org should be decreased such that it is similar to https://near.org/ecosystem which makes visible a portion of distinct color of the content below the header without requiring the user to scroll.

Closed by: https://github.com/near/near-wallet/pull/3136


Provide SORT BY functionality for facet-based query refinement

Codecov Report

Merging #203 into mudrod-117 will increase coverage by 0.04%.
The diff coverage is 23.62%.

@@               Coverage Diff               @@
##             mudrod-117    #203      +/-   ##
===============================================
+ Coverage          1.68%   1.72%   +0.04%
- Complexity           17      28      +11
===============================================
  Files                79      79
  Lines              5163    5035     -128
  Branches            688     637      -51
===============================================
  Hits                 87      87
+ Misses             5064    4936     -128
  Partials             12      12


Error cant download videos from udemy(ERROR: Unable to extract course id)

ERROR: Unable to extract course id; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
How can i solve this problem.... my SO(windows).

why


multiple pack errors in adding simple custom blocks page

in the page adding simple custom block, there are errors with the resource and behavior packs
when creating this pack, reaching the point where it says test it for yourself, the pack dose not show up. going to global resources it says in behavior packs "Unable to parse pack manifest with stack: * Line 4, Column 1
Missing '}' or object member name"
Along with a very similar thing with the resource pack, but in the form of an update report in the file. I did find changing the resource pack manifest min_engine_version from [ 1, 19, 20 ] to [ 1, 19, 50] did make it no longer send an update report.
As such I tried the same tactic for the behavior pack, which still never received an update report; only the error waring in global recourses, but to no avail.
also note that at the beginning of the page it has you download the "vanilla resource pack" which all it dose is take you to the samples, and then later says if you have downloaded the resources, referring to a custom block samples, I know not if its referring to the code shown on the article or an actual pack that you once had access to.
also also, I want to make a mob that you have to build, much unto like the iron, snow golem, or the wither, but noting in the samples or articles says how that is done. along with adding blocks to vanilla samples as it would be useful to look at the examples, especially for stuff like be hives and how they interact with campfires as that is something similar I want to make.
thank you for your time and enjoy your day!

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 63bccc5e-a22b-a564-c0af-bcc0d4ebbe2a
Version Independent ID: 63bccc5e-a22b-a564-c0af-bcc0d4ebbe2a
Content: How to Add a Simple Custom Block
Content Source: creator/Documents/AddCustomDieBlock.md
Product: gaming
GitHub Login: @mammerla
Microsoft Alias: v-jimseaman

im not sure what lead me to this, why it works, or whatever,


Integrate with Factory Boy? Or other solution?

Mostly for the purposes of testing and example generation, I would like to see Pandera's schema.example function to incorporate patterns similar to Factory Boy:

Instead of building an exhaustive test setup with every possible combination of corner cases, factory_boy allows you to use objects customized for the current test, while only declaring the test-specific fields:

While this might seem at first like this is a less-thorough version of what Hypothesis does, the bolded part above (emphasis mine) outlines the functionality I am looking for -- the ability to further constrain properties of a DataFrame in a manner appropriate for testing.  While conceivably I can create a new schema with further restrictions, this seems like it would get quickly out of hand, and does not incorporate the advantages offered by Factory Boy's pattern
Here's what the author of Hypothesis has to say about using Hypothesis with Factory Boy:

Both Factory Boy and Hypothesis are designed along a “we’re a library, not a framework” approach.  Further, factory boy is set up to take arbitrary values, Hypothesis is set up to provide them, so you can easily feed the latter into the former. For example, the following defines a strategy that uses a factory boy UserFactory object to parametrize over unsaved user objects with an arbitrary first name:

class TestUser(TestCase):
    @given(builds(UserFactory.build, first_name=text(max_length=50)))
    def test_can_save_a_user(self, user):
        user.save()

essentially I would like to see UserFactory.build replaced with schema.example.  It might be feasible to allow example to take extra kwargs that may then set values for dataframe columns and indexes.
As is, I've had to resort to constructing my factories without Pandera -- my DF has a lot of columns, and thus I had to deal with a lot of code duplication that could have easily been handled by the schema.
If there is an existing pattern that allows for overriding of fields during example generation (preferably without needing to modify the schema), please let me know!

hi @schlich, thanks for opening up this discussion.
Before going ay further, are you aware of the strategy method? Calling it basically creates a hypothesis strategy object that generates data. In line with what hypothesis recommends, example isn't the recommended way of synthesizing data, it's basically for debugging (example just wraps strategy). Here's an example of using the strategy method.
I understand the gist of what you're going for, though I'm still a little unclear an integration would look like. Since DataFrameSchema.strategy outputs a hypothesis strategy object, you can further constrain it with hypothesis, and even use it with Factory Boy  in your own test methods.
It also might help to provide a small reproducible code snippet of illustrating (a) the problem and what you're currently doing to solve it and (b) your ideal solution.

If there is an existing pattern that allows for overriding of fields during example generation (preferably without needing to modify the schema), please let me know!

Something like this would work:
import pandera as pa
from pandera.typing import Series

class Schema(pa.SchemaModel):
    column1: Series[int]
    column2: Series[float]
    column3: Series[str]

strategy = Schema.strategy(size=5)

# replace column1 with 100s
new_strategy = strategy.map(lambda df: df.assign(column1=100))
print(new_strategy.example())

# use new_strategy in tests, etc.

I think the problem might come with the complexity of my dataframes -- i have upwards of 20 columns/index levels, many with dependencies on each other.  I began trying to approach my problem with strategies but not only did the strategies end up being very complex (for example, there is no existing check that multiindex rows are unique, or a check to guarantee that each element from a list of choices appears at least once, among other things), but the strategies were prohibitively expensive for my TDD workflow, taking up to 30 seconds for each test, even after reducing the number of examples (reducing the size to about 5-10 worked fine, but that seems to defeat the purpose of hypothesis).  Since simple is better than complex, i got frustrated and ditched the strategies for the factory boy approach.
I would much rather be able to unit-test by example and integration test by strategy.  Happy to be proven wrong, but i need my test runs to be quick!

Thanks for continuing the discussion @schlich!
One thing I want to emphasize is that pandera's data synthesis capabilities are still in the early days, but there is one constraint that I think is important to preserve: the symmetry between defining a schema and generating data directly from the constraints defined in the schema itself. Of course the user can always decide to adapt a DataFrameSchema.strategy, but I think there are a couple of things here to make the UX better using pandera.

i have upwards of 20 columns/index levels, many with dependencies on each other

Yeah, unfortunately pandera doesn't really lend itself to generating data with a lot of interdependencies between columns. There is this issue #371, but specifics haven't been figured out yet. Will need to think about how to do that. If you don't mind, could you expand on what kinds of dependencies you rely on? It would be helpful to inform the solution for #371.

for example, there is no existing check that multiindex rows are unique

After #390 is implemented, adding this functionality to strategies would be pretty straightforward

or a check to guarantee that each element from a list of choices appears at least once

I think that could be implemented as a built-in Check (with an associated strategy), since isin doesn't guarantee this.
I also wanted to point you to the extensions module that leets you register checks into the pa.Check namespace. It still doesn't get at conditional dependencies, but it would allow you to implement the above check.

but the strategies were prohibitively expensive for my TDD workflow, taking up to 30 seconds for each test, even after reducing the number of examples (reducing the size to about 5-10 worked fine, but that seems to defeat the purpose of hypothesis)

how many samples do you need for your tests to be meaningful?

Since simple is better than complex, i got frustrated and ditched the strategies for the factory boy approach.

I wouldn't be opposed to a factory boy integration, I think we can further optimize the functionality (and API) of the hypothesis integration and see how far we can get.

As a side note, I've been using the dataframe checks for dependencies between columns. You can add your own using the extensions API as @cosmicBboy said.
That said, I think there's a fundamental mismatch between the bottom-up and filter approach that pandera takes and the top-down approach that would be required to generate dataframes with complex dependencies efficiently. That's not a bad thing, it optimization for the simpler, but by far the most common case.
I wonder if we could abstract out the current strategy implementation as one high-level approach, but allow users to replace that with their own top-level dataframe strategy if they want? This proposed FactoryBoy integration could be implemented as a coarse-grained sampling strategy. Was that what you were thinking in #371?

As a side note, I've been using the dataframe checks for dependencies between columns. You can add your own using the extensions API as @cosmicBboy said.

Yes, I'm trying to see i can accomplish what i need to with the "group" options in the checks (the documentation here could use a little bit of a facelift IMO) but my guess is it will only take me about 50% of the way there... stay tuned!

great discussion!
okay, there are a few points that were brought up here worth decomposing:

the schema constraints should only provide a default data synthesis strategy that is potentially inefficient for more complex use cases.
for those complex use cases, there should be an elegant way for users to "bring their own strategy" at multiple levels of the pandera API.

the current extensions API only provides customization at the Check level
we might consider adding a strategy kwarg to the schema and schema_component objects, e.g. DataFrameSchema and Column, which will override the default strategy provided by pandera, where the user is expected to implement all of the data generation logic to fulfill the constraints in the schema.

native support for conditional checks: there has been some discussion of this but the details are a little challenging to figure out because conditional checks need to (i) be well-designed for both the object- and class-based APIs (ii) have a reasonable implementation with respect to data synthesis strategies.

Yes, I'm trying to see i can accomplish what i need to with the "group" options in the checks (the documentation here could use a little bit of a facelift IMO)

Yes, the groupby check options are not ideal, and I'm working on some updates to make this more intuitive... that said the native support for conditional checks is something that might be generally useful but also for this particular use case.
Re: Factory Boy integration, I think the fact that hypothesis and factory boy seem to play well together according to the post referenced by @schlich  tells me that for now pandera's entrypoint to synthesizing data should stick with the hypothesis nomenclature and semantics (i.e. DataFrameSchema.strategy() and example() methods.

This proposed FactoryBoy integration could be implemented as a coarse-grained sampling strategy. Was that what you were thinking in #371?

Not quite, I think the coarse-grained sampling strategy would be more in line with (2), for #371 I was thinking of native support for conditional checks with a default implementation for the hypothesis strategy. For (2) I'm thinking something like:
import pandera as pa
from hypothesis import builds
from hypothesis.strategies import SearchStrategy
from factories import SomeFactory

# takes one argument, which is the schema object that this strategies is applied to
# and returns a hypothesis strategy
def custom_strategy(schema: pa.DataFrameSchema) -> SearchStrategy:
    return builds(SomeFactory.build, ...)

schema = pa.DataFrameSchema(
    ...,
    strategy=custom_strategy
)

strategy = schema.strategy()  # to use in test suite
example = schema.example()  # to generate examples on the fly for debugging


Disable default-features everywhere

Description
Avoids forcing features users don't use on by accident.
Motivation and Context

How Has This Been Tested?

Types of changes

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

[ ] My change requires a change to the documentation.
[ ] I have updated the documentation accordingly.
[ ] I have read the CONTRIBUTING document.
[ ] I have added tests to cover my changes.
[ ] All new and existing tests passed.

Looks good! LGTM.

Although, tide-core doesn't really have any feature, nor do I think we'd have any by virtue of keeping it to absolute minimum. Do we need it for tide-core?

Hmm, I probably could remove that, I added it before the last core refactor that removed the http-service-hyper dependency.


Pick an SBOM format

Emitting a well-known SBOM format is a lower priority, but it's something we specified in the proposal.
Two good options are SPDX and CycloneDX; we should determine:

Which one(s) have good, maintained Python APIs
Which one(s) have community adoption

Related: here's CycloneDX's (official?) Python module: https://github.com/CycloneDX/cyclonedx-python

There's also https://github.com/CycloneDX/cyclonedx-python-lib which is a reusable library containing the model and serializations to JSON and XML.  https://github.com/CycloneDX/cyclonedx-python builds on top of the python library.
Let us know if you have any questions implementing CycloneDX. There's a vibrant community of adopters and implementors in the project Slack workspace.

Thanks for linking those!

Based on the current maturity of the Python SPDX ecosystem, I'm inclined to say that we should go with CycloneDX for now. We'll probably want to use cyclonedx-python-lib directly, rather than the cyclonedx-python tool.
Some braindump notes:

The Bom model is the heart of the library -- we'll want to construct one, either from a "parser" (it looks like they support a sub/superset of our dependency sources directly), or manually by visiting each entry in an abstract dependency source. The latter might be more reliable, since some of their parsers (e.g. the requirements ones) won't function fully unless every dependency is pinned.

Closing so that we can formally unblock #77.


fix(swagger): synchronize enum with defined error constants

Discovered this discrepancy during a failed signin request, with my experimental swagger validation branch.

Closing this to open as a new PR, to test out the CODEOWNERS change.


runtime: fatal error: MSpanList_Insert stack trace on go get

Please answer these questions before submitting your issue. Thanks!
What version of Go are you using (go version)?
1.7.3 (UPDATE: installed from brew)
What operating system and processor architecture are you using (go env)?

What did you expect to see?
I was expecting to be able to setup common tools like
What did you see instead?
failed MSpanList_Insert 0x47bd10 0x189339c26f5e9 0x0 0x0
fatal error: MSpanList_Insert

runtime stack:
runtime.throw(0x2a3340, 0x10)
	/usr/local/go/src/runtime/panic.go:530 +0x90
runtime.(*mSpanList).insert(0x3a58a8, 0x47bd10)
	/usr/local/go/src/runtime/mheap.go:933 +0x293
runtime.(*mheap).freeSpanLocked(0x3a50a0, 0x47bd10, 0x100, 0x0)
	/usr/local/go/src/runtime/mheap.go:809 +0x4be
runtime.(*mheap).grow(0x3a50a0, 0x8, 0x0)
	/usr/local/go/src/runtime/mheap.go:675 +0x2a0
runtime.(*mheap).allocSpanLocked(0x3a50a0, 0x1, 0x47bc98)
	/usr/local/go/src/runtime/mheap.go:553 +0x4e3
runtime.(*mheap).alloc_m(0x3a50a0, 0x1, 0x1e, 0x47bca8)
	/usr/local/go/src/runtime/mheap.go:437 +0x119
runtime.(*mheap).alloc.func1()
	/usr/local/go/src/runtime/mheap.go:502 +0x41
runtime.systemstack(0xc820043e58)
	/usr/local/go/src/runtime/asm_amd64.s:307 +0xab
runtime.(*mheap).alloc(0x3a50a0, 0x1, 0x1000000001e, 0xeedf)
	/usr/local/go/src/runtime/mheap.go:503 +0x63
runtime.(*mcentral).grow(0x3a7090, 0x0)
	/usr/local/go/src/runtime/mcentral.go:209 +0x93
runtime.(*mcentral).cacheSpan(0x3a7090, 0xc800000000)
	/usr/local/go/src/runtime/mcentral.go:89 +0x47d
runtime.(*mcache).refill(0x400960, 0xc80000001e, 0xc82566b608)
	/usr/local/go/src/runtime/mcache.go:119 +0xcc
runtime.mallocgc.func2()
	/usr/local/go/src/runtime/malloc.go:642 +0x2b
runtime.systemstack(0xc820020000)
	/usr/local/go/src/runtime/asm_amd64.s:291 +0x79
runtime.mstart()
	/usr/local/go/src/runtime/proc.go:1048

goroutine 1 [running]:
runtime.systemstack_switch()
	/usr/local/go/src/runtime/asm_amd64.s:245 fp=0xc82566b190 sp=0xc82566b188
runtime.mallocgc(0x380, 0x1e8be0, 0xc800000000, 0x0)
	/usr/local/go/src/runtime/malloc.go:643 +0x869 fp=0xc82566b268 sp=0xc82566b190
runtime.newobject(0x1e8be0, 0x0)
	/usr/local/go/src/runtime/malloc.go:781 +0x42 fp=0xc82566b290 sp=0xc82566b268
cmd/link/internal/ld.writelines()
	/usr/local/go/src/cmd/link/internal/ld/dwarf.go:1651 +0xefc fp=0xc82566b648 sp=0xc82566b290
cmd/link/internal/ld.Dwarfemitdebugsections()
	/usr/local/go/src/cmd/link/internal/ld/dwarf.go:2108 +0xa59 fp=0xc82566b830 sp=0xc82566b648
cmd/link/internal/amd64.asmb()
	/usr/local/go/src/cmd/link/internal/amd64/asm.go:663 +0x8bb fp=0xc82566b9c0 sp=0xc82566b830
cmd/link/internal/ld.Ldmain()
	/usr/local/go/src/cmd/link/internal/ld/pobj.go:248 +0x1f5d fp=0xc82566be40 sp=0xc82566b9c0
cmd/link/internal/amd64.Main()
	/usr/local/go/src/cmd/link/internal/amd64/obj.go:44 +0x19 fp=0xc82566be48 sp=0xc82566be40
main.main()
	/usr/local/go/src/cmd/link/main.go:27 +0x36f fp=0xc82566bf20 sp=0xc82566be48
runtime.main()
	/usr/local/go/src/runtime/proc.go:188 +0x2b0 fp=0xc82566bf70 sp=0xc82566bf20
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1998 +0x1 fp=0xc82566bf78 sp=0xc82566bf70

Some runs will fail if retried with a similar stack in other tool, until it is able to go through all the tools without errors after some retries like godef, dlv and x/tools; others will keep failing (like gb)

CC @aclements @RLH

I was unable to reproduce this on linux/amd64.

failed MSpanList_Insert 0x47bd10 0x189339c26f5e9 0x0 0x0

This is really weird. In order this is: span, span.next, span.prev, span.list. But the span pointer looks too low (maybe Darwin mmaps really low?), span.next is clearly nonsense, and span.next should really never be non-nil and span.list is nil.
@donrudo, could you paste a few more failures? I want to look for patterns.  This does appear to be memory corruption, similar to #16570.
@donrudo, thanks for the logs. Digging into this more, it looks like Darwin does in fact allocate mspans from very low addresses, so the low span pointer is not a surprise. But if the span.next pointer were actually pointing to a span, it would also be a low value. That means this is almost certainly memory corruption. This is odd, because the mspans are in a very "stable" region of memory compared to the heap (once an mspan is allocated, it never gets freed, so the memory is type-stable) and are nowhere near the Go heap, so a bad heap pointer is unlikely to cause this. They are, however, close to the data segment (global variables) and intermingled with some runtime-internal data structures.
Also supporting the memory corruption theory is that one of your logs (xtools-5.log) shows a crash following a pointer in workbuf structure.
Also interesting is that the bad span.next value does look like a pointer (it's a "largish" 64-bit number, so it's probably not an int, and it's clearly not byte data). They're also all in roughly the same region: 0x[78]xxxxxxxxxx (even the workbuf crash has a pointer in this region if you undo the lfstack mangling). However, this isn't a Go pointer of any sort; it's nowhere near low enough to point to text, data, or runtime structures, and it doesn't have the right pattern to be a heap or heap bitmap pointer.

Also interesting is that the bad span.next value does look like a pointer

It's not a pointer. It's nanoseconds since roughly 2016-10-25T15:15 UTC. I have no idea what the significance of that epoch is, but the progression of the span.next values in the panics correlates precisely with mtimes of your log files.

/cc @quentinmit. Random timestamp values corrupting memory on Darwin. Sounds right up your alley. :)

Are you absolutely sure that the go tool you are running is one built from 1.7.3?  Because this is what I would expect to see when running an earlier version of the go tool on Sierra.  For example, what does go version print?

This is exactly consistent with using a Go version <1.7. "Nanoseconds since roughly 2016-10-25T15:15" sounds like the value of mach_absolute_time. Sierra started writing the value of mach_absolute_time into *rdx, which prior to 1.7 contained garbage. Now we put 0 there.
@donrudo You said that you are running 1.7.3 from brew, but I noticed that your logs are using GOROOT=/usr/local/go. That's where our .pkg installer places go; do you happen to have an older Go installed there, and it's shadowing the Go 1.7.3 from brew on your $PATH?
Maybe try running something like
which -a go
go version

to confirm that it's really 1.7.3.

@quentinmit is right, after running his commands I saw this:
Code/templates » which -a go
go version
/usr/local/bin/go
/usr/local/go/bin/go
go version go1.7.3 darwin/amd64

the second /usr/local/go/bin/go, the same as my $GOROOT pointed to an old 1.6.1 setup.
After fixing the $GOROOT to make it point to the correct brew install ( /usr/local/Cellar/go/1.7.3/libexec ) all the libraries were able to be correctly built.
sorry for making you lose your time with this.


Rename ExtensionPointConfig to CreateExtensionPointOption on the backend-plugin-api package

PR: https://github.com/backstage/backstage/pull/24911


More Searxng warnings

Here are other errors that I am seeing in the searxng container. I am guessing they can be ignored, but wanted to check with you.
2024-05-11 21:51:36,045 WARNING:searx.engines.internetarchivescholar: ErrorContext('searx/search/processors/online.py', 116, "response = req(params['url'], **request_args)", 'httpx.HTTPStatusError', None, ('400', 'Bad Request', 'scholar.archive.org')) False
2024-05-11 21:51:36,045 ERROR:searx.engines.internetarchivescholar: requests exception (search duration : 1.4337322499995935 s, timeout: 15.0 s) : Client error '400 Bad Request' for url 'https://scholar.archive.org/search?q=what+are+the+effects+of+newspaper+closures&limit=15&offset=0'
For more information check: https://httpstatuses.com/400
Traceback (most recent call last):
  File "/usr/local/searxng/searx/search/processors/online.py", line 163, in search
    search_results = self._search_basic(query, params)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/searxng/searx/search/processors/online.py", line 147, in _search_basic
    response = self._send_http_request(params)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/searxng/searx/search/processors/online.py", line 116, in _send_http_request
    response = req(params['url'], **request_args)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/searxng/searx/network/__init__.py", line 164, in get
    return request('get', url, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/searxng/searx/network/__init__.py", line 95, in request
    return future.result(timeout)
           ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/concurrent/futures/_base.py", line 456, in result
    return self.__get_result()
           ^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/concurrent/futures/_base.py", line 401, in __get_result
    raise self._exception
  File "/usr/local/searxng/searx/network/network.py", line 289, in request
    return await self.call_client(False, method, url, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/searxng/searx/network/network.py", line 285, in call_client
    raise e
  File "/usr/local/searxng/searx/network/network.py", line 272, in call_client
    return Network.patch_response(response, do_raise_for_httperror)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/searxng/searx/network/network.py", line 245, in patch_response
    raise_for_httperror(response)
  File "/usr/local/searxng/searx/network/raise_for_httperror.py", line 77, in raise_for_httperror
    resp.raise_for_status()
  File "/usr/lib/python3.11/site-packages/httpx/_models.py", line 749, in raise_for_status
    raise HTTPStatusError(message, request=request, response=self)
httpx.HTTPStatusError: Client error '400 Bad Request' for url 'https://scholar.archive.org/search?q=what+are+the+effects+of+newspaper+closures&limit=15&offset=0'
For more information check: https://httpstatuses.com/400
2024-05-11 21:57:27,024 WARNING:searx.engines.internetarchivescholar: ErrorContext('searx/search/processors/online.py', 116, "response = req(params['url'], **request_args)", 'httpx.HTTPStatusError', None, ('400', 'Bad Request', 'scholar.archive.org')) False
2024-05-11 21:57:27,024 ERROR:searx.engines.internetarchivescholar: requests exception (search duration : 0.3081536669997149 s, timeout: 15.0 s) : Client error '400 Bad Request' for url 'https://scholar.archive.org/search?q=what+are+the+effects+of+newspaper+closures&limit=15&offset=0'
For more information check: https://httpstatuses.com/400
Traceback (most recent call last):
  File "/usr/local/searxng/searx/search/processors/online.py", line 163, in search
    search_results = self._search_basic(query, params)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/searxng/searx/search/processors/online.py", line 147, in _search_basic
    response = self._send_http_request(params)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/searxng/searx/search/processors/online.py", line 116, in _send_http_request
    response = req(params['url'], **request_args)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/searxng/searx/network/__init__.py", line 164, in get
    return request('get', url, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/searxng/searx/network/__init__.py", line 95, in request
    return future.result(timeout)
           ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/concurrent/futures/_base.py", line 456, in result
    return self.__get_result()
           ^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/concurrent/futures/_base.py", line 401, in __get_result
    raise self._exception
  File "/usr/local/searxng/searx/network/network.py", line 289, in request
    return await self.call_client(False, method, url, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/searxng/searx/network/network.py", line 285, in call_client
    raise e
  File "/usr/local/searxng/searx/network/network.py", line 272, in call_client
    return Network.patch_response(response, do_raise_for_httperror)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/searxng/searx/network/network.py", line 245, in patch_response
    raise_for_httperror(response)
  File "/usr/local/searxng/searx/network/raise_for_httperror.py", line 77, in raise_for_httperror
    resp.raise_for_status()
  File "/usr/lib/python3.11/site-packages/httpx/_models.py", line 749, in raise_for_status
    raise HTTPStatusError(message, request=request, response=self)
httpx.HTTPStatusError: Client error '400 Bad Request' for url 'https://scholar.archive.org/search?q=what+are+the+effects+of+newspaper+closures&limit=15&offset=0'
For more information check: https://httpstatuses.com/400

The Docker image used by SearXNG is the official image. If it works properly, may be you can ignore them :).

See a simple docker compose - https://github.com/ItzCrazyKns/Perplexica/blob/master/docker-compose.yaml


X86 algorithm does not generate same outputs as X64 algorithm

With the same seed, the two algorithms do not generate the same hashes given the same input. Is this expected?
// Example
var murmur86 = MurmurHash.Create128(0, true, AlgorithmPreference.X86);
var murmur64 = MurmurHash.Create128(0, true, AlgorithmPreference.X64);
byte[] data = Guid.NewGuid().ToByteArray();

// Assert fails
Assert.Equal(murmur86.ComputeHash(data), murmur64.ComputeHash(data));

I ran into this on accident because the default argument, AlgorithmPreference.Auto picks based on bitness of the application. I was generating hashes from two different applications against the same data store. One of those applications happened to be 32bit and the other 64.

As far as i know, yes, but i may be wrong. The values I use to verify my implementation in MurmurHash.Specs come from main.cpp from the original C++ source code, and there is a different value for X86 and X64.

Alright, good to know. Might be worth mentioning in the readme.md. Given this, it's not super great to auto flip between two hashes that yield different results.


[ARM Tags] incorrect status code 202 at /{scope}/providers/Microsoft.Resources/tags/default

PATCH /{scope}/providers/Microsoft.Resources/tags/default on CRP Disk fails with status code 202
(tried with api-version 2021-04-01 and 2021-01-01, same response)
Same call on virtual machine scope and network interface scope is both good.
swagger (it only allow 200)
https://github.com/Azure/azure-rest-api-specs/blob/3ef4bf9/specification/resources/resource-manager/Microsoft.Resources/stable/2021-04-01/resources.json#L4376-L4413
Disk ID: /subscriptions/ec0aa5f7-9e78-40c9-85cd-535c6305b380/resourceGroups/rg-weidxu1/providers/Microsoft.Compute/disks/vm1weidxu_OsDisk_1_fb00d73bec2642cdbe361cea58cb1a8c
request
PATCH https://management.azure.com//subscriptions/ec0aa5f7-9e78-40c9-85cd-535c6305b380/resourceGroups/rg-weidxu1/providers/Microsoft.Compute/disks/vm1weidxu_OsDisk_1_fb00d73bec2642cdbe361cea58cb1a8c/providers/Microsoft.Resources/tags/default?api-version=2021-04-01
Try count: 1
Date:Wed, 17 Aug 2022 02:05:33 GMT
Authorization:REDACTED
Content-Length:63
x-ms-return-client-request-id:true
Content-Type:application/json
x-ms-client-request-id:dbb5edf2-04b3-4a32-abfb-76e5b33ab6e5
Accept:application/json
User-Agent:azsdk-java-com.azure.resourcemanager.resources/2.18.0-beta.1 (17.0.1; Windows 11; 10.0)
63-byte body:
{
  "operation" : "Replace",
  "properties" : {
    "tags" : {
      "key1" : "value1"
    }
  }
}

response (the response looks like an LRO)
202 https://management.azure.com//subscriptions/ec0aa5f7-9e78-40c9-85cd-535c6305b380/resourceGroups/rg-weidxu1/providers/Microsoft.Compute/disks/vm1weidxu_OsDisk_1_fb00d73bec2642cdbe361cea58cb1a8c/providers/Microsoft.Resources/tags/default?api-version=2021-04-01 (2678 ms, 0-byte body)
Cache-Control:no-cache
Pragma:no-cache
Expires:-1
Location:https://management.azure.com/subscriptions/ec0aa5f7-9e78-40c9-85cd-535c6305b380/providers/Microsoft.Compute/locations/westus3/DiskOperations/b8e53ae7-41a5-48c3-adee-d6c2d10bd877?p=ddefb9cd-2984-4659-bea2-89a23e6a6130&monitor=true&api-version=2021-08-01
x-ms-ratelimit-remaining-subscription-writes:1196
x-ms-request-id:23295eb7-60b7-44db-b682-b6bda94f0155
x-ms-correlation-request-id:23295eb7-60b7-44db-b682-b6bda94f0155
x-ms-routing-request-id:SOUTHEASTASIA:20220817T020543Z:23295eb7-60b7-44db-b682-b6bda94f0155
Strict-Transport-Security:max-age=31536000; includeSubDomains
X-Content-Type-Options:nosniff
Date:Wed, 17 Aug 2022 02:05:42 GMT
content-length:0

Hi Team, any update on the above issue?

@rthorn17 would you let us know if we should check with ARM for solution, or we should check with CRP if this request is handled by them under the hood?

Same issue https://github.com/Azure/azure-sdk-for-net/issues/30245#issuecomment-1220060795

@Drewm3 for awareness as well, as I assume the tag operation finally get to the PATCH on disk resource.

Removing the CXP attention label since Service team is already involved in this thread.

ref https://github.com/Azure/azure-rest-api-specs/pull/20494


Update Git Cheatsheet

add commands for git stash
update some formatting to escape angle brackets and add new lines

hey @animenon thanks for the merge! did you mean the spaces that seemed to change into a different kind of space? i think my text editor converted the non-breaking spaces to normal spaces automatically... i can revert them if necessary :)

@m4t1ld4 few of the git commands are shown in the second column instead of the third, could you fix this?


Allow interpolate of stack_name into docker_compose files

Using the rancher or rancher-compose or the UI you can launch a catalog entry into a stack, within the docker-compose definition you can have affinity labels.
To be able to properly use the affinity labels certain variables should be available by default.

stack_name
service_name
host_name

Closing since #3393 and #4478 pretty much cover this. host_name isn't possible since a service could be rescheduled on a different host. Please reopen if you disagree!


Add files via upload

Updating wwdr.pem file to latest

Can this PR be merged so that latest wwdr is in use while creating apple pass


Size exceed during training

gmm_k = MultivariateNormal(model_mus[k].double().to(device=self.device), model_covs[k].double().to(device=self.device))
IndexError: index 4 is out of bounds for dimension 0 with size 4
Hi,I would like to know why the size exceeds the problem when the algorithm changes the number of clusters k during training. How can I solve this problem? thank you very much.

@CHUANG-L In the last update of the code this bug has been fixed. Please let us know if it persists!


Unable to download external templates when portainer is behind a forward proxy.

Description
Unable to download external templates when portainer is behind a forward proxy.

Steps to reproduce the issue:

Deploy portainer behind a corporate network. And outgoing traffic need to be authenticated first.
You will get a "Failure: Unable to retrieve templates" error.
And there is no place to configure these settings in the "Settings" section.

Any other info e.g. Why do you consider this to be a bug? What did you expect to happen instead?

Yeah, thanks very much and this is what I know that I can achieve, but passwords may expire after a certain time. Still tend to request for such a setting in Web UI so that it can be masked and updated. What do you think?

I'm thinking that this is part of your Docker setup and should not be integrated in Portainer. You should either manage to do it using the *_proxy env vars as specified by @WTFKr0 or you can host the templates next to Portainer (http://portainer.readthedocs.io/en/stable/templates.html#build-and-host-your-own-templates) and then update Portainer settings to point at these templates.
@ncresswell what's your view on this?

Authenticating proxy servers are quite common in corp environments, so my pref is that we add this support into the UI.


IN-453 remove generate query

Purpose
Created a new generate_select_string_from_mapping method that does not rely directly on the Mapping class.
Applied this where possible, but it doesn't work on tables that have transformed columns. This will be next as it gets complicated

This is a bit of a mess, brb


fix: imports/exports/require with template literal tokens

[x] There is an associated issue in the Backlog milestone (required)
[x] Code is up-to-date with the master branch
[x] You've successfully run gulp runtests locally
[x] There are new or updated unit tests validating the change

Fixes #33680
Complements #36143
Related to #30878

This needs to be closed since import a from mod isn't valid syntax per ecma standards as pointed in #29318


Local model experiment

Added local model support. Still need to add unit tests but wanted to make sure the PR is in.
Example using 7b/ggml-vicuna-7b-1.1-q4_0.bin vs. 13b/ggml-vic13b-uncensored-q4_0.bin:

@steventkrawczyk sorry for tagging in comment, can't seem to tag for review


ENH: linalg: Add LAPACK wrapper for tgexc.

Reference issue
Refs #10881
What does this implement/fix?
Adds an interface to tgexc which I needed to sort my generalized Schur form (tgsen can't be used to actually properly sort it, just split it into two blocks).

Thanks for taking the time to contribute and my apologies that no-one seems to have looked at this yet.
Given that your changes look correct and most of the tests are passing I've decided to re-run the failing test suites to check if they pass - otherwise I'll take another look through and see if I can find the error.

Thanks for taking the time to contribute and my apologies that no-one seems to have looked at this yet.
Given that your changes look correct and most of the tests are passing I've decided to re-run the failing test suites to check if they pass - otherwise I'll take another look through and see if I can find the error.

Thanks for looking at the pull request.
Note that the first commit I pushed (that I replaced with the forced push) seems to have passed all tests, and the only difference with the current commit is the usage of assert_allclose instead of assert_almost_equal. The tests already fail during the build, however, so this should not be the cause of the test failure.

Thanks for looking at the pull request.
Note that the first commit I pushed (that I replaced with the forced push) seems to have passed all tests, and the only difference with the current commit is the usage of assert_allclose instead of assert_almost_equal. The tests already fail during the build, however, so this should not be the cause of the test failure.

The macOS test seems to fail because it cannot find a Fortran compiler for the build - so this isn't related to any of your changes. I'm not that familiar with the build system, or I'm not quite sure how to fix this and why it's not occurring for any other builds perhaps @rgommers could take a look / suggest someone who is more familiar with this part?

The macOS test seems to fail because it cannot find a Fortran compiler for the build - so this isn't related to any of your changes. I'm not that familiar with the build system, or I'm not quite sure how to fix this and why it's not occurring for any other builds perhaps @rgommers could take a look / suggest someone who is more familiar with this part?

That failure is unrelated to this PR, it's gh-13257 which was fixed after the last time CI here was run. I suggest to just ignore it, no need to re-run.

That failure is unrelated to this PR, it's gh-13257 which was fixed after the last time CI here was run. I suggest to just ignore it, no need to re-run.

@Kai-Striega I'll leave it to you to merge this PR if you're happy.

@Kai-Striega I'll leave it to you to merge this PR if you're happy.

Changes look good to me, and all the relevant tests pass - so I'm happy to merge. Thanks @Sbte for taking the time to contribute

Changes look good to me, and all the relevant tests pass - so I'm happy to merge. Thanks @Sbte for taking the time to contribute

Ah too late to comment thanks @Sbte for your time. There are a few very minor things to touch but I'll clean them up in a separate PR. Would you be willing to review it too?

Ah too late to comment thanks @Sbte for your time. There are a few very minor things to touch but I'll clean them up in a separate PR. Would you be willing to review it too?

Sure, I'd be happy to see what could have been improved.

Sure, I'd be happy to see what could have been improved.

Thanks ilayn. I'd be happy to review it and see what I could have done better 👍

Thanks ilayn. I'd be happy to review it and see what I could have done better 👍

@ilayn I seem to also need trsen and trexc, but I'll wait for your pull request before I create a pull request for those functions.

@ilayn I seem to also need trsen and trexc, but I'll wait for your pull request before I create a pull request for those functions.

yes nothing much is needed just a few things such as the removal of ++ business because that turned out to be an annoyance in the long run and some MAX(1, shape(a, 0)) for lda-like vars.  I'll send asap a PR


fix: add missing 'resolve-from' dep to examples/nextjs

:tada: This PR is included in version 3.3.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Add a rolling restart to a service

Would be great if we had "Rolling Restart" as well here:

My use-case is quite simple: we have a docker container that grabs the latest code bundle from S3 and we can update the app simply by restarting the container. So if we had a rolling restart which would wait until say, a healthcheck passes, we could update the entire cluster without taking it down. Not a big deal right now as we can do it manually, but could be useful for large clusters.

Coming soon... https://github.com/rancher/rancher/issues/1079

Ah nice, sorry for duplicates. I've been heavily using rancher for a couple of weeks.

@Kelindar Please follow #1079 to get updates.


Bearer Authorization header change prefix

What is your question?
A clear and concise description of what you are wanting to ask. Ex. I'm always frustrated when [...]
Is there any way to use a bearer authorization header with another prefix? I want to change my prefix to Token {apiKey} instead of Bearer {apiKey}. How can I do that? If it is possible if not please fix this.
What is the context?
If applicable, describe the context in which you are asking the question. Ex. I am trying to do x with y [...]
I'm trying to change Bearer {apiKey} in the Authorization-header to Token {apiKey}

Which authentication mode do you use?
You can change the Header prefix of OAuth2 authentication in Advanced Options using HEADER PREFIX input.

If you are using the Bearer Token mode, there is a PREFIX input to change the prefix.

I'm trying to add it in the .yml. I'm using designer not the core version.

It looks like the OpenAPI 3.0 standard uses Bearer as the prefix without any official syntax to alter the prefix, as per the documentation.
If changing the prefix is officially supported in OpenAPI then I'm sure it's something we can cater for. If not, some more discussions/thought needed here.

Is there a way to do the same thing like bearer authentication but then with apiKey, I have seen some things about template variable inside apiKey authorization header, but for some reason, the Insomnia Designer doesn't detect template.

Is there a way to do the same thing like bearer authentication but then with apiKey, I have seen some things about template variable inside apiKey authorization header, but for some reason, the Insomnia Designer doesn't detect template.

OpenAPI 3.0 does allow setting up an API Token with a custom header name but does not allow setting values (see OpenAPI 3.0 API Keys Documentation)
You would have to use Template Variables within the debug tab of Designer to set the Token {value} once your requests are generated

Closing since the original request is a limitation of the OpenAPI 3.0 specification


can not compile project with es5 library on Windows

Checkout https://github.com/Microsoft/vscode/commit/51108dd846bd1c7b7ec11d771e9e112aaaf2f69a
gulp watch-extension:json-client
Works on Linux and & Mac, fails on Windows:
Error: D:/work/3/s/extensions/json/client/src/jsonMain.ts(85,13): Cannot find name 'Promise'.

@jrieken FYI


Add gateway channel to the portal

Furthermore, it mocks out the structs that are sent to the gateway for different events and a first stubbed out registration logic.

@conectado Was looking pretty good -- just FYI. Was just getting around to reviewing now (sorry!)

@jamilbk don't worry! it wasn't ready for review(tests not passing) and I forgot to put it back to draft. I plan to open another PR with these changes. (or maybe 2 for easier reviewing)


Ensure compatibility with Lambda 3.10 runtime (botocore, urllib issue)

Describe the bug
The awswrangler lambda layer Version 3.4.1 pulls in urllib==2.0.7.
However urllib>=2 is not compatible with botocore==1.29.90 that is pre-installed in the AWS Lambda Runtime.
This leads to the error message: "ImportError: cannot import name 'DEFAULT_CIPHERS' from 'urllib3.util.ssl_'"
You need to either require botocore>1.29.123 OR urllib<2.
Reference: https://github.com/boto/botocore/pull/2924
How to Reproduce
Add the awswrangler lambda layer to a Lambda Function with the 3.10 runtime.
Expected behavior
The lambda function can be loaded
Your project
No response
Screenshots
No response
OS
Linux
Python version
3.10
AWS SDK for pandas version
3.4.1
Additional context
No response

Hi @FredStober thanks for opening this! Older OpenSSL in AL2 might not allow us to upgrade but Iet me give it a try. Otherwise will pin urllib3<2. Please use 3.4.0 layers in the meantime.


PHP 7.2 . Symphony Warning: Use of undefined constant IMAGE_UPLOAD_NAME - assumed 'IMAGE_UPLOAD_NAME' (this will throw an Error in a future version of PHP)

PHP 7.2
Deprecated: idn_to_utf8(): INTL_IDNA_VARIANT_2003 is deprecated in /Users/xxx/Sites/xxx/symphony/lib/boot/defines.php on line 218
Symphony Warning: Use of undefined constant IMAGE_UPLOAD_NAME - assumed 'IMAGE_UPLOAD_NAME' (this will throw an Error in a future version of PHP)
An error occurred in /Users/xxx/Sites/xxx/extensions/image_upload/extension.driver.php around line 5

Can this be released?


add panstarrs entry

Paging @rlwastro for review. I want to confirm:

[ ] This is an adequate summary of PS1. AWS listings are generally 2-3 sentences (see e.g. https://registry.opendata.aws/hst/) so we don't need to be too verbose here.
[ ] The licensing is weird to me. I guess as a member of the PS1 consortium we can release our share of the data to the public as we see fit? Feel free to correct this as needed
[ ] My inclination is to link to a NB showing how to use PS1 data, even if it doesn't use AWS, since it's better than nothing. At a later date, we can work on writing a NB that takes advantage of the cloud to do something interesting

Tagging @sshen-stsci for visibility


[mupx] [nginx] 502 Bad Gateway on Mailgun Webhook

We´re having some issues and we´re not quite sure if it´s nginx/mupx or iron router server side routes.
Our setup:
Mailgun receives a incoming email and triggers a webhook on our server which we stripped down to the bare minimum:
Router.route("/webhooks/mailgun", {where: 'server'}).post ->
  console.log "*** /webhooks/mailgun"

Then, our server trows this error: (no console.log):
[rentkitbeta.cloudapp.net] Error: request aborted
[rentkitbeta.cloudapp.net]     at makeError (/bundle/bundle/programs/server/npm/iron_router/node_modules/body-parser/node_modules/raw-body/index.js:154:15)
[rentkitbeta.cloudapp.net]     at IncomingMessage.onAborted (/bundle/bundle/programs/server/npm/iron_router/node_modules/body-parser/node_modules/raw-body/index.js:252:10)
[rentkitbeta.cloudapp.net]     at IncomingMessage.emit (events.js:92:17)
[rentkitbeta.cloudapp.net]     at abortIncoming (http.js:1916:11)
[rentkitbeta.cloudapp.net]     at Socket.serverSocketCloseListener (http.js:1928:5)
[rentkitbeta.cloudapp.net]     at Socket.emit (events.js:117:20)
[rentkitbeta.cloudapp.net]     at TCP.close (net.js:466:12)

And Mailgun reports a "502 Bad Gateway" error on the webhook and schedules it to try again.
One noteable thing is a maybe 30-60 second lag from Mailgun getting the message to the Error being thrown, maybe pointing towards some sort of timeout / missing data.
We assume that nginx somehow fails but are not quite sure on how to debug it...

More specifically: The content type: "multipart/mixed; boundary="------------020601070403020003080006"" seems to work, multipart/alternative; boundary="001a11343832b64b18051bf42125" seem to break.

Pretty sure at this point that it´s an Iron Router issue...