Error running SpecJBB test

Hi @johnjmar
Can you let me know if you've run into this error with iBM Java (that you've in-built into your benchmarking suite) ?
root@ubuntu:/home/ubuntu/op-benchmark-recipes/standard-benchmarks/Java/SPEC-jbb2015/18-06-14_174600# cat controller.log
Error: A JNI error has occurred, please check your installation and try again
Exception in thread "main" java.lang.NoClassDefFoundError: joptsimple.HelpFormatter
at java.lang.J9VMInternals.prepareClassImpl(Native Method)
at java.lang.J9VMInternals.prepare(J9VMInternals.java:291)
at java.lang.Class.getMethod(Class.java:1216)
at sun.launcher.LauncherHelper.validateMainClass(LauncherHelper.java:556)
at sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:538)
Caused by: java.lang.ClassNotFoundException: joptsimple.HelpFormatter
at java.net.URLClassLoader.findClass(URLClassLoader.java:607)
at java.lang.ClassLoader.loadClassHelper(ClassLoader.java:850)
at java.lang.ClassLoader.loadClass(ClassLoader.java:829)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:325)
at java.lang.ClassLoader.loadClass(ClassLoader.java:809)
... 5 more

I'm using the inbuilt IBM Java
16.04.4  OS 4.13 kernel

Hey Adi,
You will need to check the SPECjbb2015 kit that you are using. If it has been copied from an Intel install , it may have some X86 run-time dependencies and give this JNI error. The install should be on a Power system using the SPEC installer.

This is a Dual 22 core Power9 system ( 3.3 GHz - 3.8 GHz)

IC_Master_error.zip
Please find attached log

Hi Adi, the zip file is empty for some reason.

Hi Adi,
Please try with the latest IBMJDK build from: https://developer.ibm.com/javasdk/downloads/sdk8/ ... "ibm-java-ppc64le-sdk-8.0-5.17" or "ibm-java-ppc64le-jre-8.0-5.17.bin"
Please send a new zip of the run folder or have a look at the log files in the run folder to check for glaring errors (18*/*log)

specjbb_failure_new_java.zip
Hi @Tom-Tran i tried the recent Java and the test still didn't run , albeit its a different signature error. I actually can't find the error explicitly since the test seems to have failed "quietly"

System config:
Proc0: 22 core Power9 (SMT4 config)
Proc1: 22 core Power9 (SMT4 config)
root@ubuntu:/home/ubuntu/SPEC-jbb2015# lscpu
Architecture:        ppc64le
Byte Order:          Little Endian
CPU(s):              176
On-line CPU(s) list: 0-175
Thread(s) per core:  4
Core(s) per socket:  22
Socket(s):           2
NUMA node(s):        2
Model:               2.2 (pvr 004e 1202)
Model name:          POWER9, altivec supported
CPU max MHz:         3800.0000
CPU min MHz:         2300.0000
L1d cache:           32K
L1i cache:           32K
L2 cache:            512K
L3 cache:            10240K
NUMA node0 CPU(s):   0-87
NUMA node8 CPU(s):   88-175
root@ubuntu:/home/ubuntu/SPEC-jbb2015# lshw -short
H/W path         Device     Class      Description
                        system     ZAIUS_FX_08 (ingrasys,zaius)

/0                          bus        Motherboard
/0/1                        processor  02CY069
/0/12                       processor  02CY069
/0/2                        memory     256GiB System memory
/0/2/0                      memory     16GiB RDIMM DDR4 2666 MHz (0.4ns)
/0/2/1                      memory     16GiB RDIMM DDR4 2666 MHz (0.4ns)
/0/2/2                      memory     16GiB RDIMM DDR4 2666 MHz (0.4ns)
/0/2/3                      memory     16GiB RDIMM DDR4 2666 MHz (0.4ns)
/0/2/4                      memory     16GiB RDIMM DDR4 2666 MHz (0.4ns)
/0/2/5                      memory     16GiB RDIMM DDR4 2666 MHz (0.4ns)
/0/2/6                      memory     16GiB RDIMM DDR4 2666 MHz (0.4ns)
/0/2/7                      memory     16GiB RDIMM DDR4 2666 MHz (0.4ns)
/0/2/8                      memory     16GiB RDIMM DDR4 2666 MHz (0.4ns)
/0/2/9                      memory     16GiB RDIMM DDR4 2666 MHz (0.4ns)
/0/2/a                      memory     16GiB RDIMM DDR4 2666 MHz (0.4ns)
/0/2/b                      memory     16GiB RDIMM DDR4 2666 MHz (0.4ns)
/0/2/c                      memory     16GiB RDIMM DDR4 2666 MHz (0.4ns)
/0/2/d                      memory     16GiB RDIMM DDR4 2666 MHz (0.4ns)
/0/2/e                      memory     16GiB RDIMM DDR4 2666 MHz (0.4ns)
/0/2/f                      memory     16GiB RDIMM DDR4 2666 MHz (0.4ns)
/0/3                        generic    bmc-firmware-version
/0/5                        generic    buildroot
/0/6                        generic    capp-ucode
/0/7                        generic    hcode
/0/8                        generic    hostboot
/0/9                        generic    hostboot-binaries
/0/a                        generic    linux
/0/b                        generic    machine-xml
/0/c                        generic    occ
/0/d                        generic    petitboot
/0/e                        generic    sbe
/0/f                        generic    skiboot
/0/10                       generic    version
/0/100                      bridge     IBM
/0/101                      bridge     IBM
/0/102                      bridge     IBM
/0/102/0                    storage    88SE9235 PCIe 2.0 x2 4-port SATA 6 Gb/s Controller
/0/103                      bridge     IBM
/0/104                      bridge     IBM
/0/105                      bridge     IBM
/0/105/0                    storage    MegaRAID Tri-Mode SAS3516
/0/106                      bridge     IBM
/0/106/0                    bus        uPD720201 USB 3.0 Host Controller
/0/106/0/0       usb1       bus        xHCI Host Controller
/0/106/0/0/1                bus        General Purpose USB Hub
/0/106/0/1       usb2       bus        xHCI Host Controller
/0/107                      bridge     IBM
/0/108                      bridge     IBM
/0/108/0         enP52p1s0  network    NetXtreme BCM5719 Gigabit Ethernet PCIe
/0/0                        bridge     IBM
/0/0/0                      bridge     AST1150 PCI-to-PCI Bridge
/0/0/0/0                    display    ASPEED Graphics Family
/0/11            scsi2      storage
/0/11/0.0.0      /dev/sda   disk       80GB INTEL SSDSCKHB08
/0/11/0.0.0/0    /dev/sda   disk       80GB
/0/11/0.0.0/0/1  /dev/sda1  volume     7167KiB EFI partition
/0/11/0.0.0/0/2  /dev/sda2  volume     74GiB EXT4 volume

Hi Adi,
I have reviewed the run folder. The main issue is stemming from the run script: run_multi.sh.ibmjdk_829_20C_2S_2grp_63GB.sh
There are a lot of old Java options that should not be used. We will be updating this repo very soon with the latest recipe. Apologies for the inconvenience.
In the run script, please replace the Java options for the controller, TXI and BE with the below. Also, replace the Java execution command for the controller, TXI and BE.
JAVA_OPTS_C="-XX:-RuntimeInstrumentation -Xms1g -Xmx1g -Xmn800m -Xcompressedrefs -XX:-EnableHCR"
JAVA_OPTS_TI="-XX:-RuntimeInstrumentation -Xlp -Xms1000m -Xmx1000m -Xmn700m -Xcompressedrefs -Xtrace:none -Xconcurrentlevel0 -Xaggressive -XX:-EnableHCR"
JAVA_OPTS_BE="-XX:-RuntimeInstrumentation -Xlp -Xms61g -Xmx61g -Xmn59g -Xcompressedrefs -Xtrace:none -Xconcurrentlevel0 -Xaggressive -XX:-EnableHCR"
echo "Start Controller JVM"
$JAVA $JAVA_OPTS_C $SPEC_OPTS_C -jar ../specjbb2015.jar -m MULTICONTROLLER $MODE_ARGS_C 2>controller.log > controller.out &
echo "    Start $TI_NAME"
numactl --physcpubind=${tprocs[gnum]} --membind=${mem[gnum]} $JAVA $JAVA_OPTS_TI $SPEC_OPTS_TI -jar ../specjbb2015.jar -m TXINJECTOR -G=$GROUPID -J=$JVMID $MODE_ARGS_TI > $TI_NAME.log 2>&1 &
echo "    Start $BE_NAME"
numactl --physcpubind=${procs[gnum]} --membind=${mem[gnum]} $JAVA $JAVA_OPTS_BE $SPEC_OPTS_BE -jar ../specjbb2015.jar -m BACKEND -G=$GROUPID -J=$JVMID $MODE_ARGS_BE > $BE_NAME.log 2>&1 &

It seems as though these arguments work. (Test is still in progress) . First time I've gotten IBM java to run on Barreleye G2 Power9 systems.

@Tom-Tran  @johnjmar
Here are the numbers I got from my run . As you can see, they are not the most stellar numbers , you have observed. I think it could be because I ran this test with SMT=0 . With SMT=4 I was running out of memory.
Do you can how I can work around this ? Thanks in advance for the suggestions.
ibm_java_22c_run1.zip

Hi Adi, try reducing the number of memory pages (currently u are allocating 245GB of hugepages):
echo 60000 > /proc/sys/vm/nr_hugepages
Also, check that your hugepages are divided equally on your two sockets:
cat /sys/devices/system/node/node*/hugepages/hugepages-*/nr_hugepages

Hey @Tom-Tran  I realized that I was allocated almost all my memory and reduced it to half. Thanks for confirming that's fine. Started the run now. Hopefully numbers are better with SMT-4
Seems equally divided.
This tuning script is what I got from @basuv . I need to look into new patch / tuning scripts uploaded by @johnjmar . If things still look shitty, hopefully we can arrange a screen share next week to debug. A
Thoroughly appreciate your help in tuning this here.
root@ubuntu:/home/ubuntu/SPEC-jbb2015# cat /sys/devices/system/node/node*/hugepages/hugepages-*/nr_hugepages
0
30000
0
30000

@Tom-Tran
Sorry to bother you on the weekend. Failure again. (OOM)
[ 1156.011862] bash (6599): drop_caches: 3
[ 1173.432188] bash (6890): drop_caches: 3
[ 1204.067523] run_multi.sh.ib (6912): drop_caches: 3
[ 1475.511016] Group2.Backend. invoked oom-killer: gfp_mask=0x15080c0(GFP_KERNEL_ACCOUNT|__GFP_ZERO), nodemask=8, order=0, oom_score_adj=0
[ 1475.511020] Group2.Backend. cpuset=/ mems_allowed=0,8
[ 1475.511026] CPU: 157 PID: 11113 Comm: Group2.Backend. Not tainted 4.15.0-23-generic #25-Ubuntu
[ 1475.511029] Call Trace:
[ 1475.511037] [c000201c3b8b36e0] [c000000000cdeb7c] dump_stack+0xb0/0xf4 (unreliable)
[ 1475.511042] [c000201c3b8b3720] [c0000000002e5b94] dump_header+0x98/0x2f4
[ 1475.511044] [c000201c3b8b37e0] [c0000000002e4c68] oom_kill_process+0x368/0x6c0
[ 1475.511046] [c000201c3b8b38a0] [c0000000002e55ec] out_of_memory+0x2bc/0x710
[ 1475.511050] [c000201c3b8b3940] [c0000000002ed5dc] __alloc_pages_nodemask+0xfbc/0x1070
[ 1475.511056] [c000201c3b8b3b30] [c000000000378e80] alloc_pages_current+0xa0/0x140
[ 1475.511061] [c000201c3b8b3b70] [c00000000006d5dc] pte_fragment_alloc+0xdc/0x1e0
[ 1475.511068] [c000201c3b8b3bc0] [c0000000003a0324] do_huge_pmd_anonymous_page+0x374/0x9d0
[ 1475.511072] [c000201c3b8b3c40] [c00000000033f68c] __handle_mm_fault+0xc6c/0xe10
[ 1475.511074] [c000201c3b8b3d20] [c00000000033f958] handle_mm_fault+0x128/0x210
[ 1475.511076] [c000201c3b8b3d60] [c00000000006a72c] __do_page_fault+0x21c/0xa70
[ 1475.511085] [c000201c3b8b3e30] [c00000000000a634] handle_page_fault+0x18/0x38
[ 1475.511086] Mem-Info:
[ 1475.511093] active_anon:991119 inactive_anon:124 isolated_anon:0
active_file:239 inactive_file:185 isolated_file:0
unevictable:127 dirty:2 writeback:0 unstable:0
slab_reclaimable:2596 slab_unreclaimable:24374
mapped:436 shmem:130 pagetables:2485 bounce:0
free:1234619 free_pcp:0 free_cma:140128
[ 1475.511098] Node 8 active_anon:61769088kB inactive_anon:5632kB active_file:4864kB inactive_file:4608kB unevictable:8128kB isolated(anon):0kB isolated(file):0kB mapped:7040kB dirty:128kB writeback:0kB shmem:5952kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 60764160kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no
[ 1475.511100] Node 8 DMA free:9148352kB min:180288kB low:314176kB high:448064kB active_anon:61779328kB inactive_anon:5632kB active_file:4864kB inactive_file:4608kB unevictable:8128kB writepending:128kB present:134217728kB managed:133939648kB mlocked:8128kB kernel_stack:53680kB pagetables:145792kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:8968192kB
[ 1475.511105] lowmem_reserve[]: 0 0 0 0 0
[ 1475.511108] Node 8 DMA: 104864kB (UME) 551128kB (ME) 138256kB (UME) 13512kB (UME) 11024kB (M) 12048kB (C) 14096kB (C) 18192kB (C) 537*16384kB (C) = 8993152kB
[ 1475.511119] Node 0 hugepages_total=30000 hugepages_free=812 hugepages_surp=0 hugepages_size=2048kB
[ 1475.511120] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
[ 1475.511121] Node 8 hugepages_total=30000 hugepages_free=29614 hugepages_surp=0 hugepages_size=2048kB
[ 1475.511122] Node 8 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
[ 1475.511123] 741 total pagecache pages
[ 1475.511125] 0 pages in swap cache
[ 1475.511126] Swap cache stats: add 0, delete 0, find 0/0
[ 1475.511126] Free swap  = 0kB
[ 1475.511127] Total swap = 0kB
[ 1475.511128] 4194304 pages RAM
[ 1475.511128] 0 pages HighMem/MovableOnly
[ 1475.511129] 9705 pages reserved
[ 1475.511130] 209920 pages cma reserved
[ 1475.511130] 0 pages hwpoisoned
[ 1475.511131] [ pid ]   uid  tgid total_vm      rss pgtables_bytes swapents oom_score_adj name
[ 1475.511150] [ 1642]     0  1642     1603      109    32000        0             0 systemd-journal
[ 1475.511152] [ 1673]     0  1673      344      119    31488        0         -1000 systemd-udevd
[ 1475.511154] [ 1677]     0  1677     1266       37    26624        0             0 lvmetad
[ 1475.511156] [ 3152]   100  3152      430      110    27904        0             0 systemd-network
[ 1475.511158] [ 3229] 62583  3229     1413       64    28160        0             0 systemd-timesyn
[ 1475.511159] [ 3230]   101  3230      273      115    31744        0             0 systemd-resolve
[ 1475.511161] [ 3356]     0  3356     1357       38    30976        0             0 lxcfs
[ 1475.511163] [ 3363]     0  3363      101       67    30464        0             0 atd
[ 1475.511164] [ 3366]     0  3366     1720      240    30208        0             0 networkd-dispat
[ 1475.511166] [ 3369]     0  3369      269      113    27648        0             0 systemd-logind
[ 1475.511168] [ 3372]   102  3372     3512       89    28160        0             0 rsyslogd
[ 1475.511169] [ 3379]     0  3379     1331       78    27136        0             0 irqbalance
[ 1475.511171] [ 3383]   103  3383      183       88    27392        0          -900 dbus-daemon

(( gnum=1+1 ))
(( 2<2+1 ))
[ 1475.511172] [ 3430]     0  3430     1331        8    30208        0             0 iprdump
[ 1475.511174] [ 3461]     0  3461      148       73    26880        0             0 cron
[ 1475.511175] [ 3463]     0  3463     3767      119    33792        0             0 accounts-daemon
[ 1475.511177] [ 3471]     0  3471      294       73    27904        0             0 opal-prd
[ 1475.511178] [ 3474]     0  3474    38499      329    75264        0          -900 snapd
[ 1475.511180] [ 3540]     0  3540       54        9    30208        0             0 iprinit
[ 1475.511181] [ 3545]     0  3545       54        9    25856        0             0 iprupdate
[ 1475.511183] [ 3568]     0  3568     3728      151    28928        0             0 polkitd
[ 1475.511185] [ 3671]     0  3671      268       97    27392        0         -1000 sshd
[ 1475.511186] [ 3686]     0  3686      121       26    30720        0             0 iscsid
[ 1475.511188] [ 3690]     0  3690      129      125    30720        0           -17 iscsid
[ 1475.511189] [ 3742]     0  3742      234      121    27392        0             0 login
[ 1475.511191] [ 3749]     0  3749      116       43    30464        0             0 agetty
[ 1475.511192] [ 3964]  1000  3964      313      124    28160        0             0 systemd
[ 1475.511194] [ 3973]  1000  3973      393      129    28672        0             0 (sd-pam)
[ 1475.511195] [ 3991]  1000  3991      167       69    26624        0             0 bash
[ 1475.511197] [ 3999]     0  3999      214      104    31232        0             0 sudo
[ 1475.511198] [ 4001]     0  4001      203       98    31232        0             0 su
[ 1475.511200] [ 4002]     0  4002      149       60    30976        0             0 bash
[ 1475.511201] [ 4024]     0  4024      333      148    28416        0             0 sshd
[ 1475.511203] [ 4121]  1000  4121      333      111    28416        0             0 sshd
[ 1475.511204] [ 4122]  1000  4122      167       69    30720        0             0 bash
[ 1475.511206] [ 4130]     0  4130      214      104    31744        0             0 sudo
[ 1475.511208] [ 4131]     0  4131      203       97    27136        0             0 su
[ 1475.511209] [ 4132]     0  4132      151       62    30720        0             0 bash
[ 1475.511211] [ 6579]     0  6579      157       61    27136        0             0 screen
[ 1475.511212] [ 6580]     0  6580      149       61    30720        0             0 bash
[ 1475.511214] [ 6903]     0  6903      133       11    30976        0             0 full_run.sh
[ 1475.511215] [ 6912]     0  6912      133       45    30720        0             0 run_multi.sh.ib
[ 1475.511217] [ 6927]     0  6927  1236296    16241   822784        0             0 java
[ 1475.511271] [ 8485]     0  8485   417347     3670   269824        0             0 java
[ 1475.511272] [ 8557]     0  8557  1912692   945196  8305152        0             0 java
[ 1475.511274] Out of memory: Kill process 8557 (java) score 437 or sacrifice child
[ 1475.513927] Killed process 8557 (java) total-vm:122412288kB, anon-rss:60478848kB, file-rss:13696kB, shmem-rss:0kB
[ 1476.525881] oom_reaper: reaped process 8557 (java), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB

Hi Adi, can you try
echo 90000 > /proc/sys/vm/nr_hugepages
Sorry 30K each socket only gives 58GB.

ibm_java_run2_smt4_hpg_90k.zip
@Tom-Tran  much better .
From here , I'd like to tune it, better to get a bit more close to 24 core published numbers. Appreciate your help till here!!!

Hi Adi, great to hear the issues are resolved.
What is your performance goal?
The largest performance gain you can probably get is from increasing the number of groups per socket. I recommend 2 JVM groups per socket with 11c binded to each JVM group. Since you are limited to 128GB RAM per socket, I'd recommend you bump down the backend JVM heap in the JAVA_OPT_BE by 5 to 15 GB, ie, let's try "-Xms50g -Xmx50g -Xmn48g". Also, you'll have to increase the number of hugepages again. echo 115000 > /proc/sys/vm/nr_hugepages

@Tom-Tran My goal is to beat Dual EPYC 7601 by a 10% or so margin. 7601 clocks around 120K max-jops as well.

@Tom-Tran
echo 115000 > /proc/sys/vm/nr_hugepages ran into OOM .
I decreased 'nr_hugepages' to 110000 and the test is running.
Here is what I went with
procs[1]="0-43"
procs[2]="44-87"
procs[3]="88-131"
procs[4]="132-175"
tprocs[1]="0-7"
tprocs[2]="44-51"
tprocs[3]="88-95"
tprocs[4]="132-139"
mem[1]="0"
mem[2]="0"
mem[3]="8"
mem[4]="8"
tmem[1]="0"
tmem[2]="0"
tmem[3]="8"
tmem[4]="8"
What do you think ?
While I'm not sure if this is going to give better results, and I don't want to fiddle with system while the test is running. I got the "out of band" power measurement and chips seems to be running 10% hotter Wattage wise than previous test.
Chip 0 :                 188.00 W  (lowest =  54.00 W, highest = 222.00 W)
Chip 0 Vdd:              139.00 W  (lowest =   7.00 W, highest = 173.00 W)
Chip 0 Vdn:               14.00 W  (lowest =  12.00 W, highest =  17.00 W)
Chip 8 :                 162.00 W  (lowest =  54.00 W, highest = 222.00 W)
Chip 8 Vdd:              113.00 W  (lowest =   7.00 W, highest = 173.00 W)
Chip 8 Vdn:               14.00 W  (lowest =  11.00 W, highest =  17.00 W)

Those bindings look good. I'm curious if you'll get any minor performance gains from:
tprocs[1]="40-43"
tprocs[2]="44-47"
tprocs[3]="128-131"
tprocs[4]="132-135"
Are there any vmstat/mpstat output to complement the wattage output from the two runs? Is the hotter run achieving higher max-jops, and therefore, maximizing the CPUs which can cause increase wattage?

ibm_java_run3_4_groups (1).zip
Hi Tom, here is the output with the previous run. It is showing 8% improvement.
Is there anything else that comes to your mind, to try ?

That's great. Here are some other items that may get a couple more percent.

tproc settings above
Increase the BE heap as much as you can in JAVA_OPTS_BE... see if you can increase Xmx, Xms and Xmn by 5
Here are two OS sched tunings that slightly differs from what you are using
echo 150000000 > /proc/sys/kernel/sched_min_granularity_ns
echo<PHONE_NUMBER> > /proc/sys/kernel/sched_wakeup_granularity_ns
Tune config/specjbb2015.props... the three forkjoin tiers, the worker min/max and the selector runner... these are all threadpools that needs to be tuned, but there are no formulas to find the optimal configuration. You might get a 1-2% tuning this, unless it is really poorly configured. I'd start by just increasing/decreasing the forkjoin.worker.Tier3 by 2, 4 and 6. "specjbb.forkjoin.workers.Tier3"

Hi @Tom-Tran
(1) didn't really help the max-jops. It did hurt the critical jops by a bit.
Will try (2), (3), (4)

@Tom-Tran

Didn't help , but hampered results by 2%
Couldn't increase by 5 exactly (OOM) but was able to increase by 3 . Didn't help, but hampered results by 2%
Helped the original setting by 2%:  max-jOPS = 132390, critical-jOPS = 45363
Haven't tried yet.

Interesting that 2) hampered results, Was the difference between Xmx and Xmn 2? I'm guessing this is run-to-run variation.

Hi @Tom-Tran  Till now I was running the tests with 2400 MHz Host build setting and moved to 2666MHz and seem to be running into errors :
[32661.390624] run_multi.sh.ib (16641): drop_caches: 3
[32680.432182] JIT Compilation invoked oom-killer: gfp_mask=0x15080c0(GFP_KERNEL_ACCOUNT|__GFP_ZERO), nodemask=8, order=0, oom_score_adj=0
[32680.432186] JIT Compilation cpuset=/ mems_allowed=0,8
[32680.432191] CPU: 136 PID: 20033 Comm: JIT Compilation Not tainted 4.15.0-23-generic #25-Ubuntu
[32680.432192] Call Trace:
[32680.432201] [c00020003309f6e0] [c000000000cdeb7c] dump_stack+0xb0/0xf4 (unreliable)
[32680.432206] [c00020003309f720] [c0000000002e5b94] dump_header+0x98/0x2f4
[32680.432208] [c00020003309f7e0] [c0000000002e4c68] oom_kill_process+0x368/0x6c0
[32680.432210] [c00020003309f8a0] [c0000000002e55ec] out_of_memory+0x2bc/0x710
[32680.432213] [c00020003309f940] [c0000000002ed5dc] __alloc_pages_nodemask+0xfbc/0x1070
[32680.432219] [c00020003309fb30] [c000000000378e80] alloc_pages_current+0xa0/0x140
[32680.432224] [c00020003309fb70] [c00000000006d5dc] pte_fragment_alloc+0xdc/0x1e0
[32680.432231] [c00020003309fbc0] [c0000000003a0324] do_huge_pmd_anonymous_page+0x374/0x9d0
[32680.432235] [c00020003309fc40] [c00000000033f68c] __handle_mm_fault+0xc6c/0xe10
[32680.432237] [c00020003309fd20] [c00000000033f958] handle_mm_fault+0x128/0x210
[32680.432239] [c00020003309fd60] [c00000000006a72c] __do_page_fault+0x21c/0xa70
[32680.432247] [c00020003309fe30] [c00000000000a634] handle_page_fault+0x18/0x38
[32680.432248] Mem-Info:
[32680.432256] active_anon:88667 inactive_anon:127 isolated_anon:0
active_file:728 inactive_file:983 isolated_file:0
unevictable:127 dirty:0 writeback:0 unstable:0
slab_reclaimable:3689 slab_unreclaimable:30156
mapped:929 shmem:132 pagetables:870 bounce:0
free:498038 free_pcp:0 free_cma:209920
[32680.432261] Node 8 active_anon:2986432kB inactive_anon:2560kB active_file:2944kB inactive_file:4032kB unevictable:4096kB isolated(anon):0kB isolated(file):0kB mapped:1408kB dirty:0kB writeback:0kB shmem:2816kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 2265088kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes
[32680.432264] Node 8 DMA free:13608256kB min:177408kB low:307136kB high:436864kB active_anon:2990528kB inactive_anon:2560kB active_file:3136kB inactive_file:2176kB unevictable:4096kB writepending:0kB present:134217728kB managed:129743552kB mlocked:4096kB kernel_stack:46912kB pagetables:28288kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:13434880kB
[32680.432268] lowmem_reserve[]: 0 0 0 0 0
[32680.432271] Node 8 DMA: 27864kB (UME) 69128kB (ME) 21256kB (ME) 4512kB (UM) 11024kB (M) 12048kB (U) 14096kB (U) 18192kB (M) 828*16384kB (MC) = 13615360kB
[32680.432281] Node 0 hugepages_total=54500 hugepages_free=52320 hugepages_surp=0 hugepages_size=2048kB
[32680.432282] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
[32680.432283] Node 8 hugepages_total=54500 hugepages_free=52306 hugepages_surp=0 hugepages_size=2048kB
[32680.432284] Node 8 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
[32680.432285] 1904 total pagecache pages
[32680.432286] 0 pages in swap cache
[32680.432287] Swap cache stats: add 0, delete 0, find 0/0
[32680.432288] Free swap  = 0kB
[32680.432288] Total swap = 0kB
[32680.432289] 4194304 pages RAM
[32680.432290] 0 pages HighMem/MovableOnly
[32680.432290] 75269 pages reserved
[32680.432291] 209920 pages cma reserved
[32680.432291] 0 pages hwpoisoned
[32680.432292] [ pid ]   uid  tgid total_vm      rss pgtables_bytes swapents oom_score_adj name
[32680.432309] [ 1619]     0  1619     1158      172    37120        0             0 systemd-journal
[32680.432311] [ 1651]     0  1651     1266       50    26880        0             0 lvmetad
[32680.432313] [ 1659]     0  1659      340      142    31744        0         -1000 systemd-udevd
[32680.432315] [ 2920]   100  2920      429      181    32000        0             0 systemd-network
[32680.432317] [ 3014] 62583  3014     1413      111    32000        0             0 systemd-timesyn
[32680.432318] [ 3041]   101  3041      273      165    27648        0             0 systemd-resolve
[32680.432320] [ 3209]     0  3209      101       72    30464        0             0 atd
[32680.432321] [ 3213]     0  3213     3537       44    32000        0             0 lxcfs
[32680.432323] [ 3214]   102  3214     3512       80    32256        0             0 rsyslogd
[32680.432324] [ 3234]     0  3234     1331        9    25856        0             0 iprdump
[32680.432326] [ 3240]     0  3240      297       74    28160        0             0 opal-prd
[32680.432327] [ 3243]     0  3243     3767      178    33280        0             0 accounts-daemon
[32680.432329] [ 3247]     0  3247      269      168    27648        0             0 systemd-logind
[32680.432330] [ 3250]     0  3250      148       88    30720        0             0 cron
[32680.432332] [ 3255]     0  3255     1332      100    31232        0             0 irqbalance
[32680.432333] [ 3268]     0  3268    51199      347    76800        0          -900 snapd
[32680.432335] [ 3270]   103  3270      183      105    27136        0          -900 dbus-daemon
[32680.432337] [ 3388]     0  3388     1720      298    34304        0             0 networkd-dispat
[32680.432338] [ 3440]     0  3440       54        9    29952        0             0 iprupdate
[32680.432340] [ 3448]     0  3448       54        9    30208        0             0 iprinit
[32680.432341] [ 3451]     0  3451     3728      134    29184        0             0 polkitd
[32680.432343] [ 3567]   111  3567      801      221    28928        0             0 redis-server
[32680.432344] [ 3690]   112  3690   388416     6522   376064        0             0 mysqld
[32680.432346] [ 3753]     0  3753      268      117    27904        0         -1000 sshd
[32680.432347] [ 3765]     0  3765      121       26    26368        0             0 iscsid
[32680.432349] [ 3769]     0  3769      129      126    26368        0           -17 iscsid
[32680.432351] [ 3823]     0  3823      234      141    27392        0             0 login
[32680.432352] [ 3832]     0  3832      116       49    26368        0             0 agetty
[32680.432354] [ 4057]  1000  4057      314      188    32000        0             0 systemd
[32680.432355] [ 4066]  1000  4066      394      129    28160        0             0 (sd-pam)
[32680.432357] [ 4093]  1000  4093      167      106    30976        0             0 bash
[32680.432358] [ 4101]     0  4101      214      122    31488        0             0 sudo
[32680.432360] [ 4103]     0  4103      203      116    27136        0             0 su
[32680.432362] [ 4104]     0  4104      151       98    26368        0             0 bash
[32680.432363] [ 6895]     0  6895      333      169    32256        0             0 sshd
[32680.432365] [ 7000]  1000  7000      333      154    32000        0             0 sshd
[32680.432366] [ 7001]  1000  7001      167      106    26880        0             0 bash
[32680.432368] [ 7009]     0  7009      214      122    27136        0             0 sudo
[32680.432369] [ 7010]     0  7010      203      116    27136        0             0 su
[32680.432371] [ 7011]     0  7011      151      102    30720        0             0 bash
[32680.432372] [ 7388]     0  7388      157       68    26880        0             0 screen
[32680.432374] [ 7389]     0  7389      151      101    26624        0             0 bash
[32680.432375] [16573]     0 16573      151       85    30976        0             0 screen
[32680.432377] [16631]     0 16631      133       31    26368        0             0 full_run.sh
[32680.432379] [16641]     0 16641      133       75    30464        0             0 run_multi.sh.ib
[32680.432380] [16656]     0 16656   546881     8222   376832        0             0 java
[32680.432457] [18295]     0 18295   139656     2129   121856        0             0 java
[32680.432458] [19100]     0 19100  1337714    16164   450560        0             0 java
[32680.432460] [19223]     0 19223   136584     2036   120576        0             0 java
[32680.432461] [20028]     0 20028  1362019    15982   459264        0             0 java
[32680.432463] Out of memory: Kill process 19100 (java) score 7 or sacrifice child
[32680.433492] Killed process 19100 (java) total-vm:85613696kB, anon-rss:1000000kB, file-rss:34496kB, shmem-rss:0kB
[32680.452836] oom_reaper: reaped process 19100 (java), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB

SpeccJBB ran error while we set Barreleye_G2 memory freq to 2666.
18-07-19_234122.zip

Hi Adi, OOM sounds more of an OS problem than Java. Do you still have the same amount of available memory on the OS with the 2666 GHz memory freq?
Is Terry doing the runs now ?

Both terry and I did the runs and ran into issues . Yes still 16x 16 GB DIMMs , so same amount of memory.

I see. @basuv please comment on any side affects of changing the memory frequency from 2400 to 2666. From the outputs, one of the JVMs on node 8 got killed by the kernel because of OOM. I don't think it is due to the lack of allocated hugepages. Probably ran out of normal 64K page memory. Can we try reducing the hugepage allocaiton per node from 54500 to 53000 or 52500?

Is this issue resolved? Wondering if I should close it.


Add a few more image examples

Might be nice to have more than the one example image.

Completed via: b78e08ef632414ce8d2e07bfcd4d77ec6f1fdcbd


Meetup date changes

Dates I'd like to change (separate issue to make sure we've mirrored this with the story museum or others):

[ ] January 20 -> February 17th #179
@spikeheap will be skiing, I'm not sure where I'll be

[ ] March 16th -> March 23rd #181 (optional)
I'll be away (though cool if @spikeheap & @peterjwest would like to take it)

:+1:

Does this mean no JSOxford for 2 whole months?! I don't know if I could cope!

We could hold a secret online-only JSOxford in January

I like the idea of that @omgmog, that way I could join from Italy and not get "I'm missing JSOxford sad face" :+1:

I've emailed the Story Museum about the new dates to check availability

I like the idea of that @omgmog, that way I could join from Italy and not get "I'm missing JSOxford sad face" :+1:

We could do something cool like this:

Each person can have a 3d avatar (threejs) with their face (via getusermedia) and we can have a virtual venue (webrtc).
WHO WANTS TO HACK ON THIS IDEA WITH ME?

:+1: I can provide manpower, though I've not used threejs before.

I'm SO on this!

Looks awesome! I can help

watch this space :arrow_right: https://github.com/omgmog/Tele-JS :arrow_left:


Question: How to access StreamingBulkCheckPermission?

While I was going through the experimental service, I stumbled upon this StreamingBulkCheckPermission method and wanted to know if this accessible and if so how can we do that? Any examples would help.
Also from what I understood, all the methods supports promises and wait for the stream to close to collect the data. If there any way to possibly collect the stream data as it is?
Any info would be helpful to understand.
Thank you

StreamingBulkCheckPermission is a relict of an earlier experimental idea and was never implemented. We'll make sure to update the API reference to remove it.


2missing details README.md

Updated README.md for 2 new achivements (Open Sourcerer) & (Heart On Your Sleeve)

Conflicts fixed and ready to go , But check it before you aprove it my friend


The 'Request' library is deprecated

See https://github.com/request/request and https://github.com/request/request/issues/3142
This library should probably be using node-fetch

Thanks, @antony. Any chance you could submit a PR?

@otisg I might be able to yeah - will do as soon as I'm able to.

This is now more critical as a vulnerability (CVE-2023-28155) was published recently, so it's now tripping npm audit.

@otisg is it on Sematext's roadmap to fix the CVE-2023-28155 vulnerability in this module?

@gsf4726 Not planned currently, unless we get a PR.  Don't think this module has (m)any users.

https://www.npmjs.com/package/logsene-js
3064 weekly downloads, and a critical security vulnerability?
not sure I agree here.
I'd love to submit a PR but I too am pressed for time so haven't managed to yet.

automated downloads/updates meaning CI? that's usage. I'm not sure what bots download npm dependencies, otherwise. I certainly haven't seen any evidence of that. I would say that the library has a reasonable amount of usage.

Ugh, sorry folks, my mistake - I was thinking about https://github.com/sematext/logsene-cli
So, yes, we will address this CVE issue.

@antony @yelworc   we've just released a new version of the library removing all vulnerabilities. https://github.com/sematext/logsene-js/releases/tag/1.1.76

Thank you, much appreciated!


ci: init

Signed-off-by: spacewander<EMAIL_ADDRESS>

Depend on https://github.com/api7/apisix-build-tools/pull/231

I will merge this PR first and then fix the CI issues.
As GitHub Action will not run until the workflow file is submitted to the default branch.


response_format is missing in CreateTranscriptionParams

So looking at https://platform.openai.com/docs/api-reference/audio/create, i notice that the optional response_format params is missing in CreateTranscriptionParams.

This is intended as I wanted to make the response consistent.


All my queries return only 1024 lines and then stops?

I am connecting to an impala db via node-impala from my node server, but every time I do a query (unless the limit is less than) the result return 1024 line from the db. Even if I SELECT * it returns 1024 lines form a db with over 6 million lines. I understand that beeswax reads 1024 lines at a time when querying, but why does it stop after the first run?
Please please help.
And thank you in advance to whomever gets back to me :)

https://github.com/ufukomer/node-impala/issues/11#issuecomment-274798646

9751a960edaf34f601b2cac65373b01686a52358


Outline issues

#5

Addressed the issue where only the port side of the normandy had dark outlines.

Fixed by removing the outlines together, because there is  a bug in the Idea SVG icon renderer.

[ ] Works on Windows

[x] Works on MacOS

[x] Changelog updated

Good to go!


Use and serialize sparse structs

Hi,
I noticed we're generating 'dense' structs for errors, resources and documents.
For example, we generate:
{"data": {...}, "meta": null, "included": null, "links": null, "jsonapi": null }
Instead of:
{"data":{...}}
This causes issues with the json_api_client ruby gem, and probably a number of other clients, which look for keys to exist before they start processing, but then error out because they found a null value instead of an object.
I looked at the spec and the jsonapi github repo trying to figure out which library was wrong (client or server), and although the json api spec does not explicitly say to set missing keys to null instead of omitting them altogether, there are a number of reasons to think using sparse structures is correct:

The examples in the jsonapi.org website are sparse.
The spec may not have explicitly favored sparse structs to avoid being over-explicit (and thus hard to read, a preference briefly mentioned https://github.com/json-api/json-api/issues/101)
The spec is explicit in other cases where a 'null' shall be used, like in the primary data or links.

I've also derived Default in a number of structures to help with sparse initialization.
cheers!

@nubis This is excellent, thank you!

Published version 0.5.2 with these changes


Inverted % sign / extra line break

[x] I am on the latest Hyper.app version

[x] I have searched the issues of this repo and believe that this is not a duplicate

OS version and name: Windows 7

Hyper.app version: 1.2.1

Link of a Gist with the contents of your .hyper.js: https://gist.github.com/meeech/f2665f33b1ad23ea1dabba7b2467bedb

Relevant information from devtools (CMD+ALT+I on Mac OS, CTRL+SHIFT+I elsewhere): N/A

The issue is reproducible in vanilla Hyper.app: Does it count as vanilla if I am not using cmd.exe on windows?

Issue
I am finding I get an extra line break with an inverted % sigh. See included screen shot. This happens with any theme. I tested with a theme with no prompt, and the issue remains.
I do not see this issue when using cmd.exe. Just when using zsh. I do not see this issue when using the same zsh in conemu (for example)
I'm looking for any advice on where to start to track down this issue, or what extra info I can gather.
thanks.

solution was
unsetopt PROMPT_SP
thanks to @schmic


Unauthenticated share updates adjustments

Summary | Résumé
Adjustments for share Dialog via
https://github.com/cds-snc/platform-forms-client/issues/1530#issuecomment-1431945267

Test instructions | Instructions pour tester la modification

Share flow for both auth + non auth'd
Dialog on a smaller screen where scrolling is needed for the dialog

Pull Request Checklist
Please complete the following items in the checklist before you request a review:

[ ] Have you completely tested the functionality of change introduced in this PR? Is the PR solving the problem it's meant to solve within the scope of the related issue?
[ ] The PR does not introduce any new issues such as failed tests, console warnings or new bugs.
[ ] If this PR adds a package have you ensured its licensed correctly and does not add additional security issues?
[ ] Is the code clean, readable and maintainable? Is it easy to understand and comprehend.
[ ] Does your code have adequate comprehensible comments? Do new functions have docstrings?
[ ] Have you modified the change log and updated any relevant documentation?
[ ] Is there adequate test coverage? Both unit tests and end-to-end tests where applicable?
[ ] If your PR is touching any UI is it accessible? Have you tested it with a screen reader? Have you tested it with automated testing tools such as axe?

@anikbrazeau flagging small update here:
https://github.com/cds-snc/platform-forms-client/pull/1636/files#diff-a6e486b021382fa7935492752ec9890787007f55c22fdc5c300ec95e11355a7bR265


DLL amfrt64.dll failed to open

(Make sure you're using the latest version)
Version:
(vid) F:>auto-editor -v
Auto-Editor version 22w02a
What went wrong
Paste your command and it's output here.

(vid) F:>auto-editor 3.mp4
stderr: Input #0, rawvideo, from 'pipe:':
Duration: N/A, bitrate: 36806 kb/s
Stream #0:0: Video: rawvideo (I420 / 0x30323449), yuv420p, 426x240, 36806 kb/s, 30 tbr, 30 tbn, 30 tbc
Stream mapping:
Stream #0:0 -> #0:0 (rawvideo (native) -> h264 (h264_amf))
[h264_amf @<PHONE_NUMBER>842300] DLL amfrt64.dll failed to open
Error initializing output stream 0:0 -- Error while opening encoder for output stream #0:0 - maybe incorrect parameters such as bit_rate, rate, width or height
Conversion failed!
Error! FFmpeg Error!

it worked after download my own ffmpeg and set it to window 10 path and then use `--my-ffmpeg' flag after reboot my computer.


Fixes https://github.com/docker/docker/issues/13426

Ported the code over and adjusted to the setup process and the new netlink library
Fixes https://github.com/docker/docker/issues/13426
Signed-off-by: Madhu Venugopal<EMAIL_ADDRESS>

@mrjana @aboch addressed all the relevant comments. PTAL.

LGTM

LGTM


BIGTOP-3204. Bump Flink to 1.6.4

Bump Flink version from 1.4.2 to 1.6.4. There are three changes involved:
1. obviously, version number
2. in Flink 1.6.4, there is no 'resources' folder any more. Removed it.
3. set mode to 'legacy'
Starting from Flink v1.5, there is a rewrite of Flink’s deployment and process
model (internally known as FLIP-6). A new option 'mode' was introduced to
indicate which executions to use. However, the way Bigtop puppet deploys
'flink-jobmanager' and 'flink-taskmanager', ie. calling 'flink-daemon.sh
jobmanager' and 'flink-daemon.sh taskmanager', is legacy. Without setting
mode to 'legacy', flink's built-in exmaples fail with error
"JobSubmissionException: Failed to submit JobGraph"

@docularxu the patch is great. Just one thing: I see 3 commits in this patch. Please make this PR clean with only one commit containing the fix.
And, regarding to the Kafka reverts, are you seeing problems to run Flink 1.6 with Kafka 2.X?

@docularxu the patch is great. Just one thing: I see 3 commits in this patch. Please make this PR clean with only one commit containing the fix.

Fixed that.

And, regarding to the Kafka reverts, are you seeing problems to run Flink 1.6 with Kafka 2.X?

I didn't test that yet. What I tested is Flink 1.6 with Kafka 0.10.x version.
Problem of Kafka 2.x is its kafka-server doesn't launch since in bigtop we use zookeeper 3.4.6 which misses this class: (java.lang.NoClassDefFoundError: org/apache/zookeeper/AsyncCallback$MultiCallback)


feat: Adaptive layout scale

Closes https://github.com/marc2332/freya/issues/1
⚠ WIP
It scales the layout with the window's scale factor

Seems to be working correctly


cant run.bat

[INFO] launcher: Starting sanity checks
[INFO] launcher: Checking for Python 3.5+
[INFO] launcher: Checking console encoding
[INFO] launcher: Setting console encoding to UTF-8
[INFO] launcher: Ensuring we're in the right environment
[CRITICAL] launcher: Bot wasn't installed using Git. Reinstall using http://bit.ly/musicbotdocs.
Press enter to continue . . .

The problem and solution are on the last line.


”Craidorolț” is listed in the drop-down menu

Description:
"Craidorolț" is listed in the drop-down menu alongside its corresponding county and commune, according to the law.
Precondition:
The website is up an running.

Step 1
Type "Craidorolț" in the search bar.

Expected results
The location is listed in the drop-down menu as "Comuna Craidorolț, SATU MARE".


Experiment with libsumo

@davidrusu Experiment with libsumo (if we can get it to work, there's still more though that needs to go into it due to its limitations and our need for multiple clients - i.e. via sumo bridge)

@davidrusu please describe your experience with this.

This did not work as needed yet. May be re-opened in the future.


Header for another set of blogs in the same site

How do you add a separate page as a header(i figured this one out) as well as add a separate set of blogs to it?
For example, I wanna start a separate blog where I add code. How do I do that?
I found out how to add the header page. How can I include a set of code used for the home page that will help me add blogs separately and not mix them in the home page?

You want to have two types of articles in one blog:

Normal article with in _posts
Other "code" article that don't mix with the posts

Am I understanding you correctly?
If so you could try to use the portfolio functionality?

You want to have two types of articles in one blog:

Normal article with in _posts
Other "code" article that don't mix with the posts

Am I understanding you correctly?

Yes

If so you could try to use the portfolio functionality?

I don't want the portfolio because to use it, I need to make a picture to add it.
I want it to appear just like the home screen blog. How do I do that?

How do you add a separate page as a header(i figured this one out) as well as add a separate set of blogs to it?
For example, I wanna start a separate blog where I add code. How do I do that?
I found out how to add the header page. How can I include a set of code used for the home page that will help me add blogs separately and not mix them in the home page?

Use categories for that.

What is categories?

A field that you can put on the front matter of blogs posts. You can use the categories as any other field on the permalink.

Well, how do you use it then?

What I am trying to tell is that if I have a new page in my blog, and added a header page, how do I put the posts in that page only?

You need to mess with pagination. There's a plugin for that but it will not work with GH Pages. What you can do is write a fac-simile using Liquid only that filter for the desired category. You can use a if inside a for loop to do that.

Any simple method?

Or at least how to redirect via header page?

ping @sylhare

You can use jekyll collections (In this theme portfolio is a collection but you can add another one and custom it so that it fits your needs)
You could do it in two repo hosted on github page one showing your code and the other one your blog and add links between the two pages. But that will require some customization as well.

That works, but how can I add a header page? That is confusing to me.

Any code for adding?

ping @sylhare

Found a solution via collections. Thanks!

Awesome 👍 You can reference it here, if someone is having the same question as you, I'm sure they'll be glad to see your stuff!

Yep.


BTorrent tracker url is wrong

In many of the demos I saw it's trying /announce, while it's just /

Oops, my bad. Will have to fix each of them. Thanks for letting me know.


Get rid of _cmd references in core and improve --subscription testing

This has contributed to a few regressions and likely represents some serious technical debt. At the same time, we need to beef up the testing of this behavior.

We got the same problem.
--subscription is not working anymore.

Moving this to post-Build.

add to S164.

hi @qwordy could you pls check if the issue still exists? thanks


performance and usability improvements

Hello,
I've been hacking modipy-youtube for a few days now trying to make it fast and improve usability. I ended up implementing several improvements (which, in my experience, make a big overall difference):

only handle search, allows browsing with no overhead
only 2 API calls in search, only takes a couple of secs
use the Youtube API for metadata, minimizing the number of calls.
pafy (expensive) is only used for playback
load data in the background, adding to playing queue is usually instantaneous
return playlists in search results
separate all API logic in youtube.py, backend.py is quite clean

I don't know whether you'd consider pulling such changes. If so, let me know in case you want any explanations/modifications/etc.
Kostas

Sorry. I didn't fully consider the consequences of replacing the "devel" branch with a "develop" branch, to match the other Mopidy repos. Since there doesn't seem to be any unresolved comments in this PR, do you mind simply opening a new PR against the develop branch?


feat: implement kubectl cnpg subscription/publication create command

We still miss documentation and a few E2e tests, but this is lovely IMO


Two forms on same page

I have two forms on same page with 2 recaptcha added.
The  first form works fine but when i fill the second form with capctha tick it gives blank "vcRecaptchaService.getResponse()"
But when I complete recaptcha from first form I m allowed to submit the second form
Any suggestion will be helpful.

You need to pass the widgetId to the getResponse method. Without the widgetId it will use the first widget instance. See https://github.com/VividCortex/angular-recaptcha#response-validation

Thank you .
I rushed into opening issue.


Include source for deprecated AWS SDK 1.7 classes removed from AWS SDK 1.9

This addresses the following issue:
https://github.com/mboudreau/Alternator/issues/90
The previously deprecated classes from AWS SDK 1.7 have since been removed from AWS SDK 1.9
The original source files for these classes was downloaded from the 1.7.13 release of the AWS SDK:
https://github.com/aws/aws-sdk-java/releases/tag/1.7.13
The Alternator pom.xml dependency versions were adjusted to match latest AWS SDK versions.
This required editing some JsonUnmarshaller classes to change .currentToken to .getCurrentToken()
All JUnit tests pass 'mvn verify'.
Alternator version updated to 0.10.0-SNAPSHOT since a different AWS SDK version is used.

Sorry for time taken to merge this, vacation and all.  Will deploy new version soon.

Version 0.10.0 has been released.


[explore][south table] timestamp column in data panel did not show correctly

timestamp column in data panel did not show correctly
How to reproduce the bug

Open example chart 'Participants' in superset
Observed timestamp column in 'view result tab' under data table
See error

Expected results
Timestamp column show correct date format
Actual results
timestamp column show in long number other than date format
Screenshots

Environment
(please complete the following information):

browser type and version:
superset version: lastest master
python version: python --version
node.js version: node -v
any feature flags active:

Checklist
Make sure to follow these steps before submitting your issue - thank you!

[x] I have checked the superset logs for python stacktraces and included it here as text if there are any.
[x] I have reproduced the issue with at least the latest released version of superset.
[x] I have checked the issue tracker for the same issue and I haven't found one similar.

Additional context
Add any other context about the problem here.

That table now lets you choose between integer and human-readable timestamps. I believe this is resolved, but correct me if I'm mistaken!


How to implement a loading screen or swap root?

I need to implement a loading screen. There is a long issue in rnn-starter about splash screen. It seems it wouldn't come for a while.
I am thinking of using the technique of swapping root. It is not very clear from doc.
Is there a way to do so with rnn-screens without using react native navigation directly?

hey @lanyusan! it took me a while to respond, been busy these days. I have just release v16.0.0 of rnn-starter where you can take advantage of splash screen! but yeah, I've used that technique a few times. what I've also done is showing overlay with loading progress after first screen is shown. So I'm going to close the issue as splash screen is released and rnn-screens will be soon replaced with rn-navio.


reads state of INPUT pins and sets on update_lines

I believe this might resolve https://github.com/jdeneef/ha_gpiod/issues/3
Having update_lines read the current state of configured INPUT ports and set it on the entity allows for restarts to detect the current state of things.

I did something similar, but for all gpiod from startup iso update_lines, and updating the same in updates for binary_sensor instead of assuming the state. Not sure this would fix the issue #3, but let's see. Thanx for thinking along though!


Fix/pep 563 class init annotations parsing

Closes #105

Codecov Report

Merging #107 (1718543) into main (f8b0f4b) will decrease coverage by 0.07%.
The diff coverage is 100.00%.

:exclamation: Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the GitHub App Integration for your organization. Read more.
@@            Coverage Diff             @@
##             main     #107      +/-   ##
==========================================
- Coverage   96.95%   96.88%   -0.07%
==========================================
  Files          67       67
  Lines        2266     2280      +14
  Branches      438      250     -188
==========================================
+ Hits         2197     2209      +12
- Misses         59       60       +1
- Partials       10       11       +1

Files Changed
Coverage Δ

di/_utils/inspect.py
100.00% <100.00%> (ø)

tests/test_wiring_pep_563.py
100.00% <100.00%> (ø)

... and 1 file with indirect coverage changes

Thank you so much for the contribution!


IDVA6-1416 & IDVA6-1358: Implement proper "Cannot Add User" page

Replace placeholder stop screen with a more informative "Cannot Add User" page
Update content in English and Welsh translation files
Modify tryAddingUserController to use new error page
Update related test cases
Rename placeholder-stop-screen.njk to cannot-add-user.njk
Update constants to reflect new page name

CI: Security warnings found!


Decision on original control dataset after translation

Delete originally downloaded shards of control datasets once translated and stored in TFDS, or finalize cheaper storage options compared to mounted standard persistent disk.

closing and re-opening an identical issue for linear tracking


CNV-32609: Keep the CPU value from Catalog drawer for customizing page

📝 Description
Fixes:
https://issues.redhat.com/browse/CNV-32609
Save correctly the CPU value from Catalog drawer, especially if the user has edited this value in the drawer, so it can be displayed in Customize and create VirtualMachine page correctly, same as it was set when the user has left the drawer.
Note:
This PR can be merged now, but it is kinda problematic to reproduce the bug without https://github.com/kubevirt-ui/kubevirt-plugin/pull/1514 being merged.
🎥 Demo
Before:
https://github.com/kubevirt-ui/kubevirt-plugin/assets/13417815/310234ff-65d8-4c75-9b71-aabc870826c0
After:
https://github.com/kubevirt-ui/kubevirt-plugin/assets/13417815/d72aaff2-e7e7-4696-8e77-76aa6ae94dfb

@avivtur @metalice @pcbailey @upalatucci @vojtechszocs please review

/retest
/lgtm

/retest

/retest


[FIX] fix infinite loading hf model bug that cause oom

according to current hf code in llm.py, it will initailize a new hf_model object everytime the function is invoke, which causing duplicate loading model in gpu and cause oom.

this pr cache the hf_model with lru_cache, so that it will not load a new model everytime when the function is invoke.

before:

after:

Should the follow code be put into the initialize func?
 if hf_tokenizer.pad_token is None:
        # print("use eos token")
        hf_tokenizer.pad_token = hf_tokenizer.eos_token

Should the follow code be put into the initialize func?
 if hf_tokenizer.pad_token is None:
        # print("use eos token")
        hf_tokenizer.pad_token = hf_tokenizer.eos_token

i think so, i alr move the code, please check

Should the follow code be put into the initialize func?
 if hf_tokenizer.pad_token is None:
        # print("use eos token")
        hf_tokenizer.pad_token = hf_tokenizer.eos_token

i already move the code and tested the code, please feel free to check


LMS7002M API and reference frequency

Some calls take a reference frequency, some dont:
	float_type GetReferenceClk_SX(bool tx);
	float_type GetFrequencyCGEN_MHz();
        //...I believe this uses the ref freq that was last set by SetFrequencySX
	liblms7_status SetFrequencyCGEN(float_type freq_MHz);
	float_type GetFrequencySX_MHz(bool tx, float_type refClk_MHz);
	liblms7_status SetFrequencySX(bool tx, float_type freq_MHz, float_type refClk_MHz);
	liblms7_status SetNCOFrequency(bool tx, uint8_t index, float_type freq_MHz);
        ///...although this refClk_MHz is the DSP/ADC rate
	float_type GetNCOFrequency_MHz(bool tx, uint8_t index, float_type refClk_MHz, bool fromChip = true);

Possible changes
One of the things that I did to IConnection was add a call to query the reference frequency. The reference frequency is set by the board, external to LMS7002M. Some boards will have it fixed, some will have a synthesizer like stream.
I propose that all of these calls drop the reference frequency parameter, and in addition, LMS7002M does not cache the reference freq. Ref freq is always queried from one place, the IConnection.
IConnection.h
    /*!
     * Query the frequency of the reference clock.
     * Some implementations have a fixed reference,
     * some have a programmable synthesizer like Si5351C.
     * @return the reference clock rate in Hz
     */
    virtual double GetReferenceClockRate(void)

I agree, the reference clock can be moved to IConnection.
Some notes about reference clocks:

SXR and SXT can have separate reference clocks, but it is most likely that they always will be set to identical values.
CGEN reference clock is always equal to SXR reference clock.
Fixed reference clock boards can depend from used crystal. There are EVB7 boards that use one of the 30.72MHz or 52MHz crystal.

Also it would be a good idea to match units in the APIs, so possibly switch from MHz to Hz.

SXR and SXT can have separate reference clocks, but it is most likely that they always will be set to identical values.

Right the XBUF config can have different clocks in some configurations. Perhaps we can have an additional set of calls

GetTxReferenceClockRate() //without overloading, calls GetReferenceClockRate()
SetTxReferenceClockRate()  //without overloading, calls SetTxReferenceClockRate()

Also it would be a good idea to match units in the APIs, so possibly switch from MHz to Hz.

I have made a mistake sometimes with the Hz vs MHz. :-) I like to have absolute units when possible. Hz would be preferable in my opinion.

Since the parameters will be changed to Hz, we might as well change the frequency parameter types from float to int64_t.

I dont know if using a 64-bit integer is worth the trouble. Like: we might end up with strange precision issues when representing frequencies with repeating decimals, like 33.333... MHz. And we would loose the ability to represent sub-hz frequencies, like CORDIC precision. Maybe in reality, this isnt such a problem but I would stick with double for all units (Hz, volts, dB, etc) unless efficiency required it.

Use ref freq API: https://github.com/limemicro/lms7suite/commit/72c316b409912bd9d8cbe240bf9fb386b8c44338

And using Hz has its own issue: https://github.com/limemicro/lms7suite/issues/39
Closing


Testing accuracy of the Digits trained model using pycaffe doesn't match with Digits report

Hi, there. I'm trying to build a detector using Digits trained model. I downloaded the mean.binary, deploy.prototype and .caffemodel file of the last epoch and feed them into pycaffe. However, I'm not able to get the same high validation accuracy from net.forward_all function (99.6% from Digits, 89.6% from Python). Before the classification, I subtract the mean image from the input image. I didn't check any resizing option in this process. Has anyone done this before? Is there any step I forget? I really appreciate your help!!!
BTW, I used the trained model from pycaffe and repeat the same validation procedure. The accuracy of pycaffe trained model matched with those displayed in the trained interface.
Here's part of my python code:
mean = np.load(PY_MEAN_FILE)
net = caffe.Net(MODEL_FILE, PRETRAINED,caffe.TEST)
caffe.set_mode_cpu()
Image = cv2.imread(Image_Name)
Image = Image.transpose(2,0,1)
Image = np.float_(Image) - np.float_(mean)
out = net.forward_all(data=np.asarray([Image]))
predicted_label = out['prob'][0].argmax(axis=0)

Check out the classification example at examples/classification. The README explains limitations and ways to extend the example.

@RileyLee, did you solve your problem? I'm closing this issue. Please re-open it if you have more questions.

@lukeyeager what if i don't do any image resizing in digits, should i still expect a difference. My model gets 98%  accuracy on test set in digits and 94 in pycaffe


Improvement suggestion: add reference to source code when issuing warnings

I see warnings like the one below here and there in the log files. However, as the code base is quite large and there are lot of queries, it is not easy to track down to which query is the warning related. Would it be possible to extend the message with source file name and line number?
Or any glues how to find the query in the code that is causing the warning?
The Include operation for navigation '[t].Tenant' is unnecessary and was ignored because the navigation is not reachable in the final query results. See https://go.microsoft.com/fwlink/?linkid=850303 for more information. <s:Microsoft.EntityFrameworkCore.Query>

Further technical details
EF Core version: 2.2.6
Database Provider: Microsoft.EntityFrameworkCore.SqlServer
Operating system: Windows 10, Azure App Service
IDE: Visual Studio 2019 16.1.2

@fhurta There isn't a way to do this automatically (that's actually a hard problem: #14134) but you can add tags to your queries


Add path payments to wallet api

Title. Example payment:
keybase wallet api -m '{"method": "send-path-payment", "params": {"options": {"recipient": "nathunsmitty", "amount": "10", "source-asset": "native", "destination-asset": "USD/GDUKMGUGDZQK6YHYA5Z6AY2G4XDSZPSZ3SW5UN3ARVMO6QSRDWP5YLEX"}}}'

@keybase/picnicsquad

Added a find-payment-path option to preview a payment path before sending. There's also now a required source-max-amount option that on send-path-payment that sets a maximum number of source asset that can be used in the payment.


Bug: A category with non-ascii characters can't be slugified properly

https://firestorm-dogfood.herokuapp.com/categories/breaking/threads/9

This is down to the slugger library: https://github.com/h4cc/slugger
What should be the behaviour when using pinyin or otherwise not-trivial-to-sluggify characters? I'm inclined to believe that we should always just use the id if the slug is blank - easy to do, system already supports it.

I think that's probably good enough..
It looks like another way of doing it is as indicated here, but I don't think we'd get value out of this: http://stackoverflow.com/a/21186167/234025


-Bunch of fake airdrops

etherfi.wtf
pub-a0b6f56c81c746d397b9766ef68aefcd.r2.dev/hub/airdrops/index.html
mainnet.ether.fi
etherfilive.com
cryptojunction.xyz/dappradar
secwarex.io

etherfi.wtf
pub-a0b6f56c81c746d397b9766ef68aefcd.r2.dev/hub/airdrops/index.html
mainnet.ether.fi
etherfilive.com
cryptojunction.xyz/dappradar
secwarex.io

Hello ImdioR,

Always add the main domain, so if you want to report mainnet.ether.fi, add also (or just) ether.fi. In this specific case, it's not a fake site. ether.fi is legit.
Don't add the full domain (/), so for example, for cryptojunction.xyz/dappradar you would need to add just cryptojunction.xyz
secwarex.io is a legit site.


License

Hi,
Thank you so much for releasing this code! Super excited to try it out. Would you mind adding a license?
Thanks!

Thanks for creating the issue. The license is now added.

Thanks!!


Initial signing event sign/import

This is DRAFT until #20 is resolved
This is the initial signing event for root-signing-staging:

imports the existing staging repository into tuf-on-ci management
makes me the signer for all offline roles, and GCP KMS the signer for online roles
other signers will be added in later signing events

I believe the metadata is good to go although obviously testing the whole repository is difficult until it is merged and online signed.
The only strange thing I could see in the metadata was that registry.npmjs.org metadata still has a (empty) signature for key   314ae73 (the old signing key). It also has my signature so the metadata is valid and but that seems like a potential minor issue in tuf-on-ci -- the signatures list should only ever contain the actual signers keys.

Interesting, the signed-off-bys are missing event though my git config has it enabled... Will have to look into this


Add feature: customizable halo for prebuilt indicators

This PR implements the feature mentioned in #44

Hi @ProV1X,
I hope you're doing well.
I believe incorporating a basic Halo design with a showHalo boolean option would be an excellent feature enhancement. Setting this option to true by default would ensure the halo is displayed unless explicitly turned off by the user, providing greater flexibility and control.
It would also be beneficial to document this property clearly for users who may want to disable the halo.
Thanks and regards,
Nikhil

Hi @ProV1X,
Thank you for the PR. I hope you are doing well.
Nowadays, I am busy due to the transition of my job and some personal work, but I will merge and release this update ASAP.
Thanks and regards,
Nikhil


False alarm from Nothing

The following test does not pass:
test("Nothing should not be false-alarmed") {
  val result = WartTestTraverser(Nothing) {
    val map: Map[String, String] = Map.empty
  }
  expectResult(List.empty, "result.errors")(result.errors)
  expectResult(List.empty, "result.warnings")(result.warnings)
}

I will probably come up with a fix later.

Interesting. It expands to
val map: Map[String,String] = scala.this.Predef.Map.empty[String, Nothing];

It's probably due to B in covariant position in Map[A, +B]. Maybe it's not a bug then?


Using this with Tape

Hi,
I write my tests using tape. Would it be straight forward enough to get this module working with it?

Hi
It could be interesting.
I have used other stuff from substack but never its own testing framework.
I can try to look how to integrate it when I found some times.
Many thank for your feedback
Regards

Awesome, good news.
Anything I can help with?

If you want to give me a pull request, this is a good idea :)

tape doesn't have explicit before, beforeEach, after or afterEach functions and so I got thinking about how to implement sequelize-mocking for tape.
I figured that I could expose the functions of the module to be used manually, like this.
What do you think? On the right track? I'll finish up if so

For tape specifically, it would be implemented like this

I will take a look of your feedbacks
Thanks !

Had a chance to take a look?

Hi @alexdrans
I'm sorry, I have a lot of work at my job and few times at home
I have finished to look on some tasks on another project. I hope to look soon this point
Sorry
Regards

Hi
I start to work on it.
I think it should be:
/**
 * Using SequelizeMocking with tape easily
 *
 * @module lib/sequelize-mocking-tape
 * @exports sequelizeMochingTape
 * @version 0.1.0
 * @since 0.1.0
 * @author Julien Roche
 */

'use strict';

// Imports
const test = require('tape');

const Sequelize = require('sequelize');
const _ = Sequelize.Utils._;
const SequelizeMocking = require('./sequelize-mocking');

/**
 * @method
 * @private
 * @param {Test} test
 * @param {Function} handler
 * @returns {Function}
 */
function beforeEach(test, handler) {
    return function (name, listener) {
        test(name, function (assert) {
            let _end = assert.end;

            assert.end = function () {
                assert.end = _end;
                listener(assert);
            };

            handler(assert);
        });
    }
}

/**
 * @method
 * @private
 * @param {Test} test
 * @param {Function} handler
 * @returns {Function}
 */
function afterEach(test, handler) {
    return function (name, listener) {
        test(name, function (assert) {
            let _end = assert.end;

            assert.end = function () {
                assert.end = _end;
                handler(assert);
            };

            listener(assert);
        });
    }
}

/**
 * @name sequelizeMochingMocha
 * @param {Sequelize} originalSequelize
 * @param {string} [fixtureFilePath]
 * @param {SequelizeMockingOptions} [options]
 */
module.exports = function (originalSequelize, fixtureFilePath, options) {
    let mockedSequelize = null;
    let newTest = null;

    newTest = beforeEach(test, function (assert) {
        let createFunc = _.partialRight(fixtureFilePath ? SequelizeMocking.createAndLoadFixtureFile : SequelizeMocking.create, options);

        createFunc(originalSequelize, fixtureFilePath)
            .then(function (sequelizeInstance) {
                mockedSequelize = sequelizeInstance;
                assert.end();
            })
            .catch(assert.end);
    });

    newTest = afterEach(newTest, function (assert) {
        SequelizeMocking
            .restore(mockedSequelize, options)
            .then(function () {
                assert.end();
            })
            .catch(assert.end);
    });

    return newTest;
};

I try to publish a feature branch with examples (maybe into the weekend)
Cheers

Bump @rochejul


 I have weapon esp range set to 10. Also when spectating head dot size is based on where you died not on the person you are spectating. Doesn't matter much tbh but would be nice if it gets fixed.

It will be fixed when the new stream-proof esp comes.


display: flow-root

#2999

Thanks!

+1 for data review, since https://twitter.com/rachelandrew/status/823855485719867392:

display: flow-root has landed in Chrome Canary and Firefox Nightly.


Specifying 'Options for the resulting Listing'.

I was looking at the docs of RedditUser and I wanted to fetch all comments below a certain karma.
The docs say you can supply an options parameter to getComments() (and many more functions).
Where do I find what I can put in these options?

See here


Update list item Rest API: fixed the content-type value

The content-type for the Update list item REST API was incorrect in the documentation example here. This PR fixes the example
Category

[x] Content fix

Related issues

fixes #6636

What's in this Pull Request?
Updated the content-type header value in the example to the correct value: "application/json;odata=verbose", instead of: "application/json", which does not work.

Docs Build status updates of commit 5a5ed8b:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs/sp-add-ins/working-with-lists-and-list-items-with-rest.md
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

Docs Build status updates of commit 5a5ed8b:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs/sp-add-ins/working-with-lists-and-list-items-with-rest.md
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

I'm not sure this fix is correct... can you confirm this with an example? The content-type header has nothing to do with the metadata returned in the ODATA spec... it only defines what data is being SENT to the service.

Hi Andrew
I understand what you are saying about the content-type header but the API returns a 400 if odata=verbose is not sent as part of the header. The error message returned is '__metadata does not exist on type 'SP.Data.DataItem'
The rest API seems to be expecting that value in the header
Jerry has also provided an example here in the original issue: https://github.com/SharePoint/sp-dev-docs/issues/6636#issuecomment-767981917
Other similar API calls expect this value for the content-type header as well as, such as Create List Item, Delete List Item and a few others.
This is just a guess but from what I am reading this could have been done to support the Verbose JSON format in the OData 3.0 spec. More about this here (you are likely already familiar but just in case):
Verbose JSON Format:
https://docs.microsoft.com/en-us/openspecs/windows_protocols/ms-odata/c91c88d1-b477-46ed-bfa1-210b22ecf9ca
https://docs.microsoft.com/en-us/openspecs/windows_protocols/ms-odata/d91277b3-30dc-4195-9848-20f2f95c9ecf
Odata 3.0 spec discussing the json verbose format:  https://www.odata.org/documentation/odata-version-3-0/json-verbose-format/
Based on what I read, it may have been done to support sending the __metadata as part of the request? FWIW, I tried with odata=minimalmetadata and that resulted in the same error.

@andrewconnell - just making sure you were able to review my earlier response. Please let me know if I can further assist in any other way. Thank you!


F-10 hotkey does not exit in Ubuntu 17.10

Tested in the latest Ubuntu 17.10 with the default desktop (Gnome) with the default Gnome Terminal 3.24, instead its intercepted and opens a file menu. I use ZSH but I doubt that's related.
I suggest we change the hotkey for Ubuntu 17.10
Also, related: typing exit and pressing enter should exit or display a text telling the user to type .exit, you know, because, UX

I think we should solve this by having configurable keybindings as suggested in #202
I'll convert this into the corresponding feature request for configurable key bindings.
We can't add a message when executing exit to execute .exit for the same reason we can't make exit quit the shell. It has possible naming conflicts with the AWS service namespace so we're being defensive and requiring all shell specific commands begin with a period.


OSVR.Unity.InterfaceCallbacks.PoseCallback should take one value argument

Currently PoseCallback takes a position and a rotation:
public delegate void PoseCallback(string source, Vector3 position, Quaternion rotation);

In order to help support more generic callback code, a single 'value' type should be used for each report. In this case, since we have multiple values, a wrapper struct should be constructed:
public struct PoseReport
{
    Vector3 Position { get; set; }
    Quaternion Rotation { get; set; }
}

public delegate void PoseCallback(string source, PoseReport pose);

This allows, hypothetically, a common generic interface callback:
public delegate void InterfaceCallback<T>(string source, T value) where T : struct;

@JeroMiya ok to close this issue now that InterfaceCallback is in Managed-OSVR?

Yes, I think so.


Ensure that tuple unboxing cleans up early items if later ones fail

Implemented based on discussion in gh-5336, and on the approach used in callwrapper._ArgManager.
Replaces gh-5334.

Fails here with
RuntimeError: Failed in nopython mode pipeline (step: nopython mode backend)
Instruction does not dominate all uses!
  %.241 = call i8* @PyTuple_GetItem(i8* %.20, i64 1)
  call void @numba_reset_pyobject_private_data(i8* %.241)
Instruction does not dominate all uses!
  %.33 = call i8* @PyTuple_GetItem(i8* %.20, i64 0)
  call void @numba_reset_pyobject_private_data(i8* %.33)

@sklam, is there an easy way to get hold of more complete IR for the failure?

@eric-wieser http://numba.pydata.org/numba-doc/latest/reference/envvars.html#envvar-NUMBA_DUMP_LLVM and similar may be of use when reproducing this locally.

I think I concluded that the problem is that LLVM can't handle:
ok = ...

if ok:
    x = Foo
...
if ok:
    y = x  # error: the assembler does not know if x has been assigned without performing value-based analysis

I could work around it by initializing x to garbage, but I prefer the approach in #5422

Regarding https://github.com/numba/numba/pull/5417#issuecomment-604423109, the second if block would need a phi node for x. The optimizer would simplify the CFG and figure out that x is never uninitialized.

@sklam, do I need the phi node to have a dummy value for all possible entry points, or not?


The onnx2trt tutorial of Depth-Anything-v2.

Dear author, I appreciate your work very much, because the onnx2trt resources provided on the Internet are a bit cluttered, which is not conducive to novices to convert your model to tensorrt, so I have compiled a repository that uses tensorrt<IP_ADDRESS> to convert depth anything v2 from onnx to tensorrt, if you are interested here, you can also organize the relevant code of the repository into your repository in the future, thank you!

Thank you! I will add this to our README in the next update.


[#1969]Compendiums "Items (SRD)" and "Spells (SRD) are no longer in alphabetical order

I have removed the sort parameter from all items and spells to get them to sort alphabetical. Fixes #1969

Looking at the definition for the document data model, it looks like sort is a required field. While this shouldn't cause any errors, it will just end up resulting in the sorts for all of these documents being set to 0 (the default value) on load. A better solution would be to set everything as 0 ourselves.
The easiest way to accomplish this would be to modify utils/packs.mjs and add data.sort = 0; as the final line in the cleanPackEntry function:
  if ( data.label ) data.label = cleanString(data.label);
  if ( data.name ) data.name = cleanString(data.name);
  data.sort = 0;
}

Then just run gulp cleanPacks and all of the packs will get the updated sort value data.

I have made the change to the utils/packs.mjs file @arbron.

Implemented in https://github.com/foundryvtt/dnd5e/commit/16c334a752ffc62a24d348ddb25ca04c63b6551b


Automate checking Sign-off flag

As a developer
I want to describe how to automate checking for the sign-off flags in commits (locally or remote)
So I don't have to check this manually
Acceptance criteria:

Document how to do this in the Contributing repo.

@Flurb is this still relevant?

@Sander3003 yes, but it's more a nice-to-have feature.

Is it allowed to sign off with a GPG Key?
Because then it's possible to auto sign off.
See tip at https://docs.github.com/en/authentication/managing-commit-signature-verification/signing-commits
And https://community.element14.com/technologies/security/b/blog/posts/git-sign-your-commits-with-a-certificate how to configure and add a GPG Key.

Sounds as a good solution. We could try this.

GPG Key is not a alternative for the purpose done in LF Energy, so developers need to add the -s (--sign-off) to every commit.


APEXMALHAR-2073 fixed the race condition that caused the first key in…

… tbm to be null

@sandeepdeshmukh can you please review and merge. It will be helpful if the bug is fixed in the upcoming release.

@ilooner can you also please verify the changes as my fix affects some changes made by you.
Thanks,
Chandni

@chandnisingh Fix looks good to me

I don't have enough background to review this.
@ilooner Please go ahead and merge it.

I reviewed the changes. It looks fine to me.

@chaithu14 can you please merge. Thanks!

@ilooner thanks for merging!


Add .rbxm as a release target

To enable easier integration with code bases, it would be helpful to be able to download the built package as a .rbxm file from the Releases page. This lets users drag it into studio, which is good for people who aren't using a file system setup.

Completed!


Misleading placeholder variable name: <BOT_FILE_NAME>

It is misleading to document "QNA_CONFIGURATION = '<BOT_FILE_NAME>'; " as a placeholder variable, because the name actually being asked for is "qnamakerService", not their .bot file name. The user is most likely to enter the name of their .bot file in this place.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 2963321c-6720-be8f-aba6-225960eba1b3
Version Independent ID: bff968a7-33a8-bc53-b08b-6c17d672c3cd
Content: Use QnA Maker to answer questions - Bot Service
Content Source: articles/v4sdk/bot-builder-howto-qna.md
Service: bot-service
Product: bot-framework
GitHub Login: @ivorb
Microsoft Alias: v-ivorb

Hi Sarah,
I see your point. I'll change this to something like <SERVICE_NAME_FROM_.BOT_FILE> to make it more clear. You'll see this change live the next time the updated doc file is merged.
Thanks for helping us improve our Docs!


PowerToys Run - Query history is still collected even when the History plugin is disabled

Microsoft PowerToys version
0.81.1
Installation method
WinGet
Running as admin
Yes
Area(s) with issue?
PowerToys Run
Steps to reproduce

Disable the History plugin
Run something through PowerToys Run
Re-enable the History plugin
Type !! in PowerToys Run and observe that what you ran was still collected and stored in history

✔ Expected Behavior
I expected command history to not be collected while the History plugin is disabled
❌ Actual Behavior
When the History plugin is disabled, command history is still being collected and stored in %localappdata%\Microsoft\PowerToys\PowerToys Run\Settings\QueryHistory.json
Other Software
No response

This is currently by design. The plugin is only a solution to access the history.

This is currently by design. The plugin is only a solution to access the history.

That's kinda ridiculous. It's common sense that disabling History one should expect it to not be collected. If it is by design then consider it a feature request so that sensitive commands are not stored in a plain text file that is not made known to the end user.


⚠ Bofrost.fr has degraded performance

In fd6a141, Bofrost.fr (https://www.bofrost.fr) experienced degraded performance:

HTTP code: 200
Response time: 1119 ms

Resolved: Bofrost.fr performance has improved in b8c10f1.


DevicePlugin keeps Terminating

Hi,
I am facing a problem here with the DevicePlugin. It starts normally and the logs look fine. However after a couple of secs/mins the Pod gets terminated without any error.
I am using your modulus daemonset and the latest GKE device plugin.
Any idea what is going on there? Is this the normal behaviour?
Thanks,
Andreas

@afritzler which GKE device plugin configuration? the one in the Kubernetes addons repo? https://github.com/kubernetes/kubernetes/blob/master/cluster/addons/device-plugins/nvidia-gpu/daemonset.yaml can you share your configs?

Looking through your repo, I see that you just bumped the tags in your configs a few hours ago [0]. I see that the device plugin version now differs from what's in master of the Kubernetes repo. I would advise you stay up to date with master. Nevertheless, I tested your config on my cluster and the device plugin pods are not restarting or crash-looping.
The NVIDIA driver installers do not directly interact with the device plugin; they are responsible for placing libraries on disk and creating NVIDIA device nodes which are then discovered by the device plugin. The only way that modulus could be causing your device plugin to fail could be if the libraries are not where you they are or if the device nodes were not being created correctly. Even in both of those case, device plugin should not crash but your GPU workloads would simply not work because the wrong directories are mounted in, or the device plugin would not find any devices and your workloads would be unschedulable.
[0[ https://github.com/afritzler/kubernetes-gpu/commit/594523c3ab8776cdce3bb976f45b79e5f7432405

The thing is, once modulus installs the drivers and the device plugin is initialised there is a short moment where I can launch my tensorflow deployment on this node. Inside the container everything looks fine. I can run nvidia-smi, TF training jobs etc.
The device plugin logs (as long as it's running are looking fine - registering, detecting devices etc.)
Let me try to grab the logs from the host.

This is how it looks like when the device plugin is started
I0524 09:13:07.628787       1 nvidia_gpu.go:40] device-plugin started
I0524 09:13:07.629407       1 manager.go:79] Found Nvidia GPU "nvidia0"
I0524 09:13:07.629497       1 manager.go:130] will use alpha API
I0524 09:13:07.629515       1 manager.go:144] starting device-plugin server at: /device-plugin/nvidiaGPU-1527153187.sock
I0524 09:13:07.629755       1 manager.go:173] device-plugin server started serving
I0524 09:13:07.630412       1 manager.go:177] falling back to v1beta1 API
I0524 09:13:07.726610       1 manager.go:185] device-plugin registered with the kubelet
I0524 09:13:07.726704       1 beta_plugin.go:38] device-plugin: ListAndWatch start
I0524 09:13:07.726734       1 beta_plugin.go:46] ListAndWatch: send devices &ListAndWatchResponse{Devices:[&Device{ID:nvidia0,Health:Healthy,}],```

When I understood the device plugin framework correctly, this should be a process running permanently on the host?

Here is the output
Name:           nvidia-gpu-device-plugin-5794r
Namespace:      kube-system
Node:           ip-10-250-30-16.eu-west-1.compute.internal/<IP_ADDRESS>
Start Time:     Thu, 24 May 2018 13:51:44 +0200
Labels:         controller-revision-hash=148025000
                k8s-app=nvidia-gpu-device-plugin
                pod-template-generation=1
Annotations:    cni.projectcalico.org/podIP=<IP_ADDRESS>/32
                scheduler.alpha.kubernetes.io/critical-pod=
Status:         Running
IP:             <IP_ADDRESS>
Controlled By:  DaemonSet/nvidia-gpu-device-plugin
Containers:
  nvidia-gpu-device-plugin:
    Container ID:  docker://dbd138c4e538dd6fb0251d37858963570a85e86529e8c2afed941904b0367c7b
    Image:         k8s.gcr.io/nvidia-gpu-device-plugin@sha256:0842734032018be107fa2490c98156992911e3e1f2a21e059ff0105b07dd8e9e
    Image ID:      docker-pullable://k8s.gcr.io/nvidia-gpu-device-plugin@sha256:0842734032018be107fa2490c98156992911e3e1f2a21e059ff0105b07dd8e9e
    Port:          <none>
    Host Port:     <none>
    Command:
      /usr/bin/nvidia-gpu-device-plugin
      -logtostderr
      -host-path=/opt/drivers/nvidia
    State:          Running
      Started:      Thu, 24 May 2018 13:51:46 +0200
    Ready:          True
    Restart Count:  0
    Limits:
      cpu:     50m
      memory:  10Mi
    Requests:
      cpu:        50m
      memory:     10Mi
    Environment:  <none>
    Mounts:
      /dev from dev (rw)
      /device-plugin from device-plugin (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from default-token-f92dj (ro)
Conditions:
  Type           Status
  Initialized    True
  Ready          True
  PodScheduled   True
Volumes:
  device-plugin:
    Type:          HostPath (bare host directory volume)
    Path:          /var/lib/kubelet/device-plugins
    HostPathType:
  dev:
    Type:          HostPath (bare host directory volume)
    Path:          /dev
    HostPathType:
  default-token-f92dj:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  default-token-f92dj
    Optional:    false
QoS Class:       Guaranteed
Node-Selectors:  <none>
Tolerations:     :NoExecute
                 :NoSchedule
                 :NoExecute
                 :NoSchedule
                 node.kubernetes.io/disk-pressure:NoSchedule
                 node.kubernetes.io/memory-pressure:NoSchedule
                 node.kubernetes.io/not-ready:NoExecute
                 node.kubernetes.io/unreachable:NoExecute
Events:
  Type    Reason                 Age        From                                                 Message
  ----    ------                 ----       ----                                                 -------
  Normal  SuccessfulMountVolume  <invalid>  kubelet, ip-10-250-30-16.eu-west-1.compute.internal  MountVolume.SetUp succeeded for volume "device-plugin"
  Normal  SuccessfulMountVolume  <invalid>  kubelet, ip-10-250-30-16.eu-west-1.compute.internal  MountVolume.SetUp succeeded for volume "dev"
  Normal  SuccessfulMountVolume  <invalid>  kubelet, ip-10-250-30-16.eu-west-1.compute.internal  MountVolume.SetUp succeeded for volume "default-token-f92dj"
  Normal  Pulled                 <invalid>  kubelet, ip-10-250-30-16.eu-west-1.compute.internal  Container image "k8s.gcr.io/nvidia-gpu-device-plugin@sha256:0842734032018be107fa2490c98156992911e3e1f2a21e059ff0105b07dd8e9e" already present on machine
  Normal  Created                <invalid>  kubelet, ip-10-250-30-16.eu-west-1.compute.internal  Created container
  Normal  Started                <invalid>  kubelet, ip-10-250-30-16.eu-west-1.compute.internal  Started container

In the kubelet logs I found this
kubelet_pods.go:1121] Killing unwanted pod "nvidia-gpu-device-plugin-btrpv"

Interesting. Looks like something is causing the pod to not be scheduled to your node. You may need to pull scheduler and controller-manager logs as well. This is confirming the theory that this issue particular to your cluster configuration and unrelated to modulus.

Btw. I just had a look on what the init container is doing during installation:
Creating directory NVIDIA-Linux-x86_64-390.48
Verifying archive integrity... OK
Uncompressing NVIDIA Accelerated Graphics Driver for Linux-x86_64 390.48........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
/tmp/nvidia/NVIDIA-Linux-x86_64-390.48 /tmp/nvidia /

WARNING: nvidia-installer was forced to guess the X library path '/usr/lib'
         and X module path '/usr/lib/xorg/modules'; these paths were not
         queryable from the system.  If X fails to find the NVIDIA X driver
         module, please install the `pkg-config` utility and the X.Org
         SDK/development package for your distribution and reinstall the
         driver.

WARNING: Unable to find a suitable destination to install 32-bit
         compatibility libraries. Your system may not be set up for 32-bit
         compatibility. 32-bit compatibility files will not be installed;
         if you wish to install them, re-run the installation and set a
         valid directory with the --compat32-libdir option.

ERROR: Unable to load the 'nvidia-drm' kernel module.

ERROR: Installation has failed.  Please see the file
       '/tmp/nvidia/NVIDIA-Linux-x86_64-390.48/nvidia-installer.log' for
       details.  You may find suggestions on fixing installation problems
       in the README available on the Linux driver download page at
       www.nvidia.com.

Successfully compiled NVIDIA modules
Archiving assets
depmod: WARNING: could not open /opt/drivers/nvidia/lib/modules/4.14.42-coreos/modules.order: No such file or directory
depmod: WARNING: could not open /opt/drivers/nvidia/lib/modules/4.14.42-coreos/modules.builtin: No such file or directory
modprobe: ERROR: ../libkmod/libkmod.c:514 lookup_builtin_file() could not open builtin file '/opt/drivers/nvidia/lib/modules/4.14.42-coreos/modules.builtin.bin'
modprobe: ERROR: ../libkmod/libkmod.c:514 lookup_builtin_file() could not open builtin file '/opt/drivers/nvidia/lib/modules/4.14.42-coreos/modules.builtin.bin'

Looks kinda odd, however if I do an lsmod:
nvidia_drm             16384  0
nvidia_modeset       1110016  0
nvidia_uvm            860160  0
nvidia              14372864  8 nvidia_modeset,nvidia_uvm

things look fine. I can also run a TF container on top without a problem.

Ok, so after removing the addon label things seem to work now. Device plugin is not killed + node capacity + allocatable is correctly updated by the kubelet.

I am glad you figured it out. The addon manager can produce unintuitive results, e.g. when you update manifests in the API but not on disk.
ERROR: Unable to load the 'nvidia-drm' kernel module.

This is likely some conflict with the BIOS settings on the machine, e.g. secure boot is enabled. These errors are ignored since the rest of the drivers still work so if you do not need DRM then everything else works. Future work is cleaning up the noisy depmod/modprobe output.
Closing for now, @afritzler.

Thanks a lot again! I will open an issue regarding the addon label in the GKE repo.


Method to wrap workflow into docker images.

Something like this:

User provide interpreter and possibly packages to use (e.g. R and related packages, through partial Dockerfile recipes. We can have a library for such things.
User provide a workflow and resources to add.
We write a complete Dockerfile, and build an image from it.

The end product is that users can do
docker run my_workflow options

Note that the docker image contains all the interpreters so the end product could be highly reproducible.

I'd suggest for starters we provide a good base image -- something like mdabioinfo/sos but importantly by default we install docker inside of it. The idea is to make it possible to dockerize workflows that uses docker images itself. That way users are encouraged to make very modularized workflows that mostly calls and uses existing other docker images for each step, if the users choose to do it.

See some discussions #951 . Other than proper volume mounting, the rest of the process are straightforward to do outside SoS.


chore: release main

:robot: I have created a release beep boop
baggie: 2.4.0
2.4.0 (2024-01-16)
Features

react: Add FadeContent (24b35f7)

react: 1.3.0
1.3.0 (2024-01-16)
Features

react: Add FadeContent (24b35f7)

This PR was generated with Release Please. See documentation.

:robot: Release is at https://github.com/saxofonsolo/baggie/releases/tag/baggie-v2.4.0 :sunflower:

:robot: Release is at https://github.com/saxofonsolo/baggie/releases/tag/react-v1.3.0 :sunflower:


Is it possible to modify ohif's configuration in its docker image after the build step?

Hello, yesterday I tried to upgrade from version 1 to version 2. Since there is a docker image available, I tried to use this distribution method.
Unfortunately, I didn't find a way to modify basic configuration ( the ip address of the PACS server), without rebuilding the docker image from a modified Dockerfile.
I tried the following, as the documentation suggests at https://hub.docker.com/r/ohif/viewer, but it didn't work:
`
FROM ohif/viewer:v<IP_ADDRESS>9
RUN rm /usr/share/nginx/html/config/*
ADD ohif.js /usr/share/nginx/html/config/default.js
`
The next thing I can try is modifying this line in the main image's Dockerfile:
https://github.com/OHIF/Viewers/blob/master/Dockerfile#L38
Or, alternatively, modifying the config file the Dockerfile refers to:
https://github.com/OHIF/Viewers/blob/master/public/config/default.js
After doing either, I would run the docker build command and I would have a docker image with my configuration baked in it, any time I needed to configure
Before I proceed with this steps, I want to make sure whether there is a way to use ohif's docker image without cloning the repo and rebuilding the image.
Thank you.

@TZubiri, the web application pulls in default.js and uses the configuration it contains. That would be the approach I would recommend. If you're having issues getting it to work, chances are the documentation is slightly outdated -- possibly filenames or locations in the container.
It may be some time before I can look into the exact issue, but hopefully this info helps.

I'll go ahead and clone the repo and rebuild the image with my configuration.
If you want to look at this, I'd suggest you try to change something about the configuration with a new Dockerfile, like so:
FROM ohif/viewer:latest ADD customconfig.js /path/to/default.js
I haven't been able to do so yet, I'll update this thread and the documentation if I manage to do it.

Solved!
I must have made a mistake before, because the Dockerfile I wrote in the OP worked fine:

FROM ohif/viewer:v<IP_ADDRESS>9
RUN rm /usr/share/nginx/html/config/*
ADD ohif.js /usr/share/nginx/html/config/default.js

I can even make of the config folder a volume and change the configuration without rebuilding my derived image or even restarting my container:

sudo docker run -td -p 80:80 -v config:/usr/share/nginx/html/config myohif

Excellent job!

Although it's closed another approach. Mounting /usr/share/nginx/html to a external folder ./data or even only the required config file on the host in order to edit for example the app-config.js is possible, results however in an empty folder.
Solution:

Start Container without mounting the volume
docker cp CONTAINERNAME:/usr/share/nginx/html ./data
Stop container
edit app-config.js
Restart container mounting the volume

This seems solved, the docker page mentions:
"To configure The OHIF Viewer, you can replace the configuration file located at:
/usr/share/nginx/html/app-config.js with your own."
@mh33dev
Could you test whether this official method works? I haven't used ohif in a while.


Error when building on MacOS: "error creating aufs mount"

When running the builder instruction from here under MacOS, I get the following error:
error creating aufs mount to /var/lib/docker/aufs/mnt/ab197f71211cb833b324b17e75c0ba2e0a7f7b2599410238980a9e2b5aa27c9d-init: invalid argument

The solution I found was in this issue: go to Docker-for-mac preferences > Daemon > Advanced, and add in the "storage-driver": "aufs" key
{
    ... might have other keys already,
    "storage-driver" : "aufs"
}

Feel free to close this issue (or maybe add the solution to the builder/README?), I created it to document the solution in case other people have the same issue :)

Would be nice, yes. You can also use the local docker and map the docker.sock into builder.

This error seem to occur on Ubuntu 18.04 for me (I did the change as written above to change to aufs).
Is there some specific reason this aufs error occurs?