Dimensionality reduction clumps all but one point together

I'm able to reduce the mnist data reduction as in the description, but the output of the program for my own data is producing nonsense. Any leads appreciated. Running on OS X.
The output of LargeVis is one outlier point, with all other points in a very tightly-clumped diagonal line: first 10 lines of the file are here.  All the remaining points are right next to the last 8 points here.
10000 2
-57.236931 0.250471
1.739228 0.140431
1.739322 0.140431
1.739219 0.140431
1.739558 0.140430
1.739269 0.140430
1.739119 0.140431
1.739207 0.140431
1.739546 0.140430

Perhaps I'm not understanding some particularity of the input data format? Here's what a sample of that looks like: the format appears to me the same as the mnist, except that I have negative numbers. The full test set (20MB) is here.
➜  Linux git:(master) ✗ head ../as_text.txt| cut -c 1-140
10000 640
0.068507 0.088455 0.004352 0.062336 -0.008105 -0.065166 0.005332 -0.004465 0.009418 0.053710 0.021793 0.002761 -0.045826 0.047004 -0.021048
0.030815 0.061551 0.055325 0.014904 0.009537 0.003453 -0.041773 0.070575 0.004215 0.034589 0.026759 0.009715 -0.037361 0.003642 -0.062977 -0
0.044672 0.028437 0.024890 -0.025580 -0.002071 -0.013081 -0.038324 0.007230 0.024878 -0.006843 -0.022699 -0.018267 -0.048828 0.053914 -0.038
-0.003441 0.067980 0.047075 -0.006172 -0.017513 0.022899 0.013291 0.032307 -0.071118 -0.007152 0.019992 -0.019428 -0.069072 0.058524 0.01285
-0.010718 -0.002089 -0.008822 -0.035114 -0.066692 0.038011 -0.019087 0.011121 -0.029621 -0.024403 -0.052654 0.047402 0.006711 -0.064290 -0.0
0.052364 -0.007353 0.006950 0.039280 0.018387 -0.083283 -0.038789 0.022860 -0.029142 0.029422 0.011834 0.073171 -0.025516 0.064107 -0.001747
-0.029875 0.070031 -0.011460 -0.003957 0.025676 0.002881 0.041085 0.009806 0.015105 -0.051295 -0.029721 -0.003456 -0.072049 0.012853 0.05745
0.007060 0.103973 0.024584 0.031729 -0.031754 -0.024805 0.051161 0.042864 -0.021417 0.027601 0.017241 -0.017261 -0.043754 0.008115 -0.017126
-0.055455 -0.063698 0.063268 0.012776 0.005479 -0.033595 -0.063750 0.038983 -0.025671 -0.002447 0.044772 -0.005042 -0.047169 0.030342 0.0006

same here,
an out-liar in the first row.
and even i remove the first row in dataset, the outlier will still happen in the new first row....

Sounds like a line-encoding issue.
@lferry007 used Linux box for development, so he may not be accounting for Mac OS line ending differences in the code.  It is a simple fix.

Confirmed something about OS seems likely. I just ran the same file on my Linux machine, and it does work there. What would the fix be?

Confirmed something about OS seems likely. I just ran the same file on my Linux machine, and it does work there. What would the fix be?

@bmschmidt Try to reduce the sample size. Works for me in some cases.

@asxzy: Yeah, eliminating most of the points does make it run; 100K and 25K points fail, but with just 5K points the program is able to run with normal-looking results on OS X. (The real data here is 1 to 5 million points--any smaller and T-SNE is fine for my purposes.)
Hard to see where the point of failure is, though. A single run takes too long for it to be practical to find if its an individual row or a threshold size where it breaks.

Seeing similar behavior on a Windows OS.
@asxzy is this the -samples parameter? Just confirming how it is supposed to be set up- if I have 1 million records, -samples is set to 1e6/1e8 by default, correct? I've been trying this without luck so I may have misunderstood something.
Also I have noticed that test knn accuracy has been reporting 0% when I get this result.

@bmschmidt  The link of your data set does not work now. Could you provide a new link? BTW, we've fixed some of the bugs and you may rerun the code on your data set. If there's still a problem, please let us now.
Thanks,
Jian
https://sites.google.com/site/pkujiantang/home

I just pulled and retested and still (unfortunately) experiencing this issue. I've restored a (smaller) failing sample file under OS X to that link.

We checked the data. It is the problem of data format. In your first line, it indicates there are 1000 lines of data. We change it to 99, and the visualization looks ok now. To generate meaningful visualizations, you may need to upload the entire data set.
Jian

Oh no, in my rush to replace the online I uploaded a truncated version. This was not the original problem. I'm terribly sorry to have wasted your time on that file, and wouldn't blame you for giving up on me now.
If not, I replaced that link with the full 10,000 row set, and it still fails to compile. Pasted below is console output of different behavior under Ubuntu 14.04 and Mac OS X. As you can see, the same SHA1 hash on the input file produces good results in Ubuntu, but bad ones in OS X.
Succeeding, Ubuntu 14.04
bschmidt@sibelius:~/LargeVis/Linux$ openssl sha1 failing_largevis.txt
SHA1(failing_largevis.txt)= a4b3b7893a5b8f4ef29d82901ae3cb5f654a9abd
bschmidt@sibelius:~/LargeVis/Linux$ wc -l failing_largevis.txt
10001 failing_largevis.txt
bschmidt@sibelius:~/LargeVis/Linux$ head -1 failing_largevis.txt
10000 640
bschmidt@sibelius:~/LargeVis/Linux$ ./LargeVis -input failing_largevis.txt -output t.txt -outdim 2 -samples 100
Reading input file failing_largevis.txt ...... Done.
Total vertices : 10000  Dimension : 640
Normalizing ...... Done.
Running ANNOY ...... Done.
Running propagation 3/3
Test knn accuracy : 99.81%
Computing similarities ...... Done.
Fitting model   Alpha: 0.000700 Progress: 99.930%

bschmidt@sibelius:~/LargeVis/Linux$ head t.txt
10000 2
-14.740220 -5.766308
-1.294758 3.144548
-4.635156 9.079961
-9.019074 -10.023488
16.997780 25.454086
-25.735485 -14.697220
-3.328367 -14.550834
-4.309145 -9.262841
-37.779449 6.267919

Failing, OS X
-bash-3.2$ openssl sha1 failing_largevis.txt
SHA1(failing_largevis.txt)= a4b3b7893a5b8f4ef29d82901ae3cb5f654a9abd
-bash-3.2$ wc -l failing_largevis.txt
   10001 failing_largevis.txt
-bash-3.2$ ./LargeVis -input failing_largevis.txt -output t.txt -outdim 2 -samples 100
Reading input file failing_largevis.txt ...... Done.
Total vertices : 10000	Dimension : 640
Normalizing ...... Done.
Running ANNOY ...... Done.
Running propagation 3/3
Test knn accuracy : 99.81%
Computing similarities ...... Done.
Fitting model	Alpha: 0.000700 Progress: 99.930%

bash-3.2$ head t.txt
10000 2
-76.238503 -7.682394
0.147972 0.035222
0.147989 0.035224
0.147941 0.035219
0.148011 0.035226
0.147880 0.035213
0.147879 0.035213
0.147913 0.035216
0.147693 0.035194

I have the same issue using Ubuntu 15.10. Has anyone solved this yet?
After running Largevis on my dataset, the first point is orders of magnitude larger than the remaining points after dimensionality reduction, resulting in a meaningless plot.
root@blah-VirtualBox:/home/blah/Desktop/LargeVis/20161012# ./LargeVis -input 1k_points.txt -output 1k_2d.txt
Reading input file 1k_points.txt ...... Done.
Total vertices : 1000	Dimension : 64
Normalizing ...... Done.
Running ANNOY ...... Done.
Running propagation 3/3
Test knn accuracy : 95.98%
Computing similarities ...... Done.
Fitting model	Alpha: 0.000100 Progress: 99.993%
root@blah-VirtualBox:/home/blah/Desktop/LargeVis/20161012#
========================================================
root@blah-VirtualBox:/home/blah/Desktop/LargeVis/20161012# head 1k_2d.txt
1000 2
-31.457289 -0.287726
12.466423 -0.287530
12.466411 -0.287530
12.466626 -0.287530
12.466501 -0.287530
12.466530 -0.287530
12.466509 -0.287530
12.466496 -0.287530
12.466705 -0.287530
=========================================
Here is a link to the input data:
https://www.dropbox.com/s/bvup56przujg52d/1k_points.txt?dl=0
And a link to the Largevis output:
https://www.dropbox.com/s/jk2p0qof2sn7hr9/1k_2d.txt?dl=0
Any guidance would be greatly appreciated. Thank you!

Guys - @spamcatcher345 posted his data on my git, so I took a look and tried it out with my implementation.  In the first place, the data that was uploaded doesn't have 64 dimensions, it has 58.  I don't know whether that would affect the output with @lferry007's implementation.  Also, the data has 18 duplicates.
When I run my implementation of largeVis on it, what I get looks gaussian.
How was this data generated?

Using this data on Ubuntu 14.04 and @lferry007's implementation, I find that

I do get the problem when using the data as currently displayed
I get a good embedding (no outlier) when I change the header row to reflect it having 58 dimensions.

On OS X, it also works when properly labeled.

What do you mean by a "good" embedding?

By "good," I mean it does not have the first point as an extreme outlier with no structure in all later points; instead, it looks like T-SNE does when run on data that has some internal structure. So validating by looking at it: here's thje plot.

A mighty "slap" rang out across the land.   ./facepalm
Somewhere along the way, while moving files around VMs/hosts/networks, I somehow managed to drop the last 6 columns when creating the 1k sample data... Testing again with 58 dimensions worked in my Ubuntu 15.10 VM, compiled with the current version of GSL. Once it worked with the 1k sample data, I went back to the original data set (which DOES have 64 dimensions) and uncovered a few other self-induced issues caused by the formatting/etl I was doing. Happy to report success with 20k rows of input data. Next step is scaling up to 1-10M+ rows.
A few notes I've made along the way, in case it may help someone else in the future:
--Individual vectors must have digits of precision. Eg: Zeros (0) must be represented as 0.000000
--Execution will fail (core dump) if you have MORE than the actual number of dimensions defined in the first line of the input file.
--Execution will not fail if you have LESS than the actual number of dimensions defined in the first line of the input file. (Up to a certain point. When I define 5 dimensions on a set with 64, it fails. When I define 25 dimensions on a set with 64, it succeeds. Not sure what this does to the end result, but it cant be "right")
^^^Suggest bug fix/enhancement here - either better error checking & description or, better yet, parse the file for the correct number of rows & dimensions as part of execution
--Generally speaking, there is a need for descriptive error handling. Any number of issues with data or config or otherwise result in the same screen output: Segmentation fault (core dumped) . Advice for others: Be absolutely meticulous.
Thanks again @elbamos , @bmschmidt and @lferry007 ! This has gotten me past the bottleneck of t-SNE for this project. Oh, @elbamos - this is being generated from spam email data, labeled by k-means.

Hello again @bmschmidt, @lferry007, @elbamos & all,
Could someone please test this sample data with their own installation of Largevis and let me know if it works for you?
https://www.dropbox.com/s/fky8qec7mf3elfe/50k_500c_1000i_points.zip?dl=0
I've been been going rounds with this, and no luck so far. At some indeterminate point, dependent on the data set, the dimensionality reduction fails and reverts to the symptoms above.
TLDR below, so that you know i've done my homework before asking....
Thanks again in advance.
<begin_TLDR>
--make sure the number of rows specified in the infile header row exactly matches number of rows in the file
wc -l 50k_500c_1000i_points.txt
50000 50k_500c_1000i_points.txt
--make sure all rows have the same number of features
while read i; do echo $i | tr ' ' '\n' | wc -l; done < 50k_500c_1000i_points.txt | sort | uniq -c | sort -nr
50000 64
--make sure all values are between 0-1, no funny chars, text, etc.
root@blah-VirtualBox:/media/sf_Share/50k_points_master_data/test# cat 50k_500c_1000i_points.txt | tr ' ' '\n' | sort | head
0.00000000
0.00000000
0.00000000
0.00000000
0.00000000
0.00000000
0.00000000
0.00000000
0.00000000
0.00000000
root@blah-VirtualBox:/media/sf_Share/50k_points_master_data/test# cat 50k_500c_1000i_points.txt | tr ' ' '\n' | sort | tail
1.00000000
1.00000000
1.00000000
1.00000000
1.00000000
1.00000000
1.00000000
1.00000000
==========================================================================
--Run Largevis on all 50k rows  (results in garbage out)
root@blah-VirtualBox:/media/sf_Share/50k_points_master_data/test# ./LargeVis -input 50k_500c_1000i_points.txt -output 50k_2d -samples 10
Reading input file 50k_500c_1000i_points.txt ...... Done.
Total vertices : 50000	Dimension : 64
Normalizing ...... Done.
Running ANNOY ...... Done.
Running propagation 3/3
Test knn accuracy : 94.87%
Computing similarities ...... Done.
Fitting model	Alpha: 0.007901 Progress: 99.210%
root@blah-VirtualBox:/media/sf_Share/50k_points_master_data/test# head 50k_2d
50000 2
-93.259697 92.923935
0.004132 -0.007910
0.005585 -0.003991
0.005309 -0.004095
0.005638 -0.003910
0.003409 -0.001608
0.005987 -0.003725
0.001725 -0.003395
0.002095 -0.003146
==========================================================================
--So, lets try a sample set of the first 10k rows from the same file
root@blah-VirtualBox:/media/sf_Share/50k_points_master_data/test# head -10000 50k_500c_1000i_points.txt > 10k_500c_1000i_points.txt
root@blah-VirtualBox:/media/sf_Share/50k_points_master_data/test# ll
-rwxrwx--- 1 root vboxsf  7050000 Oct 26 16:36 10k_500c_1000i_points.txt*
-rwxrwx--- 1 root vboxsf 35250000 Oct 19 12:49 50k_500c_1000i_points.txt*
==========================================================================
--Run Largevis on the first 10k rows (results in success)
root@blah-VirtualBox:/media/sf_Share/50k_points_master_data/test# ./LargeVis -input 10k_500c_1000i_points.txt -output 10k_2d -samples 10
Reading input file 10k_500c_1000i_points.txt ...... Done.
Total vertices : 10000	Dimension : 64
Normalizing ...... Done.
Running ANNOY ...... Done.
Running propagation 3/3
Test knn accuracy : 97.99%
Computing similarities ...... Done.
 Done.
Total vertices : 25000	Dimension : 64
Normalizing ...... Done.
Running ANNOY ...... Done.
Running propagation 3/3
Test knn accuracy : 97.83%
Computing similarities ...... Done.
Fitting model	Alpha: 0.007901 Progress: 99.210%
root@blah-VirtualBox:/media/sf_Share/50k_points_master_data/test# head 25k_2d
25000 2
-97.675056 87.540543
-0.002500 -0.015151
0.006426 -0.008289
0.006369 -0.008438
0.006459 -0.008278
0.010856 -0.011586
0.006840 -0.008010
0.007054 -0.009687
0.006959 -0.009642
Try with 12k, 15k, 17k, 18k, 19k, and so forth...
==========================================================================
It doesnt appear to be caused by the number of rows or number of dimensions. I've run the mnist data successfully, as well as randomly generated 100-dimensional x 50,000 rows of both integers and floats. I've tried changing digits of precision from 2-8 with no effect.
What I'm struggling with is that the cutoff point at which it starts producing garbage out is dependent on the data set. I've had successful runs of 20k rows from a different dataset, but this one stops working after 17998 rows:
root@blah-VirtualBox:/media/sf_Share/50k_points_master_data/test# head -17999 50k_500c_1000i_points.txt > 17998_500c_1000i_points.txt
root@blah-VirtualBox:/media/sf_Share/50k_points_master_data/test# vi 17998_500c_1000i_points.txt
root@blah-VirtualBox:/media/sf_Share/50k_points_master_data/test# ./LargeVis -input 17998_500c_1000i_points.txt -output 17998_2d -samples 10
Reading input file 17998_500c_1000i_points.txt ...... Done.
Total vertices : 17998	Dimension : 64
Normalizing ...... Done.
Running ANNOY ...... Done.
Running propagation 3/3
Test knn accuracy : 95.96%
Computing similarities ...... Done.
Fitting model	Alpha: 0.007901 Progress: 99.210%
root@blah-VirtualBox:/media/sf_Share/50k_points_master_data/test# head 17998_2d
17998 2
-4.273000 -5.816042
-9.945149 12.071325
6.342212 6.314149
5.711284 -5.599425
-14.465376 -2.408209
-1.881844 -0.892462
-7.527262 12.491118
2.002883 -5.556159
13.538328 6.924161
It core dumps on 17999 rows:
root@blah-VirtualBox:/media/sf_Share/50k_points_master_data/test# ./LargeVis -input 17999_500c_1000i_points.txt -output 17999_2d -samples 10
Reading input file 17999_500c_1000i_points.txt ...... Done.
Total vertices : 17999	Dimension : 64
Normalizing ...... Done.
Running ANNOY ......Segmentation fault (core dumped)
==========================================================================
And at 18000 rows, its back to garbage out:
root@blah-VirtualBox:/media/sf_Share/50k_points_master_data/test# head 18k_2d
18000 2
-123.057167 -62.150906
0.013629 0.007195
0.010898 0.006385
0.010933 0.006196
0.010904 0.006396
0.004929 0.011840
0.010916 0.006575
0.011646 0.003596
0.011509 0.003789
<end_TLDR>

If it doesn't visualize with the reference implementation it's exceedingly unlikely that it would work with my implementation. If you'd like to give it a try it should take about 10 minutes to code reading in this data and another 15 to get results.

On Oct 26, 2016, at 7:30 PM, spamcatcher345<EMAIL_ADDRESS>wrote:
Hello again @bmschmidt, @lferry007, @elbamos & all,
Could someone please test this sample data with their own installation of Largevis and let me know if it works for you?
https://www.dropbox.com/s/fky8qec7mf3elfe/50k_500c_1000i_points.zip?dl=0
I've been been going rounds with this, and no luck so far. At some indeterminate point, dependent on the data set, the dimensionality reduction fails and reverts to the symptoms above.
TLDR below, so that you know i've done my homework before asking....
Thanks again in advance.
--make sure the number of rows specified in the infile header row exactly matches number of rows in the file
wc -l 50k_500c_1000i_points.txt
50000 50k_500c_1000i_points.txt
--make sure all rows have the same number of features
while read i; do echo $i | tr ' ' '\n' | wc -l; done < 50k_500c_1000i_points.txt | sort | uniq -c | sort -nr
50000 64
--make sure all values are between 0-1, no funny chars, text, etc.
root@blah-VirtualBox:/media/sf_Share/50k_points_master_data/test# cat 50k_500c_1000i_points.txt | tr ' ' '\n' | sort | head
0.00000000
0.00000000
0.00000000
0.00000000
0.00000000
0.00000000
0.00000000
0.00000000
0.00000000
0.00000000
root@blah-VirtualBox:/media/sf_Share/50k_points_master_data/test# cat 50k_500c_1000i_points.txt | tr ' ' '\n' | sort | tail
1.00000000
1.00000000
1.00000000
1.00000000
1.00000000
1.00000000
1.00000000
1.00000000
--Run Largevis on all 50k rows (results in garbage out)
root@blah-VirtualBox:/media/sf_Share/50k_points_master_data/test# ./LargeVis -input 50k_500c_1000i_points.txt -output 50k_2d -samples 10
Reading input file 50k_500c_1000i_points.txt ...... Done.
Total vertices : 50000 Dimension : 64
Normalizing ...... Done.
Running ANNOY ...... Done.
Running propagation 3/3
Test knn accuracy : 94.87%
Computing similarities ...... Done.
Fitting model Alpha: 0.007901 Progress: 99.210%
root@blah-VirtualBox:/media/sf_Share/50k_points_master_data/test# head 50k_2d
50000 2
-93.259697 92.923935
0.004132 -0.007910
0.005585 -0.003991
0.005309 -0.004095
0.005638 -0.003910
0.003409 -0.001608
0.005987 -0.003725
0.001725 -0.003395
0.002095 -0.003146
--So, lets try a sample set of the first 10k rows from the same file
root@blah-VirtualBox:/media/sf_Share/50k_points_master_data/test# head -10000 50k_500c_1000i_points.txt > 10k_500c_1000i_points.txt
root@blah-VirtualBox:/media/sf_Share/50k_points_master_data/test# ll
-rwxrwx--- 1 root vboxsf 7050000 Oct 26 16:36 10k_500c_1000i_points.txt*
-rwxrwx--- 1 root vboxsf 35250000 Oct 19 12:49 50k_500c_1000i_points.txt*
--Run Largevis on the first 10k rows (results in success)
root@blah-VirtualBox:/media/sf_Share/50k_points_master_data/test# ./LargeVis -input 10k_500c_1000i_points.txt -output 10k_2d -samples 10
Reading input file 10k_500c_1000i_points.txt ...... Done.
Total vertices : 10000 Dimension : 64
Normalizing ...... Done.
Running ANNOY ...... Done.
Running propagation 3/3
Test knn accuracy : 97.99%
Computing similarities ...... Done.
 Done.
Total vertices : 25000 Dimension : 64
Normalizing ...... Done.
Running ANNOY ...... Done.
Running propagation 3/3
Test knn accuracy : 97.83%
Computing similarities ...... Done.
Fitting model Alpha: 0.007901 Progress: 99.210%
root@blah-VirtualBox:/media/sf_Share/50k_points_master_data/test# head 25k_2d
25000 2
-97.675056 87.540543
-0.002500 -0.015151
0.006426 -0.008289
0.006369 -0.008438
0.006459 -0.008278
0.010856 -0.011586
0.006840 -0.008010
0.007054 -0.009687
0.006959 -0.009642
Try with 12k, 15k, 17k, 18k, 19k, and so forth...
It doesnt appear to be caused by the number of rows or number of dimensions. I've run the mnist data successfully, as well as randomly generated 100-dimensional x 50,000 rows of both integers and floats. I've tried changing digits of precision from 2-8 with no effect.
What I'm struggling with is that the cutoff point at which it starts producing garbage out is dependent on the data set. I've had successful runs of 20k rows from a different dataset, but this one stops working after 17998 rows:
root@blah-VirtualBox:/media/sf_Share/50k_points_master_data/test# head -17999 50k_500c_1000i_points.txt > 17998_500c_1000i_points.txt
root@blah-VirtualBox:/media/sf_Share/50k_points_master_data/test# vi 17998_500c_1000i_points.txt
root@blah-VirtualBox:/media/sf_Share/50k_points_master_data/test# ./LargeVis -input 17998_500c_1000i_points.txt -output 17998_2d -samples 10
Reading input file 17998_500c_1000i_points.txt ...... Done.
Total vertices : 17998 Dimension : 64
Normalizing ...... Done.
Running ANNOY ...... Done.
Running propagation 3/3
Test knn accuracy : 95.96%
Computing similarities ...... Done.
Fitting model Alpha: 0.007901 Progress: 99.210%
root@blah-VirtualBox:/media/sf_Share/50k_points_master_data/test# head 17998_2d
17998 2
-4.273000 -5.816042
-9.945149 12.071325
6.342212 6.314149
5.711284 -5.599425
-14.465376 -2.408209
-1.881844 -0.892462
-7.527262 12.491118
2.002883 -5.556159
13.538328 6.924161
It core dumps on 17999 rows:
root@blah-VirtualBox:/media/sf_Share/50k_points_master_data/test# ./LargeVis -input 17999_500c_1000i_points.txt -output 17999_2d -samples 10
Reading input file 17999_500c_1000i_points.txt ...... Done.
Total vertices : 17999 Dimension : 64
Normalizing ...... Done.

Reply to this email directly, view it on GitHub, or mute the thread.

Hi all,
We've updated the code and you can have a try. If there is still a problem, feel free to contact us.
Thanks!

@lferry007 I just went through the diff - am I correct that there are no changes to the implementation of the algorithm after the neighbor search step? Thanks

On Nov 2, 2016, at 10:02 AM, lferry007<EMAIL_ADDRESS>wrote:
Hi all,
We've updated the code and you can have a try. If there is still a problem, feel free to contact us.
Thanks!
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.

==================================================UPDATE 20161102=================================================
root@eric-VirtualBox:/media/sf_Share/50k_points_master_data/For_help# md5sum 50k_500c_1000i_points.txt
32f71633ef2a83764258c0378e9906b5  50k_500c_1000i_points.txt
root@eric-VirtualBox:/media/sf_Share/50k_points_master_data/For_help# ./LargeVis -input 50k_500c_1000i_points.txt -output 50k_2d -samples 10
Reading input file 50k_500c_1000i_points.txt ...... Done.
Total vertices : 50000	Dimension : 64
Normalizing ...... Done.
Running ANNOY ...... Done.
Running propagation 3/3
Test knn accuracy : 94.87%
Computing similarities ...... Done.
Fitting model	Alpha: 0.007901 Progress: 99.210%
root@eric-VirtualBox:/media/sf_Share/50k_points_master_data/For_help# head 50k_2d
50000 2
-126.974144 31.734627
0.011018 0.004690
0.004896 0.003125
0.004526 0.002717
0.005311 0.003130
0.003361 0.000967
0.006694 0.003260
0.003402 -0.003218
0.005849 -0.003446
================Updated to new version=================
root@eric-VirtualBox:/media/sf_Share/50k_points_master_data/For_help# md5sum 50k_500c_1000i_points.txt
32f71633ef2a83764258c0378e9906b5  50k_500c_1000i_points.txt
root@eric-VirtualBox:/media/sf_Share/50k_points_master_data/For_help# ./Largevis -input 50k_500c_1000i_points.txt -output 50k_2d -samples 10
Reading input file 50k_500c_1000i_points.txt ...... Done.
Total vertices : 50000	Dimension : 64
Normalizing ...... Done.
Running ANNOY ...... Done.
Running propagation 3/3
Test knn accuracy : 99.91%
Computing similarities ...... Done.
Fitting model	Alpha: 0.007901 Progress: 99.210%
root@eric-VirtualBox:/media/sf_Share/50k_points_master_data/For_help# head 50k_2d
50000 2
1.729691 -6.422237
-10.387295 1.105057
-10.262017 4.892396
-8.165269 7.217187
-1.564149 -9.366737
7.682181 -4.121569
-4.760568 13.656388
-4.644851 -8.798579
2.579137 10.852392

@spamcatcher345 Glad to know it works! Thanks!
Jian

This fixes the outlier problem on my previously-broken test data as well. Thanks!


DevLog

Idea: Create a library like parse but more multiple data types.
 Paths should be strings. They can always convert their data to strings. Strings benefit from regular expressions
>>> actual_input = 0xabcdef
>>> stringify(actual_input)
'abcdef'
>>> # proceed to route stringified version...

Claim a PyPI name


Gossip config: Get the Gossip Memberlist config from the pilosa config file.

Overview
Get the Gossip Memberlist config from the pilosa config file.
Added: PushPull interval, Gossip Interval, Probe Interval config options

@travisturner This PR does have the default port setting commit, so the feature will work on a single node.  My question is do we want to document these settings, or force users to use our defaults since they controls the fundamental gossip operation.

is this PR still valid, or superseded by later cluster config work @travisturner ?

The concept is still valid, but the config.go structure has changed since this PR was created (Gossip is a now a sub struct within the Config struct), so it's going to require some modification.

The memberlist configuration options that differ between the LAN and WAN configs (in memberlist/config.go) are:
LAN:
    conf.TCPTimeout = 10 * time.Second
    conf.SuspicionMult = 4
    conf.PushPullInterval = 30 * time.Second
    conf.ProbeTimeout = 500 * time.Millisecond
    conf.ProbeInterval = 1 * time.Second
    conf.GossipNodes = 3
    conf.GossipInterval = 200 * time.Millisecond
    conf.GossipToTheDeadTime = 30 * time.Second

WAN:
    conf.TCPTimeout = 30 * time.Second
    conf.SuspicionMult = 6
    conf.PushPullInterval = 60 * time.Second
    conf.ProbeTimeout = 3 * time.Second
    conf.ProbeInterval = 5 * time.Second
    conf.GossipNodes = 4 // Gossip less frequently, but to an additional node
    conf.GossipInterval = 500 * time.Millisecond
    conf.GossipToTheDeadTime = 60 * time.Second

so we should look at each of those and consider adding config support for them.

I incorporated this work in to #1014


Adds clarifying comment to Veg BGC

Helene provided a clarifying statement.

Maybe it would be better to say "see below" instead of referring to the line number (which could change). Along these lines, could add a comment on line 125 that says "See above".
This is a tiny stylistic preference, but I have been trying to include a space for comments: // Some comment..., while for commented out code, omitting the space: //int i=0;

Yeah, it's definitely better to avoid line-specific markers.
I haven't come to a conclusion on whitespace. I tend to avoid extra, as it catches my eye when skimming code, but in this case it does provide a quick difference between comments and code.


Set ETPS provider from load helper

@koenvo now you can set the provider of the EPTS data from load_metadata, however you can't do it from the load helper method load_epts_tracking_data. Wold be nice to have it there as well so you can use this helper without having to set it after the dataset is created.
I can implement this if you agree.

Can we detect it from the file itself? Even an ugly way (like checking existence of certain values in the xml)
When a user has to specify it I’m not sure I see the goal of it.

Yes, you are right. Moreover, there is actually an attribute  in the file for provider <ProviderName>Example</ProviderName> so we can use that to check for known providers. Do you want to leave this one also as a good first issue? I'm in no urgency for this yet.

@bdagnino So basically load_epts_tracking_data should work similar to load_meta_data?

@TK5-Tim not exactly. That's what I originally proposed, but @koenvo suggested a better approach. His proposal is to read the provider from the ETPS metadata file itself when loading the metadata. For that the following background is important:

If you look here you'll see there are 4 providers, for now the only one that metters for the EPTS sreializer is Metrica, because we are the only ones providing data in the EPTS format (at least that we have access to), but this is relevant for this issue.

Then you'll see that load_metadata takes 2 arguments, the metadata_file and the provider if known. In this case the provider won't be known beforehand, because it's declared in the metadata file.

The metadata file, has provider name attribute. In the example file that's on the tests folder of Kloppy it says <ProviderName>Example</ProviderName>, in files from Metrica is says <ProviderName>Metrica Sports</ProviderName>.

So the implementation would be to inside load_metadata read the ProviderName attribute and if it matches Metrica Sports, then set the provider to Provider.METRICA, and otherwise leave it as None. Later on when we get more EPTS files from other providers, we'll need to add there other cases as well.
This should also be tested on a test, for which you can either create a new metadata.xml file where ProviderName is Metrica Sports or change the one already there.
Hope it's clear but let me know if you have any questions!

@bdagnino Thank you very much, now I get the task. Do you prefer still having the argument but having it changed by the file if found in the file or should I take out the argument?
If the provider is not in the XML it would helpful to be able to put it down manually. Otherwise I do not even know if there is any reason not to have the providers name in the XML.

@TK5-Tim great!
Yes, we should leave the option to provide is an an input as well to load_matadata. If there is one provided but a different one in the metadata.xml we should probably raise a warning.

Fixed in https://github.com/PySport/kloppy/pull/52


[fix][ml] There are two same-named managed ledgers in the one broker

Motivation
In PR #17526, we know that a topic can be closed multiple times and that it is possible to have two same-named objects of class Persistenttopic in the same broker instance.
We know that closing the topic triggers the closure of the ManagedLedger. The topic object can be closed multiple times which means the ManagedLedger can be closed multiple times. This PR is used to prove: If a ManagedLedger is closed more than once, and switched ledgerHandle operation of ManagedLedger and method closed executed concurrently, there will be two of the same-named Managedledger in the same broker, possibly with different numbers of cursors.
If both Managedledgers are available and there are different numbers of cursors, this can cause the operation trimLedgers to delete too many ledgers from the meta of ManagedLedger.
Here is the process:

managedLedger_1.close
switch ledgerHandle(managedLedger_1)
create managedLedger_2
create managedLedger_3

close current LedgerHandle

async create new LedgerHandle

do close

set the state to Closed

remove managedLedger_1 from ManagedFactory.ledgers

set current ledger to the new LedgerHandle

set the state to LedgerOpened

do close the second time

create managedLedger_2

put managedLedger_2 to ManagedFactory.ledgers

remove managedLedger_2 from ManagedFactory.ledgers

create cursor_1 into managedLedger_2

create managedLedger_3

put managedLedger_3 to ManagedFactory.ledgers

recover cursor_1 from meta

create cursor_2 into managedLedger_3

has one cursor cursor_1
has two cursor: cursor_1, cursor_2

Modifications

Use Method remove(k,v) instead of remove(k) when deleting ManagedLedger from ManagedLedgerFactroy.ledgers.
fix the wrong state of the closed managed ledger.
release the ledgerHandle, which is created after the ML is closed

Documentation

[ ] doc
[ ] doc-required
[x] doc-not-needed
[ ] doc-complete

Matching PR in forked repository
PR in forked repository:

https://github.com/poorbarcode/pulsar/pull/46

Codecov Report

Merging #18688 (f64173d) into master (5c8f929) will increase coverage by 0.60%.
The diff coverage is 53.05%.

@@             Coverage Diff              @@
##             master   #18688      +/-   ##
============================================
+ Coverage     63.30%   63.90%   +0.60%
+ Complexity    26123     3490   -22633
============================================
  Files          1836     1843       +7
  Lines        134416   135163     +747
  Branches      14772    14859      +87
============================================
+ Hits          85087    86371    +1284
+ Misses        41649    40949     -700
- Partials       7680     7843     +163

Flag
Coverage Δ

inttests
24.70% <5.95%> (-0.18%)
:arrow_down:

systests
25.36% <0.49%> (-0.20%)
:arrow_down:

unittests
61.21% <53.05%> (+0.58%)
:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

...g/apache/pulsar/client/cli/AbstractCmdConsume.java
20.45% <20.45%> (ø)

.../java/org/apache/pulsar/client/cli/CmdConsume.java
40.44% <25.00%> (+8.45%)
:arrow_up:

...ain/java/org/apache/pulsar/client/cli/CmdRead.java
41.13% <41.13%> (ø)

...r/impl/SnapshotSegmentAbortedTxnProcessorImpl.java
62.79% <62.79%> (ø)

...kkeeper/mledger/impl/ManagedLedgerFactoryImpl.java
78.86% <71.42%> (-0.57%)
:arrow_down:

...ransaction/buffer/impl/TopicTransactionBuffer.java
74.27% <85.71%> (+11.77%)
:arrow_up:

...r/service/SystemTopicTxnBufferSnapshotService.java
78.26% <100.00%> (ø)

...er/systopic/NamespaceEventsSystemTopicFactory.java
85.71% <100.00%> (+12.38%)
:arrow_up:

...ransactionBufferSnapshotBaseSystemTopicClient.java
72.36% <100.00%> (+4.36%)
:arrow_up:

...er/impl/SingleSnapshotAbortedTxnProcessorImpl.java
77.65% <100.00%> (+7.00%)
:arrow_up:

... and 217 more

@poorbarcode I assume this PR is still relevant? Please merge latest changes from master and check that tests still pass.

@lhotari

I assume this PR is still relevant?

Yes.

Please merge latest changes from master and check that tests still pass.

Done.
Could you please help review this PR?

Could you please help review this PR?

@poorbarcode The change to production code itself looks good, but I don't like the test. Addressing that would require more changes to ML factory to make it possible to sub class it for tests with test hooks instead of relying on Mockito.

As discussed on the mailing list https://lists.apache.org/thread/w4jzk27qhtosgsz7l9bmhf1t7o9mxjhp, there is no plan to release 2.9.6, so I am going to remove the release/2.9.6 label


Wrong Serialization of JSON callback

Hi there
We were using the branch deep linking and added some extra information to metaData and tags of the GetShortUrl function just to see how the information would look like when installing the app on the second device.
However neither the BranchLinkProperties file nor the BranchUniversalObject had the information we needed. The problem was the faulty serialization of the JSON callback
This is the original code from BranchLinkProperties.cs:
public void loadFromDictionary(Dictionary<string, object> data) {
		if (data == null)
			return;

		if (data.ContainsKey("~tags")) {
            tags = data["~tags"] as List<string>;
        }

But data["~tags"] is a List so we fixed this by:
public void loadFromDictionary(Dictionary<string, object> data) {
		if (data == null)
			return;

		if (data.ContainsKey("~tags")) {
            tags = new List<String>();
            foreach (object tagStr in (List<object>)data["~tags"])
            {
                tags.Add(tagStr.ToString());
            }
        }

Similiar with the metadata  in loadFromDictionary:
if (data.ContainsKey("metadata")) {
			if (data["metadata"] != null) {
				Dictionary<string, object> metaTemp = data["metadata"] as Dictionary<string, object>;

				if (metaTemp != null) {
					foreach(string key in metaTemp.Keys) {
						metadata.Add(key, metaTemp[key] as string);
					}
				}
			}
		}

You try to serialize all values to a string here. So all Lists inside the metadata ($keywords, ~tags) get lost during this serialization.

@DerSnOr what version do you use?

I'm sorry, but I cannot actually find any version number inside the plugin so I can't answer your question.
But the code snippets from BranchUniversalObject.cs and BranchLinkProperties.cs are still the same at the current version here on github.

@DerSnOr you are right about wrong "~tags" parsing, this issue is fixed. Update please SDK.
#34
About "controls_params" and "metadata":

these fields are used for your custom params
you don't need read from "metadata" something like "~tags", "channels" and other params that UniversalObject and LinkProperties have
when you add some "metadata" or "controls_params" into link we know what you added and you can parse by yourself your custom params, we just give you "key":"value" and you transform your "value" as you wish (int, list, etc.)

@antonargunov
Thanks for the fix.
Yeah the thing with the UniversalObject was not really blocking as we had the tags inside the LinkProperties. I just realized that the data got missing during the serialization.

@DerSnOr Great! Thanks!


add main.py to be able to run as script from checkout

So far, after git clone you would not be able to run and debug the source code obtained as relative imports would fail:
$python shamir_mnemonic/cli.py
  File "shamir_mnemonic/cli.py", line 10, in <module>
    from .constants import GROUP_PREFIX_LENGTH_WORDS
ImportError: attempted relative import with no known parent package

Including the script adapter for the package like this, cli script runs nice and smoothly.

you are not supposed to be running cli.py directly, but through the shamir command

you are not supposed to be running cli.py directly, but through the shamir command

So just to clarify, when I'm interested to see the secret splitting or combining process step-by-step, the recommended way is like this:
python setup.py develop
pudb3 my_path_to/python-shamir-mnemonic/.venv/bin/shamir create 2of2

?
That seems workable, although the boilerplate the script starts through felt somewhat overwhelming at first.

Presumably, yes. I mean, for your purpose it might be easier to use the main.py you submitted, but I see no point in including it in the upstream repository.

also bear in mind that a lot of the boilerplate you see comes from Click, which is a library for handling command-line options. You would actually be much better off by writing a simple script that does the steps you want directly, so e.g.:
from shamir_mnemonic import generate_mnemonics

secret = b"my secret"
passphrase = b""
generate_mnemonics(group_threshold=2, groups=[(1,3), (1,1)], master_secret=secret, passphrase=passphrase)


use Connext debug libraries when building with CMAKE_BUILD_TYPE Debug

Replacing #77 (following style). This is orthogonal to the use of the Community edition. It already works with the currently used professional version of Connext.
Since the CI jobs don't build with CMAKE_BUILD_TYPE=Debug there is no need to trigger jobs for this.

Is anybody using our custom Debian package of Connext 5.2? If yes, @esteve can you please release an updated Debian package which includes the debug libraries.

+1
I'm using our debian packages.

I'm using the Debian packages too.
@j-rivero do you have time for updating the packages? I can show you how.

@dirk-thomas: this PR implements my first approach. After thinking about what the Visual Studio cmake generator does and knowing that after running cmake the call to msbuild can invoke (using /p:Configuration) Release/Debug I would say that we need both logic into the vcxproj generated by cmake. And I think that the way to do it is ros2/rmw_connext#86

@j-rivero do you have time for updating the packages? I can show you how.

Not today, a bit busy with gazebo stuff and Windows. But feel free to mail me the instructions and I will give a look tomorrow.

I agree that ros2/rmw_connext#86 is the more flexible solution. I am not sure if we need it but if you like to look into it that would be good.
Still this simple approach should be merged as soon as we have a Debian package which contains debug libraries.

@esteve Please catch up on this.
Moving back to in-progress for now.

We need an ament specific flag to make shared the default (without requiring user interaction).

From the meeting:

@esteve will ping people about the state of this.

I've created a PR to add instructions for creating Debian packages for RTI Connext:
https://github.com/rticommunity/rticonnextdds-src/pull/13
let me know if there's anything that needs to be improved.

@j-rivero talk with @esteve about testing the new instructions.

@dirk-thomas says that this is blocked by a lack of availability of debug Connext binaries (we've been unable to successfully build working versions of those ourselves).

I will close this in favor of a more flexible solution which exports both libraries like this: debug nddsd.so optimized ndds.so
I have created a separate ticket for creating a Debian package which also includes debug libraries: osrf/rticonnextdds-src#4


Create openshift-network-policies.md

Hey @NickCorcoran I've made minor stylistic changes, added a table of contents, and changed a couple of links so that we avoid creating 404s (example URL goes in a code block 68575fd and I link to the protected document public landing page rather than the NSX page directly 9956b9a). Can you let me know if you're happy with these changes before I merge and kick off a build?


republishToDlq now default is true

https://github.com/spring-cloud/spring-cloud-stream-binder-rabbit/blob/master/spring-cloud-stream-binder-rabbit-core/src/main/java/org/springframework/cloud/stream/binder/rabbit/properties/RabbitConsumerProperties.java#L65

@kinjelom Please sign the Contributor License Agreement!
Click here to manually synchronize the status of this Pull Request.
See the FAQ for frequently asked questions.

@kinjelom Thank you for signing the Contributor License Agreement!


Unable to locate executable file: 'bash' and others missing that are in PATH (packer, ansible, any.)

Have you tried troubleshooting?
Troubleshooting doc
Yup.
Agent Version and Platform
Version of your agent?
2.153.2
OS of the machine running the agent? OSX/Windows/Linux/...
Ubuntu 16.04
Azure DevOps Type and Version
dev.azure.com (formerly visualstudio.com) or on-premises TFS/Azure DevOps Server?
dev.azure.com
If dev.azure.com, what is your organization name? https://dev.azure.com/{organization} or https://{organization}.visualstudio.com
BlackBookUSA
What's not working?
Please include error messages and screenshots.
No executable files able to be located, from bash to packer to ansible etc. This is a clean, minimal install from the community ubuntu 16.04 AWS ami including packer, ansible and the ADO agent
no_bash.txt
no_ansible-playbook.txt
ubuntu@ip-10-99-99-195:~/ado-agent$ which packer
/usr/local/bin/packer
ubuntu@ip-10-99-99-195:~/ado-agent$ which ansible-galaxy
/usr/bin/ansible-galaxy
ubuntu@ip-10-99-99-195:~/ado-agent$ which bash
/bin/bash
ubuntu@ip-10-99-99-195:~/ado-agent$ ./run.sh
Scanning for tool capabilities.
Connecting to the server.
2019-06-28 02:27:52Z: Listening for Jobs
2019-06-28 02:28:34Z: Running job: Job
2019-06-28 02:28:46Z: Job Job completed with result: Failed
^CExiting...

Agent and Worker's Diagnostic Logs
Logs are located in the agent's _diag folder. The agent logs are prefixed with Agent_ and the worker logs are prefixed with Worker_. All sensitive information should already be masked out, but please double-check before pasting here.
_diag.zip

:/ someone added a path variable that overwrote the actual path, and I didn't see it

To highlight this further as I just suffered through a few hours of debugging this.
You will get this error if you have a variable named path in your pipeline as overwrites the environment variable on the agent.
trigger:
  branches:
    include:
      - master

pool:
  vmImage: 'ubuntu-latest'

variables:
  configuration: Release
  platform: Any CPU
  path: src/MyProject

steps:
  - script: |
      printenv

💥 🤦♂


Default color scheme of video upload section on Demo upload page

After we select video for upload on Demo upload page, some text is not visible on the video section and also default color iis not matching with the Dark/light theme of the page

solved!


Run button off-screen on "RUN" and "RERUN"

Usability bug:
"Run" button moves with a panel for both RUN and RERUN cases.
For RUN, it's on the top left, and is off visible screen when I enter the parameters at the bottom.
For RERUN, its bottom right and it's off screen for the most common use case - rerun with the same parameters - make me scroll down to it - extra moves.
For "re-run" - a panel at the bottom of the dialog, or floating buttons.
For "run" - call UX & visual designer.

Was just about to open a new issue when I found this one. I agree especially regarding the re-run "issue". It would improve the usability a lot if the buttons are always visible and you don't have to scroll down. I think the most common use-cases are to run the same action again, so you either want to submit it or maybe check the preview first if in doubt.


npm install angularjs-rails-resource

Is there any way to install this package using
npm install angularjs-rails-resource
I get an error, even if I try with:
npm install https://github.com/FineLinePrototyping/angularjs-rails-resource --save
Connection time out
Any idea?

I'm not sure. We did some work to get it working now with bower but I don't think I've tried using npm to install it.

On May 26, 2015, at 6:37 PM, Jose Carrion<EMAIL_ADDRESS>wrote:
Is there any way to install this package using
npm install angularjs-rails-resource
I get and error, even if I try with:
npm install https://github.com/FineLinePrototyping/angularjs-rails-resource --save
Connection time out
Any idea?
—
Reply to this email directly or view it on GitHub.

Thanks for your quick answer,
Actually I just try with:
npm install FineLinePrototyping/angularjs-rails-resource --save
And it works perfect :)
Thanks!


Use newline only when fn_call_style is Block

Closes #1528 (which I introduced, sorry).

Rebased with suggested changes.


Frontend. Link from context menu always leads to last screenshot

Case:

Write 3+ tests on difference pages and launch it
Go to web and try open any of table row with context menu "Details" (see screenshot)
All of tests details will contains screenshot of last made test

But its ok if click on table row itself

thanks for the ticket!
fixed in latest release!


Creating A Shopping Cart API Using Java

Update on customerDao and field id

@john-amiscaray

Closing this PR because the number of duplicate pull requests required to make the corrections has exceeded a reasonable limit. Please check the resources page to improve your writing skills for your next topic suggestion.


Validation of HAMMER reweighting with known FF distributions with given parameterizations

Here I'll record more details about validation mentioned in umd-lhcb/lhcb-ntuples-gen#51.

In Manuel's BaBar code (plot_q2_2hdm.cxx), he did not use TF1; instead, he filled a TH1F histogram with explicit binning and q2 calculated at center of the bin.

Here's some non-working plot. The main problem now is the normalization:

I also tried to compute total number of entries with histogram.GetIntegral(), and the result is 0. This is likely due to each bin content is too small (1E-15)

@manuelfs I've updated a plot that's been heavily tweaked in umd-lhcb/lhcb-ntuples-gen#51. Here I want to offer a little explanation on why this takes ~1 week to finish.

Doesn't start until Wednesday
I used a naive histo.Scale(1/histo.Integral()), and I got something like this:

I didn't understand why I seemed to be getting negative components, so I started reading documentation
During the next 2 days, I did a few experiments with TH1D, and it seems that my method was mostly right (sans the option width)
I was confused for a bit, until today, where I really sat down and looked closely to the documentation
I realized that the visually negative components are just error bars.

We consider this validated. The thing to keep in mind is that it might be useful to make reference curves binned in the same way as data/MC to make comparison easier.
To do that, one needs to integrate the continuous function inside each bin.


Improve UF2 converter for Eve

[ ] The script python uf2conv4eve.py -l fails on Win11 because wmic is removed by Microsoft. So we need adapt the code to other way.

See here:
https://winaero.com/microsoft-removed-the-wmic-tool-from-windows-11-dev-builds/
https://docs.microsoft.com/en-us/windows/win32/wmisdk/wmic

Now the script use PowerShell to get list drive.
If not found any drive, it try again with wmic\wmix.exe and wmic command.


Implement automatic gain/exposure calibration during alignment

Implement an algorithm to automatically choose the guidescope camera gain and exposure settings. This probably needs to be done on a per-location basis because assuming the sky is uniformly bright is probably a bad assumption especially in the presence of local obstructions.
Why: A single set of gain/exposure settings is not appropriate for all sky conditions. If settings that work well at night are used at twilight the image may be significantly overexposed causing plate solving to fail when it might have succeeded with other settings. If settings that work during twilight are used at night, plate solving may fail to detect some stars that are underexposed which may limit the number of positions on the sky where alignment can succeed.

Notes from experiments performed on 27 November 2020:

first successful plate solving near zenith: 5:17pm
camera settings: gain 0, exposure time 0.5s

Default alignment gain setting is 400 with exposure time 0.5s. With these settings the images were very overexposed at the time I was first able to get good plate solves which is how I confirmed that some kind of gain control is required.

I was getting good plate solves at other locations on the sky somewhat lower from zenith with same settings over next few minutes after the first successful solution.
I also noticed that the same exposure time and gain settings in the ZWO capture program did not yield same brightness as in track software with camera in alignment mode. I think I have the same binning (4) and same gain (0). Perhaps the difference is due to using 8 bit in capture versus 16 bit mode (I think) in track when in single-shot mode?


Add Syn config to Vagrant.

Adds configuration to vagrant to compile and setup Syn to do JWT authentication on the Fedora side. This will need to have the git repo updated once the java code lives somewhere other then my own GitHub.
Part of:
Islandora-CLAW/CLAW#520

Closing this in favour of #17 not that the islandora jwt stuff is in.


Sync Figma, CSS, and MD styles for a UDS

Update color and text styles in Figma to sync with the Harbor CSS styles and cross reference these with the Material Design principles.
Goal for a universal design system to make sure things sync up from a wireframe and dev perspective.
Tasks

[ ] Figma styles updated
[ ] CSS files created
[ ] Layout grids in Figma created

Studying Material Design 3 - will try to base Harbor off of this. Studying Color and Typography first.
The new MD web components are underway but will likely take some time to be release:
https://github.com/material-components/material-web

Done


We use InternLM Auto Formalizer formalize 20 IMO problems.

The description of InternLM Auto Formalizer is in link.
Three human experts check and modify the autoformalization.
We notice our autoformalization does not have solution_set, maybe we can merge pure-proof problems.
These 20 problems have all been compiled using following code:
$ lake exe cache get
$ lake build

Thanks!
Rebased and squashed in https://github.com/dwrensha/compfiles/commit/d624eddb3ce2294cb52bf6f165913ea62c9b3155.


topic: Move sqlalchemy methods into their own file.

Loading sqlalchemy can take a significant amount of time, so splitting these into these own file can be a significant startup-time savings.

Self-review checklist

[ ] Self-reviewed the changes for clarity and maintainability
(variable names, code reuse, readability, etc.).

Communicate decisions, questions, and potential concerns.

[ ] Explains differences from previous plans (e.g., issue description).
[ ] Highlights technical choices and bugs encountered.
[ ] Calls out remaining decisions and concerns.
[ ] Automated tests verify logic where appropriate.

Individual commits are ready for review (see commit discipline).

[ ] Each commit is a coherent idea.
[ ] Commit message(s) explain reasoning and motivation for changes.

Completed manual review and testing of the following:

[ ] Visual appearance of the changes.
[ ] Responsiveness and internationalization.
[ ] Strings and tooltips.
[ ] End-to-end functionality of buttons, interactions and flows.
[ ] Corner cases, error conditions, and easily imagined bugs.

Names and file layouts look great; I've not investigated the coverage CI failure.
ERROR: zerver/lib/narrow.py no longer has complete backend test coverage
  Lines missing coverage: [103]

Merged, thanks @alexmv!


Naming of MessageId property In SendResponse and parameter in GetMessageDetailsAsync() seems inconsistent

The SendMessageAsync() returns a SendResponse that has a MessageId property of type string.
The GetMessageDetailsAsync() call requires a MessageId parameter, but that is of type int. It seems the Id required by this method is in the MessageInfo that is found in the Messages dictionary.
Since the SendResponse can contain multiple messages wouldn't the MessageId be more a ResponseId, of even just Id.
What is the use of this property, it seems to contain a guid@mailerdomain (like<EMAIL_ADDRESS>in my case)

@jbennink as I understand it, the Postal Server really contains two different type for message identifier.

MessageId from SendResponse (string with guid@domain) insert as header ('message-id') in email and have name in ui as "Message ID"

Id in MessageInfo (integer) use as internal ID message in Postal database. Exactly this property necessary for api methods GetMessage*Async()

Such naming using in official docs see response Sending a message and description for parameter id


Uncaught NullError: method not found: '_analysis' on null

[Enter steps to reproduce below:]

Create a project on the command line using flutter create
Open the project folder within Atom
Start typing

Atom Version: 1.0.19
System: Mac OS X 10.10.5
Thrown From: dartlang package, v0.4.12
Stack Trace
Uncaught NullError: method not found: '_analysis' on null
At /Users/traviskaufman/.atom/packages/dartlang/web/entry.dart.js:21255

NullError: method not found: '_analysis' on null
  at [object Object].dart.wrapException (/Users/traviskaufman/.atom/packages/dartlang/web/entry.dart.js:22307:17)
  at [object Object].dart._rethrow (/Users/traviskaufman/.atom/packages/dartlang/web/entry.dart.js:38390:15)
  at _rootHandleUncaughtError_closure.dart._rootHandleUncaughtError_closure.call$0 (/Users/traviskaufman/.atom/packages/dartlang/web/entry.dart.js:41178:11)
  at _AsyncCallbackEntry.dart._AsyncCallbackEntry.callback$0 (/Users/traviskaufman/.atom/packages/dartlang/web/entry.dart.js:39573:30)
  at [object Object].dart._microtaskLoop (/Users/traviskaufman/.atom/packages/dartlang/web/entry.dart.js:38189:12)
  at [object Object].dart._microtaskLoopEntry (/Users/traviskaufman/.atom/packages/dartlang/web/entry.dart.js:38195:11)
  at TimerImpl_internalCallback0.dart.TimerImpl_internalCallback0.call$0 (/Users/traviskaufman/.atom/packages/dartlang/web/entry.dart.js:21631:35)
  at invokeClosure_closure.dart.invokeClosure_closure.call$0 (/Users/traviskaufman/.atom/packages/dartlang/web/entry.dart.js:23475:41)
  at _IsolateContext.dart._IsolateContext.eval$1 (/Users/traviskaufman/.atom/packages/dartlang/web/entry.dart.js:21246:25)
  at [object Object].dart._callInIsolate (/Users/traviskaufman/.atom/packages/dartlang/web/entry.dart.js:20890:28)
  at dart.invokeClosure (/Users/traviskaufman/.atom/packages/dartlang/web/entry.dart.js:22455:18)
  at /Users/traviskaufman/.atom/packages/dartlang/web/entry.dart.js:22476:18

Commands
     -8:14.3.0 core:backspace (atom-text-editor.editor.mini.is-focused)
     -8:12.5.0 core:confirm (atom-text-editor.editor.mini.is-focused)
     -7:16.3.0 core:select-all (atom-text-editor.editor.mini.is-focused)
  2x -7:14.1.0 core:confirm (atom-text-editor.editor.mini.is-focused)
     -5:30.7.0 core:select-all (atom-text-editor.editor.mini.is-focused)
  3x -5:29.4.0 core:confirm (atom-text-editor.editor.mini.is-focused)
     -5:18.2.0 core:select-all (atom-text-editor.editor.mini.is-focused)
     -5:17.9.0 core:backspace (atom-text-editor.editor.mini.is-focused)
     -5:06.4.0 core:select-all (atom-text-editor.editor.mini.is-focused)
     -5:04.0 core:confirm (atom-text-editor.editor.mini.is-focused)
     -4:14.4.0 application:open (atom-text-editor.editor.is-focused)
     -3:58.7.0 core:save (atom-text-editor.editor.is-focused)
  3x -1:34.7.0 dartlang:run-application-configuration (atom-text-editor.editor.is-focused)
     -1:14.3.0 core:copy (atom-notification.error.icon.icon-flame.native-key-bindings.has-detail)
  4x -0:59.9.0 dartlang:run-application-configuration (atom-text-editor.editor.is-focused)
     -0:00.6.0 core:backspace (atom-text-editor.editor.is-focused)

Config
{
  "core": {
    "followSymlinks": false,
    "themes": [
      "one-dark-ui",
      "atom-monokai"
    ]
  }
}

Installed Packages
# User
atom-monokai, v0.9.4
dartlang, v0.4.12
linter, v1.9.1

# Dev
No dev packages

I think this can only occur when we're able to locate an SDK, but we have issues starting up the analysis server.

This is correct and can be possibly closed. A better error would be missing SDK. Anyway installing the sdk via homebrew resolved this.

Just ran into this too. I still don't know what to do...
I'm guessing it's something with my setup, but a better message would definitely help.

I'll improve the messaging. You can verify which sdk the plugin is using by running the command 'show sdk info` (from atom's command pallette). We try to auto-detect the sdk. If we can't you can add a path manually in the plugin's settings.
You'll want a 1.13 SDK if possible, to capture a bunch of fixes in the analysis server.


feat: news in app [DO NOT MERGE]

This PR resolves []
Description

Adds an news component to the home feed below the fold above editorial and a news screen that shows all news articles.
https://github.com/artsy/eigen/assets/49686530/9d6a704f-45d2-4ad6-9e70-8935e203f06e
Follow-ups (if we want to ship):

Fix tracking copied over from editorial
Tests
Feature flag
Review with design and product if this is something we want and what we want changed

PR Checklist

[ ] I have tested my changes on iOS and Android.
[ ] I hid my changes behind a feature flag, or they don't need one.
[x] I have included screenshots or videos, or I have not changed the UI.
[ ] I have added tests, or my changes don't require any.
[x] I added an app state migration, or my changes do not require one.
[x] I have documented any follow-up work that this PR will require, or it does not require any.
[x] I have added a changelog entry below, or my changes do not require one.

To the reviewers 👀

[ ] I would like at least one of the reviewers to run this PR on the simulator or device.

Changelog updates
Changelog updates

Cross-platform user-facing changes

Home feed news module and news screen - Brian

iOS user-facing changes

Android user-facing changes

Dev changes

Need help with something? Have a look at our docs, or get in touch with us.

Warnings

:warning:

❌ An error occurred while validating your changelog, please make sure you provided a valid changelog.

  Generated by :no_entry_sign: dangerJS against c5540b451c191a42ea4d704d7a728037f0114148

@brainbicycle I think we can close this one, thanks for the work here, as mentioned in the linked PR it was extracted and adapted 👍


Package installing to wrong location

On texlive 2022, installing pdfcol doesn't resolve xelatex not finding pdfcol.sty
On closer examination, C:\texlive\2022\tex contains exactly one subdirectory, latex, which itself only contains pdfcol, which contains pdfcol.sty
Moving this to texmf-dist\tex\latex\pdfcol works.  I assume the install path is erroneous.

No the path in texlive looks fine. In my installation it is in c:/texlive/2022/texmf-dist/tex/latex/pdfcol/pdfcol.sty. That is the correct place  and xelatex finds it there without problems (but as xelatex has no color stacks it does nothing). If the path doesn't work for you something is wrong with your texlive installation.


Bug in ParticleSystem createConeEmitter??

Not sure if it is a bug this time or if I am missing something in the intentions
https://www.babylonjs-playground.com/#X643HR
In this PG I would expect that when I made the cone radius bigger the cone would scale up. However change the 1 in line 32 to a 10 and the cone gets longer and thinner rather than proportionally bigger.
I think the line radius = radius * h / this._height; in the code below should be radius = radius * h but this depends on my expectations which may be different to the authors.
ConeParticleEmitter.prototype.startPositionFunction = function (worldMatrix, positionToUpdate, particle) {             var s = BABYLON.Scalar.RandomRange(0, Math.PI * 2);             var h = BABYLON.Scalar.RandomRange(0, 1);             // Better distribution in a cone at normal angles.             h = 1 - h * h;             var radius = BABYLON.Scalar.RandomRange(0, this._radius);             radius = radius * h / this._height;             var randX = radius * Math.sin(s);             var randZ = radius * Math.cos(s);             var randY = h * this._height;             BABYLON.Vector3.TransformCoordinatesFromFloatsToRef(randX, randY, randZ, worldMatrix, positionToUpdate);         };

I'm so glad you think alike!
I will fix it (I was thinking the same but I considered it was just me)

Please, do, dunno why I did this way :-)


segmentation fault

Today I closed BitGreen version <IP_ADDRESS> (2019-08-08 00:20:52 +0200 Qt window, it gracefully disappeared. However, I found "segmentation fault" in the terminal, where the program has been running.
dmesg said:
[804906.267291] traps: bitgreen-qt[24912] general protection ip:55dda30628bb sp:7fffff1f89e0 error:0 in bitgreen-qt[55dda2460000+2403000]
Debug.log:
debug1.log
I am using:
$ lsb_release -a && uname -a
No LSB modules are available.
Distributor ID:	Debian
Description:	Debian GNU/Linux 10 (buster)
Release:	10
Codename:	buster
Linux nv01-debian 4.19.0-5-amd64 #1 SMP Debian 4.19.37-5+deb10u2 (2019-08-08) x86_64 GNU/Linux

System fully updated and functional.

The error is located here
https://github.com/bitgreen/bitgreen/blob/0fa57d4106f9ea0ca24eb527ccdae5af7cba4ce4/src/qt/bitgreen.cpp#L631
GDB call stack trace:
Thread 1 "bitgreen-qt" received signal SIGSEGV, Segmentation fault.
0x00007ffff777b5e5 in QAction::setEnabled(bool) () from /usr/lib64/libQt5Widgets.so.5
(gdb) backtrace
#0  0x00007ffff777b5e5 in QAction::setEnabled(bool) () from /usr/lib64/libQt5Widgets.so.5
#1  0x000055555566da86 in BitcoinGUI::setWalletActionsEnabled (this=0x55555661c000, enabled=false) at qt/bitcoingui.cpp:703
#2  0x000055555566ec02 in BitcoinGUI::BitcoinGUI (this=0x55555661c000, networkStyle=<optimized out>, parent=<optimized out>) at qt/bitcoingui.cpp:255
#3  0x00005555556578ca in BitcoinApplication::createWindow (this=0x7fffffffd8d0, networkStyle=0x5555563579d0) at qt/bitgreen.cpp:352
#4  0x000055555564b24b in main (argc=<optimized out>, argv=<optimized out>) at qt/bitgreen.cpp:631


exception in initAndListen: 98 Unable to lock file while trying to run a mongodb container with its working directory mounted on seaweedfs

Describe the bug
I have written a docker file that mounts its working directory onto seaweedfs and then starts mongodb on it. It exits with an exception.
System Setup

OS version : docker container based on an Alpine image.
This is SeaweedFS version 30GB 2.12 d3be2ce linux amd64
if using filer, show the content of filer.toml : default content

Expected behavior
Should work without an issue

2020-11-30T19:25:11.235+0000 I CONTROL  [initandlisten] MongoDB starting : pid=23 port=27017 dbpath=/data/db 64-bit host=docker-desktop                                                                                2020-11-30T19:25:11.235+0000 I CONTROL  [initandlisten] db version v3.4.4                                               2020-11-30T19:25:11.235+0000 I CONTROL  [initandlisten] git version:<PHONE_NUMBER>74a9debd1b6c5d36559ca86b44babd           2020-11-30T19:25:11.235+0000 I CONTROL  [initandlisten] OpenSSL version: LibreSSL 2.5.5                                 2020-11-30T19:25:11.235+0000 I CONTROL  [initandlisten] allocator: system                                               2020-11-30T19:25:11.235+0000 I CONTROL  [initandlisten] modules: none                                                   2020-11-30T19:25:11.235+0000 I CONTROL  [initandlisten] build environment:                                              2020-11-30T19:25:11.235+0000 I CONTROL  [initandlisten]     distarch: x86_64                                            2020-11-30T19:25:11.235+0000 I CONTROL  [initandlisten]     target_arch: x86_64                                         2020-11-30T19:25:11.235+0000 I CONTROL  [initandlisten] options: {}                                                     2020-11-30T19:25:11.252+0000 I STORAGE  [initandlisten] wiredtiger_open config: create,cache_size=480M,session_max=20000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),     2020-11-30T19:25:11.404+0000 I CONTROL  [initandlisten]                                                                 2020-11-30T19:25:11.404+0000 I CONTROL  [initandlisten] ** WARNING: Access control is not enabled for the database.     2020-11-30T19:25:11.404+0000 I CONTROL  [initandlisten] **          Read and write access to data and configuration is unrestricted.                                                                                2020-11-30T19:25:11.404+0000 I CONTROL  [initandlisten]                                                                 2020-11-30T19:25:11.405+0000 I CONTROL  [initandlisten]                                                                 2020-11-30T19:25:11.405+0000 I CONTROL  [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'.                                                                                2020-11-30T19:25:11.405+0000 I CONTROL  [initandlisten] **        We suggest setting it to 'never'                      2020-11-30T19:25:11.405+0000 I CONTROL  [initandlisten]                                                                 2020-11-30T19:25:11.436+0000 I FTDC     [initandlisten] Initializing full-time diagnostic data capture with directory '/data/db/diagnostic.data'                                                                                2020-11-30T19:25:11.459+0000 I INDEX    [initandlisten] build index on: admin.system.version properties: { v: 2, key: { version: 1 }, name: "incompatible_with_version_32", ns: "admin.system.version" }                                        2020-11-30T19:25:11.459+0000 I INDEX    [initandlisten]          building index using bulk method; build may temporarily use up to 500 megabytes of RAM                                                                                2020-11-30T19:25:11.463+0000 I INDEX    [initandlisten] build index done.  scanned 0 total records. 0 secs              2020-11-30T19:25:11.465+0000 I COMMAND  [initandlisten] setting featureCompatibilityVersion to 3.4                      2020-11-30T19:25:11.465+0000 I NETWORK  [thread1] waiting for connections on port 27017                                 2020-11-30T19:25:15.902+0000 I NETWORK  [thread1] connection accepted from <IP_ADDRESS>:38680 #1 (1 connection now open)   2020-11-30T19:25:15.907+0000 I NETWORK  [conn1] received client metadata from <IP_ADDRESS>:38680 conn1: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "3.4.4" }, os: { type: "Linux", name: "NAME="Alpine Linux"", architecture: "x86_64", version: "Kernel 4.19.128-microsoft-standard" } }                               2020-11-30T19:25:16.057+0000 I -        [conn1] end connection <IP_ADDRESS>:38680 (1 connection now open)                  MongoDB shell version v3.4.4                                                                                connecting to: mongodb://<IP_ADDRESS>:27017/admin                                                                          2020-11-30T19:25:16.350+0000 I NETWORK  [thread1] connection accepted from <IP_ADDRESS>:38686 #2 (1 connection now open)   2020-11-30T19:25:16.358+0000 I NETWORK  [conn2] received client metadata from <IP_ADDRESS>:38686 conn2: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "3.4.4" }, os: { type: "Linux", name: "NAME="Alpine Linux"", architecture: "x86_64", version: "Kernel 4.19.128-microsoft-standard" } }                               MongoDB server version: 3.4.4                                                                                Successfully added user: {                                                                                "user" : "alphadose",                                                                                "roles" : [                                                                                {                                                                                "role" : "root",                                                                                "db" : "admin"                                                                                }                                                                                ]                                                                                }                                                                                2020-11-30T19:25:16.421+0000 I -        [conn2] end connection <IP_ADDRESS>:38686 (1 connection now open)                  There doesn't seem to be a server running with dbpath: /data/db                                                         2020-11-30T19:25:17.267+0000 I CONTROL  [initandlisten] MongoDB starting : pid=1 port=27017 dbpath=/data/db 64-bit host=docker-desktop                                                                                2020-11-30T19:25:17.267+0000 I CONTROL  [initandlisten] db version v3.4.4                                               2020-11-30T19:25:17.267+0000 I CONTROL  [initandlisten] git version:<PHONE_NUMBER>74a9debd1b6c5d36559ca86b44babd           2020-11-30T19:25:17.267+0000 I CONTROL  [initandlisten] OpenSSL version: LibreSSL 2.5.5                                 2020-11-30T19:25:17.267+0000 I CONTROL  [initandlisten] allocator: system                                               2020-11-30T19:25:17.267+0000 I CONTROL  [initandlisten] modules: none                                                   2020-11-30T19:25:17.267+0000 I CONTROL  [initandlisten] build environment:                                              2020-11-30T19:25:17.267+0000 I CONTROL  [initandlisten]     distarch: x86_64                                            2020-11-30T19:25:17.267+0000 I CONTROL  [initandlisten]     target_arch: x86_64                                         2020-11-30T19:25:17.267+0000 I CONTROL  [initandlisten] options: { config: "/etc/mongod.conf", net: { bindIp: "<IP_ADDRESS>" }, security: { authorization: "enabled" } }                                                                             2020-11-30T19:25:17.293+0000 I STORAGE  [initandlisten] exception in initAndListen: 98 Unable to lock file: /data/db/mongod.lock Resource temporarily unavailable. Is a mongod instance already running?, terminating                           2020-11-30T19:25:17.293+0000 I NETWORK  [initandlisten] shutdown: going to close listening sockets...                   2020-11-30T19:25:17.293+0000 I NETWORK  [initandlisten] shutdown: going to flush diaglog...                             2020-11-30T19:25:17.293+0000 I CONTROL  [initandlisten] now exiting                                                     2020-11-30T19:25:17.293+0000 I CONTROL  [initandlisten] shutting down with code:100

Additional context
You can check the docker file in the network-mounted-volumes branch here :  https://github.com/sdslabs/gasper-dockerfiles/tree/network-mounted-volumes

can not reproduce. worked fine.
Alpine-Mongo$ docker run -it --name mongo -e MONGO_INITDB_ROOT_USERNAME="root-user" -e MONGO_INITDB_ROOT_PASSWORD="pass123" -p "27019:27017" -v /Users/chris/tmp/mm/db:/data/db mongo_alpine:1.1
2020-11-30T20:15:04.708+0000 I CONTROL  [initandlisten] MongoDB starting : pid=1 port=27017 dbpath=/data/db 64-bit host=b68523eff5b1
2020-11-30T20:15:04.708+0000 I CONTROL  [initandlisten] db version v3.4.4
2020-11-30T20:15:04.708+0000 I CONTROL  [initandlisten] git version:<PHONE_NUMBER>74a9debd1b6c5d36559ca86b44babd
2020-11-30T20:15:04.708+0000 I CONTROL  [initandlisten] OpenSSL version: LibreSSL 2.5.5
2020-11-30T20:15:04.708+0000 I CONTROL  [initandlisten] allocator: system
2020-11-30T20:15:04.708+0000 I CONTROL  [initandlisten] modules: none
2020-11-30T20:15:04.708+0000 I CONTROL  [initandlisten] build environment:
2020-11-30T20:15:04.708+0000 I CONTROL  [initandlisten]     distarch: x86_64
2020-11-30T20:15:04.708+0000 I CONTROL  [initandlisten]     target_arch: x86_64
2020-11-30T20:15:04.708+0000 I CONTROL  [initandlisten] options: { config: "/etc/mongod.conf", net: { bindIp: "<IP_ADDRESS>" }, security: { authorization: "enabled" } }
2020-11-30T20:15:04.712+0000 W -        [initandlisten] Detected unclean shutdown - /data/db/mongod.lock is not empty.
2020-11-30T20:15:04.720+0000 I -        [initandlisten] Detected data files in /data/db created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'.
2020-11-30T20:15:04.723+0000 W STORAGE  [initandlisten] Recovering data from the last clean checkpoint.
2020-11-30T20:15:04.724+0000 I STORAGE  [initandlisten] wiredtiger_open config: create,cache_size=3471M,session_max=20000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),
2020-11-30T20:15:05.572+0000 I FTDC     [initandlisten] Initializing full-time diagnostic data capture with directory '/data/db/diagnostic.data'
2020-11-30T20:15:05.573+0000 I NETWORK  [thread1] waiting for connections on port 27017
2020-11-30T20:15:06.025+0000 I FTDC     [ftdc] Unclean full-time diagnostic data capture shutdown detected, found interim file, some metrics may have been lost. OK

any updates?

any updates?

Probably, this one could be closed. Because I didn't found any information on this topic: could/should seaweedfs be used as a storage for databases such as postgres? If yes, then as a FUSE mount?


Implement CUPS web UI template for creating printer instances

Is your feature request related to a problem? Please describe.
Currently, we can only create printer instances via CLI, but not via Web UI. Some users do not know CLI and use CUPS Web UI only.
Describe the solution you'd like
Creating printer instance via CUPS Web UI
=====================================================
@michaelrsweet @tillkamppeter thinking about  it from CUPS 3.0 perspective - will printer instances functionality be in cups-local daemon as well? If they will, what would be a GUI option for using them, since Web UI will be part of cups-sharing? Do we count on 3rd GUI app to use our API to create instances?

OK, so printer instances are almost always PER USER settings, so we can't configure them through the web interface. Ideally print UI should use the CUPS API for saving print options (cupsSetDests, cupsAddDest, cupsSetOption, etc.) and the instance name is just a name associated with certain print options ("Photo", "Manual-Labels", etc.) that the UI can get from the user (and show in a drop-down list near the currently selected printer...)
CUPS 3.0 doesn't change how this works...

@michaelrsweet hmm, I thought printer instances could be part of CUPS Web UI since root writes into /etc/cups/lpoptions and Web UI handles server options...
I recalled printer instances because one of our customers has many print queues (over 3k), and some of them are as many times pointing to the same device but with one/few option(s) different - cupsd startup takes over 4 minutes for them, because every queue has a PPD file which gets loaded, which slows the startup remarkably.
My idea was to use printer instances for some, and look whether we could run some part of printer loading in separate threads - I have a prototype for this, but it is still testing phase before I create PR for it.
Regarding printer instance, so IIUC they are not shared/accessible from remote machine - then what is the best practice for the setup when I want to share several print queues, pointing to the same device but with different option(s), and I want to save memory, since adding PPD for every print queue is redundant - printer instances looked very nice in the aspect.

hmm, I thought printer instances could be part of CUPS Web UI since root writes into /etc/cups/lpoptions and Web UI handles server options...

While it is true that root writes into /etc/cups/lpoptions, the CGI programs do not run as root so they wouldn't be able to manipulate that file... Also, not all applications support printer instances so it might not offer the improvement you are looking for... :/

After looking at what would be required to implement this (basically new operations) and the corresponding security issues with that approach, I'm uncomfortable adding this functionality to CUPS. Another method (one that would work with all applications) would be to create "shadow" print queues that point to the main queue but have different defaults. Essentially you just need to create another printer pointed at the local/primary printer using the IPP Everywhere driver and then set the alternate defaults accordingly.


proposal: delete item functionality

This should only be able to be done with ones own item. I'm happy to provide guidance.

Closing this as it's not a priority for now. We may decide to revisit this in the future.


Use tileset for everything

blocks, placeable blocks
Also add auto-tiling feature (so block sprites combine together).

add prefabs for everything
refactor code (particularly repetition and placeholderPreview) (could rename PlacePreview to PlayerPreview)
change unplaceable animation to particle system


Missing autoupdate meeting duplicate select

Open a meeting create form of a committee with meetings
Reload
The duplicate from select input has no meetings

The input uses template_meetings, active_meetings and archived_meetings from the organization.

I can reproduce the problem.


[Docs-IS 7.0] Update Enable Verification for Updated User Attributes feature related documentations

Is your suggestion related to a missing or misleading document? Please describe.

Previously Sending the email verification email is skipped when updating the email address as long as the verifyEmail claim is not set to true & Sending the SMS OTP verification is also skipped if the verifyMobile claim is not set to true in the SCIM 2.0 request.
But with the fix done for the issue(https://github.com/wso2/product-is/issues/18414), Now it is not needed to set verifyEmail / verifyMobile  claims in the user update request for triggering verfication mail/sms.
So need to update the following IS documentation by removing the mentions of verifyEmail & verifyMobile claims.

https://is.docs.wso2.com/en/latest/guides/identity-lifecycles/enable-email-account-verification-for-an-updated-email-address/
https://is.docs.wso2.com/en/latest/guides/identity-lifecycles/enable-verification-for-updated-mobile-number/

Related Issues:

https://github.com/wso2/product-is/issues/18414

The latest links point to https://is.docs.wso2.com/en/latest/guides/users/attributes/manage-attributes/ which doesn't explain this feature at all. Hence the full flow should be documented based on the new console instructions.


feat(safe-core-sdk): Rename safe-cores-sdk-types

⚠ Don't merge until the new package is published ⚠
This PR resolves https://github.com/safe-global/safe-core-sdk/issues/947
We are renaming the package safe-cores-sdk-types to types-kit

@dasanra i did not update migration guides. Perhaps the migration-to-v4 could be updated to
Note: When upgrading to protocol-kit v4, it's necessary to upgrade to types-kit v1
wdyt?

This PR resolves https://github.com/safe-global/safe-core-sdk/issues/947

@yagopv something we can consider. The last major should be compatible with all the previous protocol-kit v4


Can create a resource without entering any data

Tested on 23.3 branch
Resources

templates
workflows
connection

Steps to reproduce

Select any of the listed resources above from the sidebar
Click on add to create a new resource
See that you're able to submit an empty form

Expected behavoir
This shouldn't be possible. We should require name/short name in order to create any of the resources
Notes
Please, speak to Jože before starting

@katrinDY is this really unexpected? Since we don't require handles nor names I don't really see a reason why submitting empty forms would not be permitted.
The server does (or should at least) filter out/ignore invalid/empty things when performing operations over them (such as workflows)

@tjerman I'm not entirely sure if this should be expected or unexpected. It makes sense that we don't require handle and/or name for these resources but it also doesn't make sense that we can create such resources without entering handle and/or name. You can close this issue, if you think it's expected

I'll let @Fajfa make the final call; for me, this is more of a UX issue

Monorepo 2023.3 commit d431b90a9

@Bojan-Svirkov, test code on:

2023.3.x-bugfix-make-name-required-for-resources
2022.9.x-bugfix-make-name-required-for-resources

CL:
Fixed:
What: Make name property required when creating templates, dal connections, workflows, auth clients and sensitivity levels
How: Validations were added to prevent creating one of the listed resources without adding a name
Refs:

22.9 38a02d5b9
23.3 4ccafb19

Added CL


is there a way to stop the flashing in console?

in while loop
add
getchar();

Hi @GalaxyLinus.
Can you please provide more details of the issue? Which file are you having issue at? Which language are you using (Python/C/C++)?

you can see my screenshot

I compile donut.c
the compiler will warn you to add head file，you can type 'man getchar' in the terminal to see which head file you should add
I don't add it because my compiler can generate exe file

Hi @GalaxyLinus. Can you please provide more details of the issue? Which file are you having issue at? Which language are you using (Python/C/C++)?

i have the same issue,i have the code in python

When I think about it, python is probably iust too slow, I'll try cyphon
tomorrow
ErMandrage @.***> schrieb am Sa., 2. Okt. 2021, 17:41:

Hi @GalaxyLinus https://github.com/GalaxyLinus. Can you please provide
more details of the issue? Which file are you having issue at? Which
language are you using (Python/C/C++)?
i have the same issue,i have the code in python
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/RandomThings23/donut/issues/2#issuecomment-932772457,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ANTKWHSZTLDS2NYXTF53VM3UE4R3HANCNFSM5EYWQTOA
.


Fix misindent in internal/catch_test_spec.hpp:70

This (and all bugs akin) could (and honestly should) be fixed by enforcing a .clang-format at repository root
Closes #679

Any updates on this?

Any updates on this?

Any updates on this?

Rebased

Thanks - and good Catch. Sorry it took a while to get to this


Handle double-quotes and fixes for PointTier

PointTier.read was passing arguments to Point in the wrong order
TextGrid.write was using min() and max() to get xmin and xmax for tiers, except for IntervalTiers, which returns an object rather than a string (see #7), so writing a textgrid with a PointTier didn't create a valid file. and the same issue for PointTier.write
remove __min__ and __max__ in re #7
PointTier.write missed a newline after writing the Object class line
double-quotes in mark or text fields need to be doubled when writing, or Praat can't read the written textgrids
doubled double-quotes in textgrids written from Praat need to be reduced to single double-quotes
add tests that cover the above. Passes for me with 2.7, passes with ResourceWarnings with 3.4 for unclosed files from readFile which can be refactored separately

Thanks for the pull request with all this good stuff in it! A couple small things before I merge it:

If you're going to add the unittest framework for the tests in RWtests.py, would you be willing to move the doctests in textgrid.py into that framework? I'd rather not mix testing frameworks (and I'm entirely fine using unittest; it's probably better for a project of this size/complexity)
If RWtests.py is going to become a unit test suite, the tests in the __main__ should also become unit tests.
Could you register RWtests.py as the test suite for the package? You do this by adding something like

test_suite="RWtests.py"
to the setup invocation in setup.py. Then you can run something like python setup.py test to run all the tests.

I moved the existing tests over to unittest. I also found an issue with text or mark strings that have both double quotes and newlines in them. This existed before the PR, but it looks like it would need a bigger rewrite to fix. I wrote a test that covers it (which currently fails) and opened issue #10
Other than that, it passes for me with 2.7, and passes on 3.4 with ResourceWarning (unrelated to the PR, see above) and DeprecationWarning for assertRaisesRegexp. The interpreter suggests assertRaisesRegex which isn't found in 2.7 unittest, so I left it alone.

I moved the existing tests over to unittest. I also found an issue with text or mark strings that have both double quotes and newlines in them. This existed before the PR, but it looks like it would need a bigger rewrite to fix. I wrote a test that covers it (it's marked as an expected failure) and opened issue #10. Otherwise, it passes for me on 2.7, and passes on 3.4 with ResourceWarning and DeprecationWarning

Looks great, thanks for the PR. Merging now.


bumping parent

Changes Unknown when pulling 026b139bcab8548fda0a858ee6c8c9a60674cb27 on witokondoria:fix/stratio_parent into ** on Stratio:branch-0.1**.

Changes Unknown when pulling daabdb8b65552b54969f0a45871c8b96afd83b87 on witokondoria:fix/stratio_parent into ** on Stratio:branch-0.1**.

:shipit:

Comment accepted. Will treat it ASAP on Jenkins

Rebase && testing in progress

:shipit:

Comment accepted. Will treat it ASAP on Jenkins

Rebase && testing in progress

:shipit:

Comment accepted. Will treat it ASAP on Jenkins

Rebase && testing in progress


[AutoDiff] Add missing withoutDerivative(at:) fix-its.

Add withoutDerivative(at:) fix-its for errors regarding non-differentiable arguments and results.

Example:
import _Differentiation

@differentiable
func round(_ x: Float) -> Float {
  Float(Int(x))
}

round.swift:3:2: error: function is not differentiable
@differentiable
~^~~~~~~~~~~~~~
round.swift:4:6: note: when differentiating this function definition
func round(_ x: Float) -> Float {
     ^
round.swift:5:9: note: cannot differentiate through a non-differentiable result; do you want to use 'withoutDerivative(at:)'?
  Float(Int(x))
        ^
        withoutDerivative(at:  )

@swift-ci Please smoke test

@swift-ci Please smoke test Linux


Typescript error: properties.Date.date does not exist

Report bugs here only for the Node JavaScript library.
If you're having problems using Notion's API, or have any other feedback about the API including feature requests for the JavaScript library, please email support at<EMAIL_ADDRESS>Describe the bug
A clear and concise description of what the bug is.
date should be set as optional on the type

To Reproduce
Node version: 14.15.1
Notion JS library version: "0.0.1"
Steps to reproduce the behavior:

Expected behavior
A clear and concise description of what you expected to happen.
date is declared as an optional type of Date

hi @JorgeArreolaS, I'm fairly new to Typescript
I have here a sample structure for the select type that comes from QueryDatabaseResponse:
...
  Category: {
    id: '...',
    type: 'select',
    select: {
      id: '...',
      name: 'Test',
      color: 'blue'
    }
  }
...

When I use if (type === 'select') the type works fine:
  db.results
    .map(it => it.properties)
    .map(it => it.Category)
    .map(it => {if (it.type === 'select') return it.select})

BUT when I filter them with the type, it fails:
  db.results
...
    .filter(it => it.type === 'select')
    .map(it => it.select)

error:
Type error: Property 'select' does not exist on type '{ type: "title"; title: ({ type: "text"; text: { content: string; link: { url: string; } | null; }; annotations: { bold: boolean; italic: boolean; strikethrough: boolean; underline: boolean; code: boolean; color: "default" | ... 17 more ... | "red_background"; }; plain_text: string; href: string | null; } | { ...; }...'.
  Property 'select' does not exist on type '{ type: "title"; title: ({ type: "text"; text: { content: string; link: { url: string; } | null; }; annotations: { bold: boolean; italic: boolean; strikethrough: boolean; underline: boolean; code: boolean; color: "default" | ... 17 more ... | "red_background"; }; plain_text: string; href: string | null; } | { ...; }...'.

  82 |
  83 |     .filter(it => it.type === 'select')
> 84 |     .map(it => it.select)
     |                   ^
info  - Checking validity of types .%

Hi @zaerald, Im drinking coffee too.
A bit weird the typescript thing.
At first, a tip here
Instead of
    .map(it => {if (it.type === 'select') return it.select})

you can use an AND operator
    .map( it => it.type === 'select' && it.select )

In case the  it.type === 'select' is false, the map will return false, and it.select will not be executed, typescript will be happy.
Also you can set a default value with the OR operator at the end
    .map( it => condition && value || default )

The same with the inline operator
    .map( it => condition ? value : default )

with the filter think, I dont think typescript can automatically infer types when you filter an array
It is logic at runtime that after you filter the properies with an specific type, all the elements with have that type. So, is not as much recommended but you can use a typescript flag to let him know that you know there will be an error but its fine.
  db.results
    ...
    .filter(it => it.type === 'select')
    //@ts-expect-error
    .map(it => it.select)

More information at this docs

@JorgeArreolaS thanks for the tip 👌, and this now makes sense for the filter error that I encounter.

@JorgeArreolaS @zaerald Sorry for barging in like that but I had similar issues in the past with getting types on filtered arrays and I thought I would take this opportunity to share my solution.
We can use user-defined type guards or user type predicates to keep the typing accurate while using array.filter. IMHO, this makes the code a bit more readable than using a typescript flag.
I tried to make an example as simple as possible:
  type Address = { street: string };
  type PersonWithOptionalAddress = { name: string; address?: Address };
  type PersonWithRequiredAddress = { name: string; address: Address };

  const people: PersonWithOptionalAddress[] = [
    { name: 'Simon', address: { street: 'nice street' } },
    { name: 'Sarah' },
  ];

  // Will give error
  /**
   * Type 'PersonWithOptionalAddress[]' is not assignable to type 'PersonWithRequiredAddress[]'.
   * Type 'PersonWithOptionalAddress' is not assignable to type 'PersonWithRequiredAddress'.
   * Property 'address' is optional in type 'PersonWithOptionalAddress' but required in type 'PersonWithRequiredAddress'.
   **/
  const peopleMaybeAddresses: PersonWithRequiredAddress[] = people.filter(
    (person) => !!person.address,
  );

  // OK
  const peopleWithAddresses: PersonWithRequiredAddress[] = people.filter(
    (person): person is PersonWithRequiredAddress => !!person.address,
  );

Reference (a bit outdated): https://www.benmvp.com/blog/filtering-undefined-elements-from-array-typescript/
I think Typescript changed a bit from when I had to implement this "workaround" though. When using array.filter and the result is an array of primitive types, it seems that Typescript infers the result properly.
Cheers !

Closing this issue because it seems like it was not having to do with the SDK but just a typescript issue.


Mostow rigidity theorem

"By the rigidity theorem of Mostow and Prasad, if a knot complement admits a hyperbolic structure, then that structure is unique [Mostow, 1973, Prasad, 1973]. More carefully, Mostow showed that if there was an isomorphism between the fundamental groups of two closed hyperbolic 3-manifolds, then there was an isometry taking one to the other." - J. Purcell

Implemented in d5cc095


Test cleanup

Based on https://github.com/aspnet/Mvc/issues/7583#issuecomment-377984569

don't see any changes to ModelBinderFactory. Has null-coalescing already been cleaned up there?

Nope, doing a separate PR for it. This was, as the description states, to address PR comments from the older one.

any use of TestModelMetadataProvider.CreateDefaultProvider(...) remain in unit tests?

There's plenty of these for instance all HtmlHelper unit tests for instance use it - https://github.com/aspnet/Mvc/blob/dev/test/Microsoft.AspNetCore.Mvc.ViewFeatures.Test/Rendering/DefaultTemplatesUtilities.cs#L94. I don't think there's a lot of value in perusing cleaning this up any further.


Question about Compiling against an older SDK

With what Tools do I need to compile this ANE?
By the Way I am using Mac.
And I already tried it with Eclipse ADT, Android Compiler and Flash Builder with the ADT Plugin.
If I change the Runtime in the extension.xml and tried to build it with adt this error occurs:
adt -package -target ane ./AndroidFullScreen.ane extension.xml -swc swc/fullscreen-ane-android.swc -platform Android-ARM -C android . -platform Android-x86 -C android . -platform default -C default .
Invalid swc file. The extension NameSpace requires the SWF verison to be 25 or lower.
(btw. verison (version) is spelled wrong)
I have done nothing before that. I didnt compile anything, especially not the Java Part, since no Programm finds and Project in there.
-- Why do I need to compile it? --
For my Apps I am using: "Apache Flex 4.13.0 - Air 14" and I need it since in newer Versions some Buttons and Styles got removed. And the workload to fix that, would be too huge. But may be done in the future.
So I want to compile the ANE against that, older Version.
I need to have the newest Source as .ANE since there is a Bug which just got fixed in the last 2 Versions, but those need a higher Runtime.
The System UI does not get hidden after the Programm has lost Focus once, that is the Issue I am facing, which got fixed.
With friendly Regards
Jan aka. Sonorpearl

The current release build is compiled against Apache Flex 4.14.1 SDK with AIR 17.
If you're using an older SDK, try editing the namespace at the top of extension.xml in the build folder, in your case replace 17.0 with 14.0, or downloading 4.13 with AIR 17+ using the installer.
The misspelt error message comes from the SDK, so might be worth reporting here.

@neilrackett Where is 17.0 and 14.0 in extension.xml?

It's at the end of the first line and is currently set to 24.0:
<extension xmlns="http://ns.adobe.com/air/extension/24.0">


MWPW-127443: Removed Bowser.js

Resolves: MWPW-127443
Before: https://stage--dc--adobecom.hlx.live/acrobat/online/pdf-to-jpg
After: https://mwpw-127443-eliminate-bowser--dc--adobecom.hlx.live/acrobat/online/pdf-to-jpg

Codecov Report

Merging #337 (6fce461) into stage (e102ca3) will decrease coverage by 0.19%.
Report is 3 commits behind head on stage.
The diff coverage is 76.92%.

@@            Coverage Diff             @@
##            stage     #337      +/-   ##
==========================================
- Coverage   94.26%   94.07%   -0.19%
==========================================
  Files          26       23       -3
  Lines        2650     2601      -49
==========================================
- Hits         2498     2447      -51
- Misses        152      154       +2

Files Changed
Coverage Δ

.../blocks/dc-converter-widget/dc-converter-widget.js
98.99% <ø> (-0.02%)
:arrow_down:

acrobat/blocks/eventwrapper/eventwrapper.js
28.79% <25.00%> (-2.02%)
:arrow_down:

acrobat/scripts/scripts.js
95.25% <82.35%> (-1.68%)
:arrow_down:

acrobat/scripts/frictionless.js
100.00% <100.00%> (+2.81%)
:arrow_up:

... and 1 file with indirect coverage changes
:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


fix format of the local tag in bin/push-docker

The current local tag format is $(whoami)_$(date +%y%m%d_%h%m%s).
It seems the intention was to have the date as year, month, day, hour, minute, second. However, %h is a shortened month name like Aug, and %m is month. This way, month appears three time in the tag, for no reason. The correct format is %H for hours, %M for minutes and %S for seconds.
Release note:

NONE

/assign @greghanson

@vadimeisenbergibm: GitHub didn't allow me to assign the following users: greghanson.
Note that only istio members can be assigned.

In response to this:

/assign @greghanson

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@vadimeisenbergibm: The following test failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

prow/pilot-presubmit.sh
9c43c4167937d24de38a7599a1a48266758c93b0
link
/test pilot-presubmit

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

/approve

/approve
/lgtm

/retest