Softether vpn: grep command not found.

After this came out at the first time, i installed grep by: yum install grep. However, this error message still come out.

dbaflight,
The only place in the article I use grep is at the section found at the URL given below:
https://github.com/rharmonson/richtech/wiki/Installing-SoftEther-VPN-4-on-CentOS-6.5-Minimal-x86_64#enable-init-script--start-softether
You should not need to install grep for it is installed as part of the base (minimal) operating system. Or did you use a different Linux distribution or installation method from the one described here:
https://github.com/rharmonson/richtech/wiki/CentOS-6.5-Minimal-x86_64-Base-Installation-Guide
Please clarify by providing additional information if you still need further assistance. I would like to help but need more details.
R

Thanks for your reply and your valuable time!
There's additional information:
root@001 vpnserver]# make
"grep" command not found.
Installation is aborted.
make: *** [default] Error 1
[root@001 vpnserver]#
I am using Centos 6.7

Odd. Please execute the following two commands.

Please provide me your path environmental variable using "# echo $PATH" then copy and paste the results.

Here is an example from one of my hosts. Yours may differ.
[root@ns ~]# echo $PATH
/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/root/bin
[root@ns ~]#

Execute "# rpm -qi grep" and verify you don't get 'package X is not installed.' From your earlier communication, you did a yum to install which would imply it is install now, but it is odd for it should have already been installed.

If you $PATH looks good and grep is installed then we have two options. I could install 6.7 and walk through my guide and try to reproduce the error or create a new guide using CentOS 7 (1503). If I am going to take the time, I rather spend it on CentOS 7. Do you have access to the CentOS 7 (1503-1) Minimal installation media?
R

Thanks for your reply.
[root@001 ~]# echo $PATH
/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin
[root@001 ~]# rpm -qi grep
Name        : grep                         Relocations: (not relocatable)
Version     : 2.20                              Vendor: CentOS
Release     : 3.el6_7.1                     Build Date: Tue Nov 10 17:52:52 201
Install Date: Mon Nov 23 22:06:14 2015         Build Host: c6b9.bsys.dev.centosorg
Group       : Applications/Text             Source RPM: grep-2.20-3.el6_7.1.srcrpm
Size        : 1197808                          License: GPLv3+
Signature   : RSA/SHA1, Tue Nov 10 20:40:47 2015, Key ID 0946fca2c105b9de
Packager    : CentOS BuildSystem http://bugs.centos.org
URL         : http://www.gnu.org/software/grep/
Summary     : Pattern matching utilities
Description :
The GNU versions of commonly used grep utilities. Grep searches through
textual input for lines which contain a match to a specified pattern and then
prints the matching lines. GNU's grep utilities include grep, egrep and fgrep.
GNU grep is needed by many scripts, so it shall be installed on every system

Actually i am using a vps so i can simply reinstall the system.

OK. So for my benefit please share with me the installation process. For example, do you upload and attach media (ISO), netinstall, or does the VPS provider provide media (which?) and install or do they provide a base operating system to you for installing packages, configuration, etc? Do you understand my concern? If you are not using the CentOS Minimum installation media, authoring a CentOS 7 guide is not likely to resolve the problem. It might, but probably not. If the VPS is providing a base OS to you for use, then opening a service ticket with the VPS describing the issue may be an option.
I am not brushing you off on to your VPS! I do want to assist, but your operating environment is an unknown to me. Who is your VPS provider? Maybe they have a free trial I could take a peek at to potentially reproduce you symptoms.
R

The problem is solved. I opened a ticket in order to asked about this grep problem, and they gave me an answer. They said they have updated the centos6.7 ISO so I should reinstall the system. After reinstalling centos6.7, this problem is solved, everything works well. It seems that it is the idc's problem, not ours.
Thank you again for your kind help.

Awesome!
I am glad your VPS got it fixed. I will be building a new lab in 2016 and posting an updated CentOS 7 and SoftEther guide at some point. Please star and follow my github if you found it helpful.
Best wishes,
R

Just for sake of closure i found out the issue here.
The command where determines whether the grep command is available.  If the where tool isn't installed you get the "grep" command not found. when running make from the source folder.
just yum install where  ;)

Thanks to @shaunie2fly , I found out that for my CentOS 7, yum install which fixed the problem.

@danuid Thanks, had been pulling my hairs for so long, phew, finally got that working thanks to your suggestion. :)

Interesting. I have not ran into this problem, myself. Be nice to know if the OS installations where from media or a service provider. Also, what media or service provider? I suspect the botched installation are from providers not media, but..

@rharmonson  Thanks for asking, I guess it has something to do with the "minimal" part of the OS which in my example was "centos-7-x86_64-minimal" which most probably didn't have the which command. Its apparent that this command is being used directly/indirectly during the make process. Since this command was lacking from the OS, installing it manually solved the aforementioned issue.

I appreciate you all sharing the challenge. Using either the CentOS 7 minimal or netinstall and not installing any additional packages, I executed # rpm -qi which and got the following:
[root@ipa1 ~]# rpm -qi which
Name        : which
Version     : 2.20
Release     : 7.el7
Architecture: x86_64
Install Date: Sat 25 Feb 2017 06:07:21 PM PST
Group       : Applications/System
Size        : 76962
License     : GPLv3
Signature   : RSA/SHA256, Thu 03 Jul 2014 10:43:07 PM PDT, Key ID 24c6a8a7f4a80eb5
Source RPM  : which-2.20-7.el7.src.rpm
Build Date  : Mon 09 Jun 2014 07:25:22 PM PDT
Build Host  : worker1.bsys.centos.org
Relocations : (not relocatable)
Packager    : CentOS BuildSystem <http://bugs.centos.org>
Vendor      : CentOS
URL         : http://www.xs4all.nl/~carlo17/which/
Summary     : Displays where a particular program in your path is located
Description :
The which command shows the full pathname of a specified program, if
the specified program is in your PATH.

The package is installed by default. Obviously, several of you have reported the problem so on my next revision or new guide for SoftEther, I will call it out as a dependency to compile with make.
Thank you!


Research Puppeteer testing framework

References user story #73
Determine how Puppeteer is used to test Chrome extensions and how it can be implemented.
Definition of done:

[x] Find resources to learn about Puppeteer
[x] Follow a tutorial on how to utilize Puppeteer
[x] Find a method of implementing Puppeteer for our project

Finished up research, ready to implement Puppeteer.
Another quick set up and example video (not specific to extensions):
https://www.youtube.com/watch?v=URGkzNC-Nwo&ab_channel=MichaelKitas
I couldn't find a tutorial video specifically for Chrome extensions, but the Chrome developer page should be sufficient enough.
[t:30]


[All Hosts] (testing) clarify tool only works on Beta channel

Learn Build status updates of commit 80f989b:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs/includes/use-legacy-edge-or-ie.md
:white_check_mark:Succeeded
View

docs/testing/ie-11-testing.md
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the learn.microsoft.com contributor guidesPost your question in the Learn support channel

Learn Build status updates of commit 28d8fd7:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs/includes/use-legacy-edge-or-ie.md
:white_check_mark:Succeeded
View

docs/testing/ie-11-testing.md
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the learn.microsoft.com contributor guidesPost your question in the Learn support channel


Incorrect output with double bank holidays

When New Year's Day is a Saturday (okay, so this doesn't happen again 2022 now, after 2011, but still), lib/bank_holiday_generator.rb will, if I've read it right, set New Year's Day and 2nd January both to Monday 3rd January. What should happen is the 2nd is moved to 3rd automatically by statute, and the 4th will usually be manually added by proclamation (so if this script is only outputting the statutory setup, it should technically leave it on the Saturday).
A similar issue with Christmas/Boxing Days 2021, where the code will currently set both Christmas Day and Boxing Day to 27th December, missing the 28th (again, added by proclamation as a replacement for Christmas Day).
Hope that's helpful.

Probably ok to close this own now, unless your concerns have not been addressed in #86 @dracos? :)

Great, thanks :) Wonder if the code will still be in use when it comes around ;)


unseal vault error only happened on gitlab -ci

Hi all :
i can successful deploy HA cluster on my lab , but if i leverage CI to trigger
run "ansible-playbook -i /kubespray/inventory/mycluster/hosts.ini cluster.yml"
it will fail on "unseal vault " , but i don't know what is different ~
ERROR! no action detected in task. This often indicates a misspelled module name, or incorrect module path.
The error appears to have been in '/kubespray/roles/vault/handlers/main.yml': line 44, column 3, but may
be elsewhere in the file depending on the exact syntax problem.
The offending line appears to be:

name: unseal vault
^ here

Is your runner/image setup differently from your control machine ? For example mixing system packages (ansible) with pip packages (ansible-modules-hashivault) in your runner. If so, the README.md mentions a workaround.

but if i leverage CI to trigger
run "ansible-playbook -i /kubespray/inventory/mycluster/hosts.ini cluster.yml"

You must run pip install -r requirements.txt to install the dependencies on your ci runner/job

Hi all ,
thxs your help and  response ,  i did run install requirement first , below  is my batch-run in  CI stages (Install requirement on ci-runner) , and set_all.yaml  did same install requirement pkg on my master/ worker node .
Below are the details :
------- CI-Stage --------

git clone http://x.x.x.x/kubespray.git

cd /kubespray
yum -y install epel-release
easy_install pip
pip2 install jinja2 --upgrade
yum install -y wget python python36
cd /kubespray
pwd

- pip uninstall ansible-modules-hashivault

cd /kubespray/requests-2.19.1 && python setup.py install
cd /kubespray && pip install -r requirements.txt
ansible -i /kubespray/inventory/mycluster/hosts.ini all -m ping
ansible-playbook -i /kubespray/inventory/mycluster/hosts.ini set_all.yml
ansible-playbook -i /kubespray/inventory/mycluster/hosts.ini cluster.yml

----------  Ansible recap result on CI-Console -----------------
PLAY RECAP *********************************************************************
k8s-g2                     : ok=7    changed=4    unreachable=0    failed=0
k8s-g3                     : ok=7    changed=5    unreachable=0    failed=0
k8s-m1                     : ok=7    changed=4    unreachable=0    failed=0
k8s-m3                     : ok=7    changed=5    unreachable=0    failed=0
k8s-m4                     : ok=7    changed=4    unreachable=0    failed=0
Monday 22 October 2018  19:34:55 +0000 (0:01:07.603)       0:03:36.743 ********
install basic packages ------------------------------------------------- 69.83s
Install epel-release --------------------------------------------------- 68.01s
PIP Install log -------------------------------------------------------- 67.60s
Run Commands ------------------------------------------------------------ 4.06s
Clean Old artifacts ----------------------------------------------------- 3.68s
disable unused services ------------------------------------------------- 3.11s
replace line ------------------------------------------------------------ 0.40s
$ ansible-playbook -i /kubespray/inventory/mycluster/hosts.ini cluster.yml
The offending line appears to be:

name: unseal vault
^ here

The error appears to have been in '/kubespray/roles/vault/handlers/main.yml': line 44, column 3, but may
be elsewhere in the file depending on the exact syntax problem.

Just an update , i try to not run "Install requirement.txt" in the CI Stages , i pre-installed on the runner  docker image ,then will be not stuck , don't know why  ,but thxs all

you can try to use the kubespray docker image we are using in the CI:
quay.io/kubespray/kubespray:v2.7

Got it ~ appreciated !


No image mode

Enum

Show images (default)
Block images
Show images only via Wi-Fi

Reference

https://github.com/jocmp/capyreader/discussions/461

This is available as of 2024.11.1078-dev.


NotImplementedError: The Cell2location model currently does not support minified data.

with stereoseq and single cell  raw counts data, I got the error: NotImplementedError: The Cell2location model currently does not support minified data., But the data I use is the raw counts
Please use the template below to post a question to https://discourse.scverse.org/c/ecosytem/cell2location/.
Problem

...

[ ] I follow the instructions from the cell2location tutorial (using on scvi-tools).
[ ] I have adjusted required hyperparameters to my dataset and tissue N_cells_per_location and detection_alpha.
[ ] I have provided 10X reaction/inlet as batch_key for reference NB regression.
[ ] I have checked scverse Discourse and old Cell2location Community Forum, and did not find a solution.

Description of the data input and hyperparameters

...

...
Single cell reference data: number of cells, number of cell types, number of genes

...
Single cell reference data: technology type (e.g. mix of 10X 3' and 5')

...
Spatial data: number of locations numbers, technology type (e.g. Visium, ISS, Nanostring WTA)

...

May be somthing was wrong, But I don't known, I need some help. Below is the versions I use. Thank you!
 I transformed it to a adata file. and the adata.X is the raw matrix. I don't know what is wrong

Can you please provide a reproducible example of your code? and the full traceback?

my code is Refer to the tutorial to run the pipeline, the tutorial is in https://cell2location.readthedocs.io/en/latest/notebooks/cell2location_tutorial.html#Cell2location:-spatial-mapping. The difference is tutorial data is 10x space, and My data is stereoseq.  The code was error with mod = cell2location.models.Cell2location(
adata_vis,
cell_state_df=inf_aver,
# the expected average cell abundance: tissue-dependent
# hyper-prior which can be estimated from paired histology:
N_cells_per_location=10,
# hyperparameter controlling normalisation of
# within-experiment variation in RNA detection:
detection_alpha=20
)
import sys,os
import scanpy as sc
import anndata
import pandas as pd
import numpy as np
import matplotlib.pyplot as plt
import matplotlib as mpl
from collections import defaultdict as dt
import cell2location
import scvi
from matplotlib import rcParams
rcParams['pdf.fonttype'] = 42 # enables correct plotting of text for PDFs
if len(sys.argv) !=7:
print(f"python %s  <adata_vis> <adata_ref>  <sample_name> <mod_name>" % sys.argv[0])
sys.exit(0)
results_folder = sys.argv[1]
adata_vis = sc.read_h5ad(sys.argv[2]) ## spatial h5ad
adata_ref = sc.read_h5ad(sys.argv[3]) ## single cell h5ad
target = sys.argv[4]
adata_ref.dict['_raw'].dict['_var'] = adata_ref.dict['_raw'].dict['_var'].rename(columns={'_index': 'features'})
adata_ref.raw.var.index = adata_ref.raw.var["features"]
adata_ref = adata_ref.raw.to_adata()
adata_ref.obs["region"] = adata_ref.obs["region"].astype("category")
adata_ref.obs["batch"] = adata_ref.obs["batch"].astype("category")
adata_ref.obs["Time"] = adata_ref.obs["Time"].astype("category")
adata_ref.obs[target] = adata_ref.obs[target].astype("category")
sample = sys.argv[5]  ##sample_name
mod_name = sys.argv[6]  ##mod name saved
create paths and names to results folders for reference regression and cell2location models
ref_run_name = f'{results_folder}/reference_signatures'
run_name = f'{results_folder}/cell2location_map'
if not os.path.exists(ref_run_name): os.makedirs(ref_run_name)
if not os.path.exists(run_name): os.makedirs(run_name)
adata_vis.uns = dt(dict)
adata_vis.uns['spatial']["sample"] = sample
find mitochondria-encoded (MT) genes
adata_vis.var['MT_gene'] = [gene.startswith('mt-') for gene in adata_vis.var_names]
remove MT genes for spatial mapping (keeping their counts in the object)
adata_vis.obsm['MT'] = adata_vis[:, adata_vis.var['MT_gene'].values].X.toarray()
adata_vis = adata_vis[:, ~adata_vis.var['MT_gene'].values]
adata_ref.var['SYMBOL'] = adata_ref.var_names
rename 'GeneID-2' as necessary for your data
#adata_ref.var.set_index('GeneID-2', drop=True, inplace=True)
from cell2location.utils.filtering import filter_genes
selected = filter_genes(adata_ref, cell_count_cutoff=5, cell_percentage_cutoff2=0.03, nonz_mean_cutoff=1.12)
print(selected)
filter the object
#adata_ref = adata_ref[:, selected].copy()
adata_ref = adata_ref[:, selected]
#adata_ref.write("adata_ref.h5ad")
prepare anndata for the regression model
cell2location.models.RegressionModel.setup_anndata(adata=adata_ref,
# 10X reaction / sample / batch
batch_key='batch',
# cell type, covariate used for constructing signatures
labels_key=target,
# multiplicative technical effects (platform, 3' vs 5', donor effect)
categorical_covariate_keys=['region']
)
create the regression model
from cell2location.models import RegressionModel
mod = RegressionModel(adata_ref)
view anndata_setup as a sanity check
mod.view_anndata_setup()
mod.train(max_epochs=250, use_gpu=True)
mod.plot_history(20)
plt.savefig(f"{results_folder}/mod.plot_history.pdf")
In this section, we export the estimated cell abundance (summary of the posterior distribution).
adata_ref = mod.export_posterior(
adata_ref,
sample_kwargs={'num_samples': 2000, 'batch_size': 2000, 'use_gpu': True}
)
Save model
mod.save(f"{mod_name}", overwrite=True)
adata_file = f"{ref_run_name}/sc.h5ad"
adata_ref.write(adata_file)
mod.plot_QC()
plt.savefig(f"{results_folder}/mod.plot_QC.pdf")
export estimated expression in each cluster
if 'means_per_cluster_mu_fg' in adata_ref.varm.keys():
inf_aver = adata_ref.varm['means_per_cluster_mu_fg'][[f'means_per_cluster_mu_fg_{i}'
for i in adata_ref.uns['mod']['factor_names']]].copy()
else:
inf_aver = adata_ref.var[[f'means_per_cluster_mu_fg_{i}'
for i in adata_ref.uns['mod']['factor_names']]].copy()
inf_aver.columns = adata_ref.uns['mod']['factor_names']
inf_aver.to_csv(f"{results_folder}/inf_aver.txt", index=True, header=True)
##Cell2location：空间映射
find shared genes and subset both anndata and reference signatures
intersect = np.intersect1d(adata_vis.var_names, inf_aver.index)
print(intersect[1:10])
adata_vis = adata_vis[:, intersect].copy()
adata_vis.write("sp.h5ad")
inf_aver = inf_aver.loc[intersect, :].copy()
prepare anndata for cell2location model
cell2location.models.Cell2location.setup_anndata(adata=adata_vis, batch_key="orig.ident")
create and train the model
mod = cell2location.models.Cell2location(
adata_vis,
cell_state_df=inf_aver,
# the expected average cell abundance: tissue-dependent
# hyper-prior which can be estimated from paired histology:
N_cells_per_location=10,
# hyperparameter controlling normalisation of
# within-experiment variation in RNA detection:
detection_alpha=20
)

What is minified data?
@forrwill I can recommend trying to make sure that the adata.X or adata.layers["whatever slow you are using"] is scipy.sparse.csr_matrix and data type is "float32":
adata.X = scipy.sparse.csr_matrix(adata.X, dtype="float32")

Thank you, I will check it.

@forrwill can you provide a full traceback of the error?

Do you mean the log file? or the input data I use

      extra_categorical_covs State Registry

┏━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━┓
┃  Source Location   ┃ Categories ┃ scvi-tools Encoding ┃
┡━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━┩
│ adata.obs['batch'] │   W   │          0          │
│                    │  XC   │          1          │
│                    │            │                     │
└────────────────────┴────────────┴─────────────────────┘
/soft/Miniconda3/envs/cell2loc_env/lib/python3.9/site-packages/lightning_fabric/plugins/e
rank_zero_warn(
GPU available: True (cuda), used: True
TPU available: False, using: 0 TPU cores
IPU available: False, using: 0 IPUs
HPU available: False, using: 0 HPUs
/soft/Miniconda3/envs/cell2loc_env/lib/python3.9/site-packages/lightning_fabric/plugins/e
rank_zero_warn(
/soft/Miniconda3/envs/cell2loc_env/lib/python3.9/site-packages/pytorch_lightning/trainer/
rank_zero_warn("You passed in a val_dataloader but have no validation_step. Skipping val loop.")
You are using a CUDA device ('NVIDIA A800 80GB PCIe') that has Tensor Cores. To properly utilize them, you should set `torch.set_float32_matmul
LOCAL_RANK: 0 - CUDA_VISIBLE_DEVICES: [1]
/soft/Miniconda3/envs/cell2loc_env/lib/python3.9/site-packages/pytorch_lightning/trainer/
rank_zero_warn(
^MTraining:   0%|                                                                                | 0/250 [00:00<?, ?it/s
^MEpoch 250/250: 100%|███████████████████████████████████████████████████████████| 250/250 [03:39<00:00,  1.14it/s, v_num=1, elbo_train=1.62e+8
^MSampling local variables, batch:   0%|                                                                                | 0/75 [00:00<?, ?it/s
^MSampling global variables, sample:   0%|                                                                              | 0/199 [00:00<?, ?it/s
Traceback (most recent call last):
File "./cell2loc_mapping.py", line 135, in
mod = cell2location.models.Cell2location(
File "/soft/Miniconda3/envs/cell2loc_env/lib/python3.9/site-packages/cell2location/mode
super().init(adata)
File "/soft/Miniconda3/envs/cell2loc_env/lib/python3.9/site-packages/scvi/model/base/_b
raise NotImplementedError(
NotImplementedError: The Cell2location model currently does not support minified data.

Which model are you attempting to train? The error message suggests cell2location.models.Cell2location but the number of epochs is for the regression model.
We strongly don't recommend minibatch training (batch_size=number) for cell2location.models.Cell2location because it gives lower accuracy and requires extremely long training. You have a fairly large GPU so please try using full data training (batch_size=None).
If you really need and would like to try limiting batch_size, you need to use our experimental amortised inference approach which uses a neural network to approximate cell abundance. This approach is generally less sensitive (especially low count data such as Stereoseq) - but on good quality data (such as human lymph node and mouse brain used in cell2location paper) it can give very similar results to our preferred approach. You can try aggregating Stereoseq locations to get higher data quality. See here for the required settings https://github.com/BayraktarLab/cell2location/discussions/264#discussioncomment-5341068 and please post the exact code you will use here to make sure this approach is used correctly.
It could be possible that cell2location.models.Cell2location doesn't support minified data - but I don't know what minified data is.
Just a tip: wrap your code into backticks to display it nicely:
"```python"
"```"


v0.1 Release

This issue tracks our initial release: v0.1.0 which should include the following features & functionality:

Color

IBM Design Language colors
Carbon Design System tokens
Support for each theme

Layout

Spacing scale
Breakpoints

Typography

font scale
font family
Ideally, this should include type tokens

Stretch Goals

Aspect ratio support
Light / dark mode support

Could add a checkbox or a progress percentage for each bullet point on the issue? So we could track easier how the release is going.
Also, should be good to add some carbon documentation / source code for each doc, so we can reach the source values easier when debugging / fixing / adding new functionalities


DEV:LOG: Implementation of "Delete channel from ChannelSet by ChannelSet UUID and mnemonic" has a bad URL

While documenting Drillflow's URLs that are configurable by SLB, I noticed that the following URL does not match SLB's API:
Drillflow:

https://demo.slb.com/democore/channelreader/v4/witsml/channels/:mnemonic
SLB's API:

https://api-demo.nam.drillops.slb.com/democore/channelreader/v4/witsml/channels/{mnemonic}?channelSetUuid={channelSetUuid}
Explanation:

The URL to use for this REST call should be:
https://api-demo.nam.drillops.slb.com/democore/channelreader/v4/witsml/channels/
{mnemonic} is a variable to be provided within the REST code and is not a hard-coded part of the SLB API's URL.
Further explanation as provided within SLB's API provides further clarity:
Delete channel from ChannelSet by ChannelSet UUID and mnemonic. Both Channel metadata and data will be deleted.
mnemonic is expected to be provided and not hard-coded.
Further Ask:

Who assumes this card will need to also generate a QA card and add to Docs (envvars.rst).

UPDATE: I have not included this documentation into envvars.rst (Drillflow documentation) because I think this endpoint is part of the "bug":
:Variable:
LOG_MNEMONIC_PATH
:Description:
The path to use to get to the
:Variable:
LOG_MNEMONIC_PATH
:Description:
The path to use to get to the
:Default:
https://demo.slb.com/democore/channelreader/v4/witsml/channels/:mnemonic
:Required:
NO (default will be used)
:Example Environmental Switch in Docker:
To set to https://prod.slb.com/channelreader/v5/witsml/channels/:mnemonicDefault:
https://demo.slb.com/democore/channelreader/v4/witsml/channels/:mnemonic
:Required:
NO (default will be used)
:Example Environmental Switch in Docker:
To set to https://prod.slb.com/channelreader/v5/witsml/channels/:mnemonic

UPDATE: This does not appear to be implemented in the code base & Chris says that we will never use this endpoint. It is correct that is should not be included within the documentation, but it should be removed from the code base.

This is fixed in container 0.18.1


Add texts for visitors hub

TODOs

[x] update links
[x] intro + overview text
[x] card texts

implemented


Error NoPermissions:Formatting on the unsaved file

Issue Type: Bug
Python extension output:
Error 2021-05-14 17:06:55: Failed to create a temporary file [NoPermissions (FileSystemError): Unable to write file '/Untitled-1.13264068d108c6901b3592ea654fcd57.tmp' (NoPermissions (FileSystemError): Error: EACCES: permission denied, open '/Untitled-1.13264068d108c6901b3592ea654fcd57.tmp')
	at _handleError (/usr/share/code/resources/app/out/vs/workbench/services/extensions/node/extensionHostProcess.js:87:156478)
	at runMicrotasks (<anonymous>)
	at processTicksAndRejections (internal/process/task_queues.js:93:5)
	at async y.writeText (/home/jack/.vscode/extensions/ms-python.python-2021.5.829140558/out/client/extension.js:9:344845)
	at async Object.t.getTempFileWithDocumentContents (/home/jack/.vscode/extensions/ms-python.python-2021.5.829140558/out/client/extension.js:9:360722)
	at async l.provideDocumentFormattingEdits (/home/jack/.vscode/extensions/ms-python.python-2021.5.829140558/out/client/extension.js:9:373955)] {
  code: 'NoPermissions'
}

Extension version: 2021.5.840043038
VS Code version: Code 1.56.1 (e713fe9b05fc24facbec8f34fb1017133858842b, 2021-05-06T10:08:16.954Z)
OS version: Linux x64 5.4.0-42-generic
OS: Ubuntu 20.04.2

System Info

Item
Value

CPUs
Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz

GPU Status
2d_canvas: enabledgpu_compositing: enabledmultiple_raster_threads: enabled_onoop_rasterization: disabled_offopengl: enabled_onrasterization: disabled_softwareskia_renderer: enabled_onvideo_decode: disabled_softwarevulkan: disabled_offwebgl: enabledwebgl2: enabled

Load (avg)
2, 1, 1

Memory (System)
15.55GB (0.30GB free)

Process Argv
--no-sandbox --unity-launch --crash-reporter-id d1342c61-ab2f-444c-8817-05c0593ae50f

Screen Reader
no

VM
67%

DESKTOP_SESSION
ubuntu

XDG_CURRENT_DESKTOP
Unity

XDG_SESSION_DESKTOP
ubuntu

XDG_SESSION_TYPE
x11

A/B Experiments
vsliv368:30146709
vsreu685:30147344
python383cf:30185419
pythonvspyt602:30300191
vspor879:30202332
vspor708:30202333
vspor363:30204092
pythonvspyt639:30300192
pythontb:30283811
pythonvspyt551:30291414
vspre833:30267464
pythonptprofiler:30281270
vshan820:30294714
vscorecescf:30290706
pythondataviewer:30285071
vscus158:30286553
vscgsv2:30301612
bridgeflightcf:30299255
vscod805:30301674

@Honghe Can you check if you have TMP, TEMP, TMPDIR either of them set to a directory where you have write permissions? If you are using formatter like black we currently have to use a temp file to format it.

@karrtikr The default formatting provide is autopep8. and it still doesn't work even I start code via:
mkdir $HOME/tmp
TMP=$HOME/tmp code .

@Honghe This is what I have for tmp folder:

I also recommend trying to set all three variants of the temp env variable. Also, see if you can use mktemp from the VS Code terminal to create a temp file.

TMP=$HOME/tmp TEMP=$TMP TMPDIR=$TMP code .

Test command in the VS Code terminal:
~/vscodeprojects
$ echo $TMP
/home/jack/tmp

~/vscodeprojects
$ echo $TMPDIR
/home/jack/tmp

~/vscodeprojects
$ echo $TEMP
/home/jack/tmp

~/vscodeprojects
$ mktemp
/home/jack/tmp/tmp.S4hiJyuTDa

But the formatting error still occurs:
Error 2021-05-18 16:36:46: Failed to create a temporary file [NoPermissions (FileSystemError): Unable to write file '/Untitled-1.13264068d108c6901b3592ea654fcd57.tmp' (NoPermissions (FileSystemError): Error: EACCES: permission denied, open '/Untitled-1.13264068d108c6901b3592ea654fcd57.tmp')
	at _handleError (/usr/share/code/resources/app/out/vs/workbench/services/extensions/node/extensionHostProcess.js:87:156478)
	at processTicksAndRejections (internal/process/task_queues.js:93:5)
	at async y.writeText (/home/jack/.vscode/extensions/ms-python.python-2021.5.842923320/out/client/extension.js:9:344845)
	at async Object.t.getTempFileWithDocumentContents (/home/jack/.vscode/extensions/ms-python.python-2021.5.842923320/out/client/extension.js:9:360722)
	at async l.provideDocumentFormattingEdits (/home/jack/.vscode/extensions/ms-python.python-2021.5.842923320/out/client/extension.js:9:373955)] {
  code: 'NoPermissions'
}

I've been getting this same error for a few days now:
This is in the Log (Extension Host) in my output tab

Error (FileSystemError): Unable to write file '/Untitled-2.387795c86765346eca0c041bac00348b.tmp' (Unknown (FileSystemError): Error: EROFS: read-only file system, open '/Untitled-2.387795c86765346eca0c041bac00348b.tmp')
	at _handleError (/Applications/Visual Studio Code.app/Contents/Resources/app/out/vs/workbench/services/extensions/node/extensionHostProcess.js:84:155975)
	at runMicrotasks (<anonymous>)
	at processTicksAndRejections (internal/process/task_queues.js:93:5)
	at async y.writeText (/Users/cdestigter/.vscode/extensions/ms-python.python-2021.7.992362372-dev/out/client/extension.js:9:344068)
	at async Object.t.getTempFileWithDocumentContents (/Users/cdestigter/.vscode/extensions/ms-python.python-2021.7.992362372-dev/out/client/extension.js:9:359945)
	at async h.provideDocumentFormattingEdits (/Users/cdestigter/.vscode/extensions/ms-python.python-2021.7.992362372-dev/out/client/extension.js:9:373178)

Not sure if related, but the Python log has this stuff in it:
Python interpreter path: /usr/local/bin/python3.8
Python interpreter path: /usr/local/bin/python3.7
Python interpreter path: /usr/local/bin/python3.8
Python interpreter path: /usr/local/bin/python3.7
Python interpreter path: /usr/local/bin/python3.8
Python interpreter path: /usr/local/bin/python3.7

Every time I switch context to a python file, one more of each interpreter shows up in the log. Weird huh? My interpreter in the User settings is set to /usr/local/bin/python3.7 so I'm not clear on where the 3.8 is coming from.
With either of those interpreters, I can run import tempfile ; print(tempfile.gettempdir()) and I get the expected result: /var/folders/4b/xwkgxs8x5y55f33bqm_8mjdc0000gn/T (which is the value of the TMPDIR env var)

I am getting same error(my OS is windows)

I have set TMP, TEMP, TMPDIR path to a different folder still I am getting error while formatting python code without saving

@karthiknadig

This happens if the VS Code instance for some reason does not pick up TMP, TEMP changes. Unfortunately, the temp file creation is handled by an external library. A generic solution to this is to not create the temp file in the first place. We have plans to implement this via Language Server Protocol. This will allow us to solve formatting problem for python files and notebook scenarios.
So closing this in favor of #17918


Problem with listeningToModelEvents([ ])

Using the test code:
$LocationsTable = LocationFactory::make()
    ->listeningToModelEvents(
        [
            'Model.beforeSave' => 'beforeSave',
        ]
    )
    ->persist();

the event is failing to run.
In an attempt to find the problem, I looked at the EventCollector after the listeningToModelEvents() method ran and saw this:
object(CakephpFixtureFactories\Factory\EventCollector) id:0 {
  private listeningBehaviors => [
    (int) 0 => 'Timestamp'
  ]
  private listeningModelEvents => [
    'Model.beforeSave' => 'beforeSave'
  ]
  private defaultListeningBehaviors => [
    (int) 0 => 'Timestamp'
  ]
  private factory => object(App\Test\Factory\LocationFactory) id:1 {
    protected applyListenersAndBehaviors => false
    protected marshallerOptions => [
      'validate' => false,
      'forceNew' => true
    ]
    protected saveOptions => [
      'checkRules' => false,
      'atomic' => false,
      'checkExisting' => false
    ]
    protected withModelEvents => false
  }
  private rootTableRegistryName => 'Locations'
}

The last property of the LocationFactory reads protected withModelEvents => false.
Based on this information I set LocationFactory::withModelEvents to true and the events ran properly. With this property set it does not matter whether I use the method listeningToModelEvents().
Either the code is wrong or this section of the documentation is wrong.

@dreamingmind which version of the Plugin are you using? Have you tried with the latest?

Ach! I'll get back to you on this. Probably my error.

O.K., I'll close it for the moment, feel free to re-open!

My issue appears to be with associated tables failing to run configured events.
I have a record Items which hasMany('Skus'). Skus are configured to use events in this way:
protected function setDefaultTemplate(): void
{
    $this->setDefaultData(function(Generator $faker) {
        return [
//          'hash' => $faker->text(20), //this should be set by the event
            'name' => $faker->text(15),
            'code' => $faker->text(5),
        ];
    })
        ->listeningToModelEvents(['Model.beforeSave']);
}

This code produces all the required records but does not run the events for Skus:
//In a test class
    public function testItem()
    {
        ItemFactory::make()->standAloneItem()->persist();
    }

//in the ItemFactory
    public function standAloneItem($parameter = null, int $n = 1): ItemFactory
    {
        return $this
            ->withPrimarySku()
            ->with('Tenant.Warehouse');
    }

    public function withPrimarySku($parameter = null): ItemFactory
    {
        return $this->with(
            'PrimarySku',
            \App\Test\Factory\SkuFactory::make(['base_sku' => 1])
        );
    }

If I call the SkuFactory directly, the configured events will run.
This code for example will produce one sku without the event running and a second with the event running.
    public function testSku() {
        $item = ItemFactory::make()->standAloneItem()->persist();
        SkuFactory::make(['item_id' => $item->id, 'tenant_id' => $item->tenant->id])->persist();
    }

I'm currently in Cake 4.1.6 and FixtureFactory 2.1.0

I don't know how to re-open this issue. Should I just make a new one?

@dreamingmind I see your issue. The event manager will apply the beforeSave event to the ItemFactory, but not to its associations.
Therefore, in testSku(), the event is not triggered when Skus are associated, but triggered when called directly.
I agree that this behavior of the package is wrong, since per default the SkuFactory listens to the beforeSave event. The event should be triggered.
I suggest as a turn around that you explicitly enable the event in your ItemFactory as follows
public function withPrimarySku($parameter = null): ItemFactory
    {
        return $this->with(
            'PrimarySku',
            \App\Test\Factory\SkuFactory::make(['base_sku' => 1])->listeningToModelEvents(['Model.beforeSave'])
        );
    }

Does this trigger the beforeSave event?
I have re-opened the issue and will work in the coming days on a fix.

@dreamingmind I have added a few tests to make sure that the model events were triggered in associations too. They are, including when the event is activated in the defautl template.
You can have a look here:
https://github.com/vierge-noire/cakephp-fixture-factories/blob/master/tests/TestCase/Factory/EventCollectorTest.php#L329
You can ignore my previous post. The error seems to be on your side. Which version of the plugin do you use? Do you use the latest v2.1.0 (v1.1.0 on Cake3)?

Ok. I'm digging deeper. I've pulled your recent code and see the passing test. I'll see if I can either figure out what's wrong or write a failing test.

@dreamingmind can I close this for now?

Yes. I got sidetracked on another time sensitive task and will open a new issue if my research turns something up.
The two specific details I will look into is the use of a static callable in the event handler and the triggering of an event that is more than 1 association away.
Thanks


cannot update with extra conditions in BaseActiveRecord

What steps will reproduce the problem?
The update function in yii\db\BaseActiveRecord  is
public function update($runValidation = true, $attributeNames = null)

when execute db update operation , the default condition is the old primary key  , you cannot add extra conditions .
What is the expected result?
It should support update with extra conditions in BaseActiveRecord .
What do you get instead?
maybe we can modify the original update function  or add a new function :
public function updateWithCondition($extraConditions,$runValidation = true, $attributeNames = null)

Additional info

Q
A

Yii version
2.0.?

PHP version

Operating system

update always call on exist record (model)
what is condition for record ?

If you call a non static update on AR instance, it is pretty logical that it will run on that instance. If you need to update more than one record or if you need extra conditions then you should use
http://www.yiiframework.com/doc-2.0/yii-db-activerecord.html#updateAll()-detail


Pixel coords for the image crop

Apparently the additional parameter pixelCrop of onChangeComplete is always undefined.
And also, is there any way to set the crop on pixel units? Instead of converting it from pixel units to percentage every time in order to use it?

Hi @riccardolorenzon updating the README was confusing because that version isn't released yet. RC7 only passes the normal crop object. If you want it to pass pixels then your should also pass the outputPixelUnits prop. At the moment there is no way to pass pixels in because it would require another property or for values to specify a unit e.g. instead of 220 it would be 220px as there is no way to determine whether the passed in values are pixels or percentages. I'll consider it for the next version though. In the mean time you could do the calculation yourself to convert pixels to percentages.

hi @DominicTobias, thank you for the quick reply.
Any suggestions on how to get the natural height and width of the image without loading it again?

I used the natualHeight and naturalWidth img properties: http://www.w3schools.com/jsref/prop_img_naturalheight.asp

I just updated the component to the last version.
Is it now possible to specify the crop coordinates using pixels? i can't find that part on the docs.

Hi @riccardolorenzon no there isn't and there is no intention of adding this, most other cropping tools out there use pixels so if you prefer that you might be better off with them (it would complicate the code base too much to add support for both). The point of using percentages is so that when the crop is resized it is still correct (responsive) - there is no need to write an algorithm to detect if the crop element resizes, poll for it, and recalc the crop. This makes it smoother and the code simpler (it just works), the drawback is that if you want to pass pixels in then you have to calc them. Although you do get passed the pixels in onComplete and onChange for convenience of passing that to e.g. a backend, you are still supposed to pass in percentages.

Doing this is really easy. Here's how my component looks:
getBase64(file) {
    this.setState({ loading: true, file });

    let reader = new FileReader();
    reader.readAsDataURL(file);
    reader.onload = () => {
      var image = new Image();
      image.src = reader.result;

      image.onload = () => {
        this.setState({
          loading: false,
          image: reader.result,
          height: image.height,
          width: image.width,
        });
      };
    };
    reader.onerror = error => console.log('Error: ', error);
  }

Get the  base64 of a file object, render it to an image, get the height and width. Then, pass the height and width to your cropper props, something like this:

          minWidth: 1920 / image.width * 100,
          minHeight: 350 / image.height * 100,
          maxWidth: 1920 / image.width * 100,
          maxHeight: 350 / image.height * 100,

Now you have percentages from pixels, for anyone else who needs it :)

I used the natualHeight and naturalWidth img properties: http://www.w3schools.com/jsref/prop_img_naturalheight.asp

Getting naturalWidth and naturalHeight as 0, any idea why?


Benchmark on c2-standard-60 in background

Run x86_64 benchmarks on c2-standard-60 VM but don't publish to the dashboard.
I'm planning to collect the data for 1~2 weeks to ensure there is no issue to switch to c2-standard-60 VM (we expect to see more stable benchmark results with c2-standard-60). It currently takes almost the same time as benchmarking with c2-standard-16, so we don't slow down the CI.
#14661

Is the plan to run the benchmarks with the same number of max threads (8) or more threads since c2-standard-60 can support more?

We can config the benchmarks with more cores later. Currently we want to make sure there is no regression on the stability.


fix: make provider bridgeable

In order to generate a Pulumi provider with tf-bridge, the code must be moved out of the internal package

@rawkode I am going to accept this PR onto another branch owned by the repo to remove issues about accessing secrets in the execution of GH Actions.  The new branch will be RedisLabs:fix/merge-of-make-provider-bridgeable and I will raise a PR from there.


Automate K8s deployment and K8s stack upgrade

Currently we have automated way to deploy K8s environment.
We need to have the ability to upgrade k8s stack (force upgrade to the same version).
After k8s stack upgrade is available , following stress test workflow needs to be implemented:
Loop for 100 times
   Create a new Kubernetes environment
   Add 4 hosts
   Wait until Kubernetes is deployed
   Ensure we can access the Dashboard
   Deploy a Kubernetes yaml
   Deploy a Helm template
   Loop for 10 times
      Upgrade to the same Kubernetes version
      Ensure the Dashboard and kubectl still work
      Ensure the Kubernetes app and Helm app still work
   Delete the Kubernetes environment

The single stress testing case now include the following:
Ensure we can access the Dashboard - test case #1
Deploy/Validate a Kubernetes yaml (Pre upgrade stack) - test case #2
Validate Helm (Deploy/Test/Delete) a release - test case #3
Loop for N times - test case #4
   Force Upgrade IPSEC
   Validate Kubectl
   Validate Dashboard
   Modify Pre Upgrade stack
   Create Post Upgrade stack
   Validate Post Upgrade Stack
   Validate Helm

https://github.com/rancher/validation-tests/pull/344


issue 355 'boon saves empty attributes' https://github.com/boonprojec…

…t/boon/issues/355

Merged and tested.


Move to CPM, simplify

Codecov Report
Patch coverage has no change and project coverage change: -7.18 :warning:

Comparison is base (638eafa) 17.33% compared to head (2c28ba5) 10.16%.

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
Additional details and impacted files
@@            Coverage Diff             @@
##             main      #15      +/-   ##
==========================================
- Coverage   17.33%   10.16%   -7.18%
==========================================
  Files           3        3
  Lines         225      187      -38
  Branches      119      127       +8
==========================================
- Hits           39       19      -20
+ Misses        155      146       -9
+ Partials       31       22       -9

Flag
Coverage Δ

Linux
10.16% <ø> (+6.04%)
:arrow_up:

Windows
?

macOS
?

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

test/constexpr_tests.cpp
50.00% <ø> (-50.00%)
:arrow_down:

test/tests.cpp
50.00% <ø> (-50.00%)
:arrow_down:

... and 1 file with indirect coverage changes
Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


allow unaligned reads with _mm_loadl_epi64

As discussed in #582 it is "safe" to read unaligned memory locations with _mm_loadl_epi64. This code was suggested by scottmcm in the Rust Discord - I'm not familiar enough with this part of Rust to offer much commentary on it.
But to note, I have tried this with my code that uses this intrinsic and am seeing the behavior I'd expect to see.

So I cleaned up my example and got the right flags so that godbolt shows what I think is the right instructions. I'm not sure how to translate this into Rust though.
https://gcc.godbolt.org/z/EZv0qv
Notably,
_mm_loadl_epi64(...);
_mm_storel_epi64(...);

becomes
        mov     rax, qword ptr [rdi + 24]
        mov     qword ptr [rdi + 40], rax

It's weird that it takes a qword ptr because I think it really only is loading a dword here, though I guess I have nothing to base that on.

It's weird that it takes a qword ptr because I think it really only is loading a dword here, though I guess I have nothing to base that on.

So the Intrinsics Guide says these should lower to a movq, but these intrinsics are so simple, that the code that they will lower to will heavily depend on what the code at the call site around them is doing because LLVM can easily reason about them.
When we merge this, you can try them in your app, and if you see unexpected code generation we can revise their implementation.

So I'm looking at the trace in my actual program, and I believe the C version which uses _mm_loadl_epi64 is emitting movq while Rust (with this patch) is emitting vmovqdu. It's unclear if this is because llvm is unable to optimize the Rust version for some reason or if the C version has just correctly determined that only a quadword is needed, not a double quadword.

I wonder if the right code here isn't just
    _mm_set_epi64x(0, ptr::read_unaligned(mem_addr as *const i64))

That could work too. Could you modify your stdsimd copy locally, and use it in your project, and report whether that works better?

Yes, it does emit movq. It's hard to say whether that's generally faster, but it does seem closer to the original spirit of the intrinsic.


[$1000] Chat -  "Report no longer exists" message upon removing image that has deleted thread

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Action Performed:

Open staging.new.expensify.com
Send an image to a chat
Make a thread on that message using Reply in thread
From the thread chat, leave the thread by Details > Leave thread
Delete the image

Expected Result:
Image removed successfully without any error
Actual Result:
Empty image returned with the error "Report no longer exists" after deletion
Workaround:
Unknown
Platforms:

Which of our officially supported platforms is this issue occurring on?

[ ] Android / native
[ ] Android / Chrome
[ ] iOS / native
[ ] iOS / Safari
[x] MacOS / Chrome / Safari
[ ] MacOS / Desktop

Version Number: <IP_ADDRESS>
Reproducible in staging?: Yes
Reproducible in production?: yes
If this was caught during regression testing, add the test name, ID and link from TestRail:
Email or phone of affected tester (no customers):
Logs: https://stackoverflow.com/c/expensify/questions/4856
Notes/Photos/Videos: Any additional supporting documentation
https://github.com/Expensify/App/assets/93399543/63911b09-8869-4dbc-a129-70e0be560e92
https://github.com/Expensify/App/assets/93399543/6ad7a660-4b0e-40fc-b81e-6948839dec79
Expensify/Expensify Issue URL:
Issue reported by: @kerupuksambel
Slack conversation: https://expensify.slack.com/archives/C049HHMV9SM/p1684468035059069
View all open jobs on GitHub
Upwork Automation - Do Not Edit

Upwork Job URL: https://www.upwork.com/jobs/~0170002ec496e4cb5d
Upwork Job ID:<PHONE_NUMBER>181433856
Last Price Increase: 2023-06-08

Nice, all reproduced

Reproduced on Staging and Production, by the way

I think rendering doesn't seem to work reliably.
Leave this problem to me and I will fix it.

Proposal
Please re-state the problem that we are trying to solve in this issue.
Empty image returned with the error "Report no longer exists" after deletion.
What is the root cause of that problem?
After creating & leaving the thread, then deleting the attachment

the back-end responds with:

So, we update Onyx with the failure data.

We still see the message after refreshing the page.
We don't see the message after deleting the data in the Onyx database, and then refresh the page.

It looks like even though the back-end responds with this data, the attachment is actually deleted, so after deleting the data in the local database & refreshing the page, the message dissapears.
What changes do you think we should make in order to solve the problem?
Have someone from back-end investigate step by step the call for this case in order to see where the problem occurs.

I think this issue might have the same root cause as this one. Maybe we could put it on hold and test it again when the other one gets fixed? What do you think @mananjadhav ?

Yeah I agree, we should put this one on Hold.

On hold for https://github.com/Expensify/App/issues/19078!

Similar issue reported here - https://github.com/Expensify/App/issues/19707 - do you think we could combine these into one job? cc @mananjadhav @cristipaval

The issues are different, but they might have the same root cause. My recommendation is to also put yours on hold for this one. What do you @mananjadhav think?

Still on hold.

Moving to Weekly given that this is on hold

No more on hold, and still reproducible.

This one should be fixed internally.

@cristipaval If it's going to be fixed internally and the fix will be related to this Proposal, will it matter?
Asking out of curiosity, thank you!

https://github.com/Expensify/App/issues/19078 is on production, so we can move forward with this!

@chiragsalian I need your inpout here.
I did some investigation and it happens as following:

The user leaves the thread, which means that their authToken is not authorized anymore to access the childReport
The user then deletes the reportAction, this operation succeeds, but then in Web-E here, we want to send updates to the participants of the childReport, updates with the change on the parent reportAction
Because the authToken can't access the childReport (due to step 1) for getting the getNotifiableParticipantAccountIDs, Pusher sends updates with the error thrown, because the childReport couldn't be accessed by the user authToken

Interesting, the most straightforward way I can think of solving this is by moving getNotifiableParticipantAccountIDs to auth. It would be so much cleaner this way versus wondering if the user has access to report or not.

I thought about something similar. I thought that we might want to return the notifiableParticipantAccoundIDs in the response to the UpdateReportComment auth command.

I'll work on this today.

I don't think we'll need App changes for this one, so I don't think we need @mananjadhav to review. I'll keep you posted.
(fix might be ready for review early next week because today I jumped to help on the super urgent SNH tasks)

Ok, thanks Cristi! Let me know, and then unassign and I'll retract the contract 👍

Cristi is getting to work on this, this week!

Alright, 2 draft PRs created, one for Auth and one for Web-E. I'll make them ready tomorrow after testing a bit more.

oh, ok... I'll make the PRs ready asap.

Ok, PRs are ready for review.

Adding Reviewing as the auth PR is under review and the /App PR is on hold until that's done!

Removing @mananjadhav because the fix is implemented in Auth and Web-E

Thanks! In Upwork, I've ended the contract for @mananjadhav without payment

FYI @conorpendergrast: The PRs are still in review because @chiragsalian pointed out that my solution is not complete.
I will continue on this one tomorrow as I am trying to finish my work on wave3 today.

I am working today on the requested changes on the PR.

How's this going @cristipaval ?

Nice, thanks for that @cristipaval!

No update on this one, I was ooo last week.

@cristipaval can we get a little update on this one? I have an issue that seems to be dependent on the fix for this issue.

Auth PR is ready for review again.

I see the auth PR is waiting for review from Bobby

PR review is ongoing!

I knoooooow Melvin! I'm heads-down on SmartScan at Saastr these days. I really wish I could continue pushing this a bit this week.

Cristi is still focused on Saastr, and I'm sure he'll get to this after that :)

@anmurali I'm on parental leave; re-assigning! This has been triaged and Cristi is working on it as an internal fix

Both Auth and Web-E PRs for this are ready for review again (finally, I know 😢 )

The Web-E PR is in production now, so this should be closed after we pay the reporting bonus to @kerupuksambel. It's the old amount, 250$, @anmurali.

friendly bump, @anmurali

👀

I'll ping @anmurali internally. She was ooo last Friday that's why I think this one got delayed.

@conorpendergrast, could you please handle the payment here? 🙏  I discussed with @anmurali on NewDot and she is swamped these days.

The Web-E PR is in production now, so this should be closed after we pay the reporting bonus to @kerupuksambel. It's the old amount, 250$, @anmurali.

This is the only payment due here, @conorpendergrast.

Absolutely!

Paid and contract ended. Good to close @cristipaval ?


feat: Select number days for each part of project

select days/add # days to context
closes #129

ya can you store number days in the context, ill pr after you resolve darrens review


Raphael.ca , the arguments can't not be dynamic?

can I use arguments to override Raphael.ca.something ?
Or the argument list of ca must be a certain pattern.

Raphael.ca?

sorry, I made a mistake paper.ca.........  Now I write them in Raphael.el, reference the "paper" with "this.paper" to extend the custom attribute..... Though I don't like this way of writing,  it seems the only way to extend custom attribute before a certain paper instance is instantiated...

Mistake 2.....  this question is to ask the arguments of paper.ca, I answered another question......


Refactor Hazelcast datastorage backend

Refactor and review to support production patterns.

Declined. Hazelcast storage is for dev purposes only.


Questions about CurrentEpochStartTime

Context
https://github.com/osmosis-labs/osmosis/blob/976dc698709ec4f7132747f9aa914de6f096d53c/x/epochs/types/genesis.pb.go#L55-L65
Questions

Where is t=35?
When was the epoch created? Was it created prior to t=14? If so, why does the first tick occur at t=30?

A block at t=35 will not trigger a new epochs. (Notice that the epoch there is inclusive of the t=35 time.)
Yes it was created prior to t=14. The answer to your question is that this is explaining the downtime scenario. Suppose the chain goes offline at t=14, and comes back online at t=30


fix error loading certain league settings

It seems like some (older?) leagues are missing this, which causes an error when retrieving their settings.

oh good find... i've planned to make typescript typings for this, but time is not friendly!!
i should be able to merge this in this week!

TS typings would be great 😄 I'm a TypeScript consumer and type the interface manually. Though you still ultimately have to assume API types yourself, which may or may not have caught this issue.


Firework in 3d

Your fireworks look especially good. Please also create a 3d project. (I saw it in the videodescription and need a tutorial in 3d to understand)
Sorry if I make spelling mistakes,
Gamemap

Hi, thank you, that's very nice. I created a 3D project now, you can find it here:
https://github.com/hinek/fireworks3d
I also made a video tutorial, it's on youtube:
https://www.youtube.com/watch?v=ix5xXHN8OQk

Thank you very much!


When I click cancel, the message still show it is edited, while it is not

The message should not show the date when it is not changed, such as when it is cancelled

With cancel the message is not edited now


[light-client] added new get_peers / local_node_info and updated fetch_transaction / get_transaction / set_scripts

https://github.com/nervosnetwork/ckb-light-client/pull/123
https://github.com/nervosnetwork/ckb-light-client/pull/110
https://github.com/nervosnetwork/ckb-light-client/pull/108

[ ] add get_peers
[ ] add local_node_info
[ ] update fetch_transaction
[ ] update get_transaction
[ ] update set_scripts

hold on, there are still some changes pending

The light-client was released, now the issue can be started

<EMAIL_ADDRESS>has been released, and the light client protocol also has been launched on the CKB mainnet. It's time to update the relevant light client modules in Lumos. To make tests independent and reproducible, it's recommended to create fixtures like @ckb-lumos/rpc

<EMAIL_ADDRESS>has been released, and the light client protocol also has been launched on the CKB mainnet. It's time to update the relevant(相关) light client modules in Lumos. To make tests independent and reproducible, it's recommended to create fixtures like @ckb-lumos/rpc

The fixtures in the rpc module is suitable for unit tests that test serialized params and results, where the expected inputs and expected outputs are clear. light-client-rpc currently only does e2e testing, and the use of fixtures feels a bit inappropriate

The fixtures in the rpc module is suitable for unit tests that test serialized params and results, where the expected inputs and expected outputs are clear. light-client-rpc currently only does e2e testing, and the use of fixtures feels a bit inappropriate

I am not very sure what you mentioned about the difference between the light client and RPC. As I see it, both need to prepare returned data from the node and define the expected data for client

The fixtures in the rpc module is suitable for unit tests that test serialized params and results, where the expected inputs and expected outputs are clear. light-client-rpc currently only does e2e testing, and the use of fixtures feels a bit inappropriate(不当)

I am not very sure what you mentioned about the difference between the light client and RPC. As I see it, both need to prepare returned data from the node and define the expected data for client

The rpc module use fixtures to test the toParams and toResult functions, these functions are responsible for converting snake case and camel case.
and the tests for direct interaction with rpc nodes are also in thee2e-test module
There seems to be a lot of test in e2e-test that is dynamic and contextual, such as commit a transaction and then testing to see if the fetch_transaction rpc is working properly based on the txHash
I'm probably not sure how to put this contextual logic into fixtures, any ideas?

There seems to be a lot of test in e2e-test that is dynamic and contextual

Exactly, e2e is contextual, we need a lot of effort to construct a case, and this is the reason that I recommend introducing unit cases without context for the light client module.

I'm probably not sure how to put this contextual logic into fixtures, any ideas?

Regarding your question about how to implement contextual logic into fixtures, I suggest following the example of using get_transaction. We can define the expected and actual results in a JSON format, and check them against each other.
{
  "toTransaction": {
    "actual": "...",
    "expected": "...",
  }
}

However, the current light client module just deep-camelized the RPC's result without any check or type definition, this is a lack of transparency and easily lead to bugs.
I realize that the light client's data structures are the same as the ckb-types, we can reuse the ResultFormatter from @ckb-lumos/rpc directly, such as the TransactionWithStatus. This way, we don't need to reconstruct the format cases here and improve the module's quality

@gpBlockchain<EMAIL_ADDRESS>has been adapted in @ckb-lumos/light-client, can you help to try it again?


Input modularity matrix

Added receiving adjacency matrix as list of lists. Added treat_as_modularity parameter. Added tests and examples.
We still might want to add handling of numpy arrays before merging.

For now I've added support for numpy arrays the easiest way.
I think now it is good to go.
Please, feel free to review and merge into master.

Looks great, thanks Alexander!
Have a few questions.
Side question - I wonder if it would look nicer if we auto-treat weight as modularity if the weight property name is modularity -this way we could remove this flag from the interface.
(just seems to be a very edge case)
If user passes a matrix, then there won't be a way for us to distinguish between normal adjacency matrix and modularity matrix. And we expect passing modularity matrix with treat_as_modularity=True to be the main use-case.


fix: DelayOnTouchOnly API document

The type and default value of DelayOnTouchOnly seemed to be wrong, so it is corrected.

Thanks for merging!


Jetton Migrations interface

Closes last milestone from https://github.com/ton-society/ton-footsteps/issues/57

[x] UI for Jetton admin to initiate the migration
[x] New minter deployment
[x] Migration master deployment
[x] Minting new Jettons to migration master
[x] UI for users to migrate their tokens
[x] Migration helper deployment
[x] Transferring old Jettons to migration helper

All functional is working as wanted. I just made few test migrations and everything was successful.
I'll proceed with fixing little display bugs and it will be ready to merge.

@shaharyakir can you please review it?

Yes, will do tomorrow

<3


InstagramTimelineFeedRequest always fails

All my attempts to get the timeline feed ends in Reading InstagramFeedResult from {"message": "", "status": "fail"}. Is there another way to get my feed/am I doing something wrong? Help is very much appreciated!

Can you post the code you are using?

Sorry, here's the line I am using to send the feed request
InstagramFeedResult timelineFeed = instagram.sendRequest(new InstagramTimelineFeedRequest());

In my code the feeds requests are made like:

I search for the user I want the feed and get the PK of the user

Once I get the PK I make the request using this PK.

In code:
InstagramSearchUsernameResult request = instagram.sendRequest(new InstagramSearchUsernameRequest("theUserNameYouWant")); InstagramUser user = request.getUser(); InstagramFeedResult result = instagram.sendRequest(new InstagramUserFeedRequest(user.getPk()));
Notice that you may need to make multiple feed requests to get the full feed.

@HectorHumanes I appreciate your help, but I'm trying to send an InstagramTimelineFeedRequest, not a InstagramUserFeedRequest. I'm trying to get the timeline of the user I'm logged in with, not the medias of a specific user.

Upss yes, true. So, i'm afraid I haven't any piece of code for timeline feed, sorry!
I will leave my previous answer in case someone find it useful for other operations

The updated code @jvogit referenced fixes this issue and I will be closing this thread. Thanks a lot for all the help!

Its not merged yet. Why did you close it?


Galaxy S10 not being detected

Mozilla/5.0 (Linux; Android 9; SM-G973F) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/76.0.3809.111 Mobile Safari/537.36

When trying to parse the above user agent with model number SM-G973F (Galaxy S10) it doesn't show "Samsung Galaxy S10" it just shows "SM-G973F".
This was tested on https://whichbrowser.net/tryout/
I also tested the same user agent but changed the model number just to see where the issue was - changing the model number from SM-G973F to SM-G960F made it parse the manufacturer and model correctly.

Database has been updated and v2.0.38 has been released.


On accidental user role demotion/promotion with Okta SSO

Doc update as a result of troubleshooting https://secure.helpscout.net/conversation/2328484756/55510

@pzeballos please take a look when you can so we could finish and merge this. Many thanks!


Build tests' dependencies

What are the dependencies required by the build tests? I am writing a PKGBUILD for libratbag and right now the following test fail when building on a clean chroot, check-svg and ratbagctl-test.

Apparently they were python-gobject (gi module) and python-lxml.


OSS helpers left lying around

Start vscode out of source
Reload the window
Quick vscode

Notice helper processes lying around.
I can repro this 100% of the time on my mac os. Let me know if you can not repro and need more details
Adding important since this slows down my cpu considerably

@isidorn I cannot reproduce:

open vscode out of sources, has a TS file
reload window
quit
check htop for the process

Whats the full command line of the OSS helper process?

So maybe open a .json file, than reload and let me know if you can repro
➜  vscode git:(master) ps aux | grep 19457
isidor           19457  99.4  0.3  5071436  54500 s002  R     4:58PM   0:38.17 /Users/isidor/Development/vscode/.build/electron/Code - OSS.app/Contents/Frameworks/Code - OSS Helper.app/Contents/MacOS/Code - OSS Helper --nolazy --inspect=18224 /Users/isidor/Development/vscode/extensions/json-language-features/server/out/jsonServerMain --node-ipc --clientProcessId=19446
isidor           19500   0.0  0.0  4279300    720 s002  R+    4:58PM   0:00.00 grep --color=auto --exclude-dir=.bzr --exclude-dir=CVS --exclude-dir=.git --exclude-dir=.hg --exclude-dir=.svn 19457

I cannot reproduce. This looks like an extension not shutting down properly, moving to @alexandrudima (since @aeschli is out for the JSON extension which probably did not change).

Let me know if you need more details from my side.
Also if I am the only one seeing this feel free to remove important label.

@isidorn yeah like:

does it reproduce with any JSON file
does it reproduce from a fresh user data dir (empty settings)

@isidorn yes sir, reproduces

Since this is an issue that has probably been around for a while it can probably wait until @aeschli can do it.


Gslux 755 location info

JIRA issue
https://jira.camptocamp.com/browse/GSLUX-XXX
Description
(details of the change, additional tests that have been done, reference to the issue for tracking, etc)
Screenshots
(only if the final render is different)

Thanks for the work, I left a few comments regarding the code.
Tested on github pages:

the position is not updated in the permalink (first update ok when no position at all, but no update after when position already exists)
QR is not visible
url is not visible
some buttons not working (download forage, add to itinerary)
but maybe this is because the PR isn't finished yet.

thanks for the review,
QR code and short URL ar not working on github pages, since the backend API refuses that hostname
localhost:8080 is OK
will work on migration, once the env variables are fixed
some buttons not implemented yet.
permalink: great catch: I did not notice the permalink is updated.
There seems to be a glitch in prod: if you pan the map after right clicking, the center of viewport is used, not clicked coordinates.

Thx for the work. Approving this PR but it would be great to make some changes before merging. Test on gh pages OK, one minor thing I don't see the download forage button (is it on purpose? i can't make it work in prodution neither).
Will test integration in v3.

You need to be use 'ACT' to have the forage button, I cannot see it either. I was only able to test it by using instrumented code.

Also, one thing I did not see: there is no "unlisten" for pointer events, does it mean listeners are still active even when location panel is hidden?

Some inappropriate comments are worsening the review: approving the Pr to move forward. But not approving the code.
Thx for the work.

hello @tkohr
I did the rebase wrt the feature info branch. could you please check the latest commits if you think this is OK with your code ?
I would like to do some more harmonization, what do you think of it ?:

[ ] move locationInfo and streetview composables into composables/info
[ ] use only one info store with both location and feature states
[ ] move locationInfo e2e test into cypress/e2e/info

hello @tkohr I did the rebase wrt the feature info branch. could you please check the latest commits if you think this is OK with your code ?

Thanks for the rebase @mki-c2c ! Looks nice to see the right click and left click work together. Didn't notice any issues with the feature info part.

I would like to do some more harmonization, what do you think of it ?:
* [ ]  move locationInfo and streetview composables into composables/info

Good idea!

* [ ]  use only one info store with both location and feature states

What do you think of creating an info folder within the stores, renaming the info.store to location-info.store and moving location-info.store and feature-info.store to the same folder? I feel like keeping both separated in different stores, keeps things clearer.

* [ ]  move locationInfo e2e test into cypress/e2e/info

Good idea!


CurseForge modpack not pulled from URL

Hi Itzg. Thanks for the awesome docker image!
I'm trying to spin up a container from a CurseForge URL. I've followed the steps in the README but it looks like the TYPE and CF_SERVER_MOD environment variables are being ignored. A vanilla server is deployed instead of a modded one. I'm hoping that I've missed something small.
Steps to reproduce:

Pull the image

docker pull itzg/minecraft-server

Create a CurseForge server container

docker run -d -it -e EULA=TRUE -p 25565:25565 --name mc itzg/minecraft-server \
-e VERSION=1.12.2 \
-e TYPE=CURSEFORGE \
-e CF_SERVER_MOD=https://www.curseforge.com/minecraft/modpacks/rlcraft

Start the container

docker container start mc

See logs.txt

Ah, the -e arguments need to come before the image name, so try:
docker run -d -it -e EULA=TRUE -p 25565:25565 --name mc \
-e VERSION=1.12.2 \
-e TYPE=CURSEFORGE \
-e CF_SERVER_MOD=https://www.curseforge.com/minecraft/modpacks/rlcraft \
itzg/minecraft-server

Ah, the -e arguments need to come before the image name, so try:
docker run -d -it -e EULA=TRUE -p 25565:25565 --name mc \
-e VERSION=1.12.2 \
-e TYPE=CURSEFORGE \
-e CF_SERVER_MOD=https://www.curseforge.com/minecraft/modpacks/rlcraft \
itzg/minecraft-server

Hi, I've been trying for days to start a Curseforge server in vain.
I tried first by following the directions and composing a docker string for a custom RLCraft server, but it never started because it said that probably there is no server executable in the link I gave it.
So I decided to try any example of docker-compose contained in the examples folder of your repo; also there is nothing to do but with a different error:
Downloading FTB modpack...
  https://www.curseforge.com/minecraft/modpacks/rlcraft -> /data/modpacks.zip
Unpacking FTB server modpack /data/modpacks.zip ...
.unzip: short read

I then saw today here among the issues the one I'm replying to now, and I tried this docker line that you just posted, but also from the same error.( which i posted below)
myuser@mydomain:~$ sudo docker run --rm -it -e EULA=TRUE -p 25565:25565 --name mc -e VERS
raft-server
usermod: no changes
Running as uid=1000 gid=1000 with /data as 'drwxrwxrwx    2 1000     1000          4096 Sep 27 15:11
Checking version information.
Checking type information.
Looking for Feed-The-Beast / CurseForge server modpack.
Downloading FTB modpack...
  https://www.curseforge.com/minecraft/modpacks/rlcraft -> /data/modpacks.zip
Unpacking FTB server modpack /data/modpacks.zip ...
.unzip: short read

Please make sure you are using the server version of the FTB modpack!

PS: yes i changed the -detach with a --remove to try it without cluttering my server
thank you in advance, let me know if i should open another issue :)

I'll have to debug what the modpack zip contains, because even when I navigate to
https://www.curseforge.com/minecraft/modpacks/rlcraft/files
and grab the server download URL from the "Additional Files", https://www.curseforge.com/minecraft/modpacks/rlcraft/download/2791783 then it still reports the unzip "short read" error.
There might be an HTTP redirect that needs to be accounted for...

Oh, CurseForge may have updated things to defeat non-human downloads since it now seems to through an adfly type page:

@pixtim if you don't mind us piggybacking on this issue, I could adjust the title for "RLCraft" just in case it's something specific to that.

Oh, CurseForge may have updated things to defeat non-human downloads since it now seems to through an adfly type page:

@pixtim if you don't mind us piggybacking on this issue, I could adjust the title for "RLCraft" just in case it's something specific to that.

Another thing, if it can be useful.
Even giving him the zip downloaded from the website at the end he says "are you sure it's a file server?"
(I don't have this log about it now though)
Maybe it's me that I did something wrong but not knowing I imagine that it could be useful as information.

@itzg Thanks for the help with the -e argument. 'Was rather silly of me. I got the mod-pack version of the image running and started running into the same issues as @alessandro-massarenti . We can close this issue if you like - the image is working.
I managed to get the RLCraft mod-pack server running by downloading the server pack manually and copying it into a mounted data volume for the container. I've pasted my documentation below so that it can be replicated.
README
Guide
See https://hub.docker.com/r/itzg/minecraft-server/
See https://github.com/AllTheMods/Server-Scripts
Installing the Docker Image

Pull the Forge Minecraft Server image

docker pull itzg/minecraft-server

Creating a Vanilla Server

Create a container for the server

 docker run -d -it -e EULA=TRUE -p 25565:25565 --name mc itzg/minecraft-server

Run the container

docker container start mc

Creating a CurseForge Server

Create a docker volume directory on the host OS.
Download the server mod-pack from CurseForge and put it inside the volume directory.
Download the server scripts from Github and put it inside the FeedTheBeast directory inside volume directory.
Create a docker container and run it:

docker run -d -it -e EULA=TRUE -p 25565:25565 \
-v /home/tim/docker/volume:/data \
-e TYPE=CURSEFORGE \
-e CF_SERVER_MOD=RLCraft.zip \
-e MANIFEST=/data/FeedTheBeast/manifest.json \
--name mc itzg/minecraft-server

docker container start mc

Modded Client Installation

Download the client mod-pack archive from https://www.curseforge.com/minecraft/mc-mods
Create a new instance in MultiMC using the Twitch project URL for the modpack.
Add OptiFine manually and install a shader pack.

Also, the forge server complains that the EULA is not accepted even though it's set to eula=TRUE in the eula.txt file. Looks like it's case sensitive. Setting it to eula=true fixes the issue.

Okay looks like it's spinning up a vanilla server. I'm investigating. :)

still not working to me.
It says "are you sure that this file is a server file?"
even by getting it your(@pixtim)  docker string and the right server zip

There's something wrong with the RL Craft server packs. I checked 2.6.2 and 2.5 and they're both missing the server startup script, ServerStart.sh and installer jar at the top level:

I would recommend reporting an issue against the modpack; however, since I personally don't use modpacks much at all, I'm not sure how that's done.
Meanwhile, I'll explore adding an option to generically combine the unzipped content of a modpack like this with a TYPE=FORGE VERSION=1.12.2 invocation.

Looks like the zip file i'm passing in manually has the same .unzip: short read issue. I'm going to try and upload the file to my server manually and chown, chmod it.

This may or may not help you regarding the downloading of the server file but it turns out that the following download link
https://www.curseforge.com/minecraft/modpacks/skyfactory-4/files/2725984
turns into
https://media.forgecdn.net/files/2725/984/SkyFactory_4_Server_4.0.8.zip
which it is able to download without any issues.
I also noticed that the numbers on the end of the first URL are split into two sections. The first being the first four digits and the second being the last three digits. The only thing missing then is the filename which is also required.
@itzg it is definitely not just RLCraft related! I've tried it with SevTech and SkyFactory 4 as well and had the same issue.

@Thundernerd thank for that analysis! I was also trying to see what the Twitch client was resolving when using the server download, but the URL went away too fast :)

As a solution for RL Craft (and other server-less server packs) I have add a GENERIC_PACK option that can be used to stitch together a CurseForge server, such as:
version: '3.7'

services:
  mc:
    image: itzg/minecraft-server
    environment:
      EULA: "TRUE"
      TYPE: FORGE
      VERSION: 1.12.2
      FORGEVERSION: <IP_ADDRESS>38
      # Can be a URL or a container-local path to a zip containing mods, plugins, and other directories
      # The checksum of the file is evaluated to ensure it is unpacked only once into the /data directory.
      GENERIC_PACK: /modpacks/RLCraft+Server+Pack+1.12.2+-+Beta+v2.6.3.zip
      # Number of directories to strip from the zipped content, default is 1
      GENERIC_PACK_STRIP_DIRS: "1"
    ports:
      - 25565:25565
    volumes:
      - ./data:/data
      - ./modpacks:/modpacks

If a couple people could test this out, that would be great. I will then add it to the README as an official option.

@Thundernerd , how were you able to determine the URL conversion it is doing? Specifically I'm wondering if the algorithm can be generalized for less and more file ID digits where it is always the first four digits in first path part and then remaining digits in the other part?

Actually might have answered the first question by doing a network trace in Chrome. It seems to start with an "edge CDN" URL like https://edge.forgecdn.net/files/2725/984/SkyFactory_4_Server_4.0.8.zip and then that 302's to the media.forgecdn.net one.

That's exactly what I did :). I think it's always the last three go into the second segment but I'm not exactly sure about that. I thought I saw a mod that had five digits in the first segment but I couldn't find it anymore.

@itzg I can confirm that the new GENERIC_PACK option works. I've added docker-compose to my VPS and now I can spin up the RL-craft server by just creating the volume directories, copying over the modpack and running compose. Thanks! This so awesome! :beers:

iam a little bit confused about the option "GENERIC_PACK_STRIP_DIRS"
i trying this pack https://www.curseforge.com/minecraft/modpacks/dungeons-dragons-and-space-shuttles
unzipping is not correctly i think he is unpacking all files in one directory

GENERIC_PACK seems to be helping. Ran into this issue trying to get ChoosenArchitect's Bounds 3.0 modpack setup. Currently though the container dies after a time out and shows the following:

usermod: no changes

Running as uid=1000 gid=1000 with /data as 'drwxrwxrwx    5 1000     1000          4096 Oct 11 02:37 /data'

Checking version information.

Checking type information.

Checking Forge version information.

Downloading generic pack from https://media.forgecdn.net/files/2623/86/Bounds+3.0+Server+Files.zip ...

The docker-compose.yml I'm using:
---
version: "3.7"

volumes:
  mc-data:

networks:
  default:
    external: true
    name: 'public'

services:
  minecraft-server:
    ports:
      - "25565:25565"

    environment:
      EULA: 'true'
      VERSION: 1.12.2
      DIFFICULTY: normal
      WHITELIST: zekodun,denzuko
      OPS: zekodun
      TYPE: FORGE
      GENERIC_PACK: https://media.forgecdn.net/files/2623/86/Bounds+3.0+Server+Files.zip
      ALLOW_NETHER: 'true'
      ANNOUNCE_PLAYER_ACHIEVEMENTS: "true"
      ENABLE_COMMAND_BLOCK: "true"
      FORCE_GAMEMODE: "true"
      GENERATE_STRUCTURES: "true"
      SPAWN_ANIMALS: "true"
      SPAWN_MONSTERS: "true"
      SPAWN_NPCS: "true"
      MODE: "survival"
      PVP: "false"
      SEED:<PHONE_NUMBER>743822299
      ENABLE_QUERY: "true"
      VIEW_DISTANCE: "10"
      MEMORY: "3G"
      MAX_MEMORY: "3G"
      INIT_MEMORY: "512m"
      GUI: "FALSE"
      CONSOLE: "FALSE"

    networks:
      - default

    image: itzg/minecraft-server:latest
    tty: true
    stdin_open: true
    shm_size: 128M
    deploy:
      resources:
        limits:
          memory: 3.5G
      restart_policy:
        condition: on-failure
    volumes:
      - mc-data:/data

...

Portainer shows the Last output as:
 Traceback (most recent call last): File "/usr/bin/mcstatus", line 11, in <module> sys.exit(cli()) File "/usr/lib/python2.7/site-packages/click/core.py", line 764, in __call__ return self.main(*args, **kwargs) File "/usr/lib/python2.7/site-packages/click/core.py", line 717, in main rv = self.invoke(ctx) File "/usr/lib/python2.7/site-packages/click/core.py", line 1137, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "/usr/lib/python2.7/site-packages/click/core.py", line 956, in invoke return ctx.invoke(self.callback, **ctx.params) File "/usr/lib/python2.7/site-packages/click/core.py", line 555, in invoke return callback(*args, **kwargs) File "/usr/lib/python2.7/site-packages/mcstatus/scripts/mcstatus.py", line 49, in ping click.echo("{}ms".format(server.ping())) File "/usr/lib/python2.7/site-packages/mcstatus/server.py", line 36, in ping connection = TCPSocketConnection((self.host, self.port)) File "/usr/lib/python2.7/site-packages/mcstatus/protocol/connection.py", line 129, in __init__ self.socket = socket.create_connection(addr, timeout=timeout) File "/usr/lib/python2.7/socket.py", line 575, in create_connection raise err socket.error: [Errno 99] Address not available

Don't want to put the blame directly on mcstatus but is there anyway to control the timeout on that? Bounds is a 158Mb pack and on my network would take about 8 minutes or more to download.

found my own answer... silly me should have thought about this one too. Overwritten the heathcheck by setting the interval and start_period to later in the sequence.
....
healthcheck:
      test: ['CMD', 'mcstatus', 'localhost:25565','ping']
      interval: 10m
      timeout: 10s
      retries: 3
      start_period: 10m
....

Still waiting on it to complete the download but at lease now the health check is not killing the container too soon. Might one suggest changing the Dockerfile to include --start-period=5m? to offset the startup time for any mod pack or other downloads to complete?

Added, Pull Request #397 which includes the suggested change.
Also found out that using the url method when the container restarts it always downloads the modpack. Some use cases might need that but perhaps only when the mods folder does not exist, or the shasum is out of sync, or when REMOVE_OLD_MODS is set?

Pull Request #398 implements the above suggestion.

Sorry @denzuko , I read PR comments and these comments out of order, so we both arrived at the same idea for overriding the health check startup interval.

I'm running into a similar/related issue
I'm creating my container using the following (info has been sanitized)
docker run -itd --name minecraft\
  -v /opt/minecraft:/data\
  -e MANIFEST=/data/FeedTheBeast/manifest.json\
  -e VERSION=1.12.2\
  -e TYPE=CURSEFORGE\
  -e CF_SERVER_MOD=https://media.forgecdn.net/files/2756/981/ATM3-5.12.3_Server-FULL.zip\
  -p 25565:25565\
  -e EULA=TRUE\
  -e VIRTUAL_HOST=mc.domain.com \
  -e LETSENCRYPT_HOST=mc.domain.com \
  -e<EMAIL_ADDRESS>\
  --restart=always\
    itzg/minecraft-server

Which results in the following
➜  ~ docker logs minecraft -f
usermod: no changes
Running as uid=1000 gid=1000 with /data as 'drwxrwxr-x    2 1000     1000          4096 Oct 23 07:31 /data'
Checking version information.
Checking type information.
Looking for Feed-The-Beast / CurseForge server modpack.
Downloading FTB modpack...
  https://media.forgecdn.net/files/2756/981/ATM3-5.12.3_Server-FULL.zip -> /data/981.zip
Unpacking FTB server modpack /data/981.zip ...
...............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
usermod: no changes
Running as uid=1000 gid=1000 with /data as 'drwxrwxr-x    3 1000     1000          4096 Oct 23 07:32 /data'
Checking version information.
Checking type information.
Looking for Feed-The-Beast / CurseForge server modpack.
usermod: no changes
Running as uid=1000 gid=1000 with /data as 'drwxrwxr-x    3 1000     1000          4096 Oct 23 07:32 /data'
Checking version information.
Checking type information.
Looking for Feed-The-Beast / CurseForge server modpack.
usermod: no changes
Running as uid=1000 gid=1000 with /data as 'drwxrwxr-x    3 1000     1000          4096 Oct 23 07:32 /data'
Checking version information.
Checking type information.
Looking for Feed-The-Beast / CurseForge server modpack.
usermod: no changes
Running as uid=1000 gid=1000 with /data as 'drwxrwxr-x    3 1000     1000          4096 Oct 23 07:32 /data'
Checking version information.
Checking type information.
Looking for Feed-The-Beast / CurseForge server modpack.

Any help would be greatly appreciated.

@obsessionwithfire do you mind opening a new issue? Yours is definitely in the general realm of FTB/CurseForge challenges, but seems to be different since the startup logic is quietly failing at the point:
Looking for Feed-The-Beast / CurseForge server modpack.

I probably have some missing error checking around there.

@itzg. Done, thanks for your help.

If REMOVE_OLD_MODS is true and the GENERIC_PACK's sum doesn't equal the last sum (if one exists), it should probably remove any file which the generic pack introduced on the last run. I assume this could be implemented by creating a manifest of file paths after the pack is downloaded.
This would allow for any generic files to be replaced between runs with no fear of files deleted from the generic pack left dangling.

@denzuko I modified this behavior in itzg/docker-minecraft-server#491

@pixtim Can I ask how did you manage to get your server to work? I have tried with this current docker-compose.yml file but the server spun up was only a vanilla server. Is it okay if you can share your docker-compose file as well?
This is what my docker-compose file looks like:
version: '3.8'

services:
    mc:
        image: itzg/minecraft-server
        ports:
            - 25565:25565
        volumes:
            - ./modpacks:/modpacks
        environment:
            TYPE: "FORGE"
            VERSION: "1.12.2"
            FORGEVERSION: "<IP_ADDRESS>38"

            GENERIC_PACK: "/modpacks/RLCraft+Server+Pack+1.12.2+-+Beta+v2.8.2.zip"
            GENERIC_PACK_STRIP_DIRS: "1"

            INIT_MEMORY: "1G"
            MAX_MEMORY: "12G"
            EULA: "TRUE"
            MAX_TICK_TIME: -1
            REPLACE_ENV_VARIABLES: "TRUE"
            ONLINE_MODE: "FALSE"
            ALLOW_FLIGHT: "TRUE"
            DIFFICULTY: "3"
            VIEW_DISTANCE: "6"

Hi @Lucria
My compose file:
version: '3.7'

services:
  mc-pix:
    image: itzg/minecraft-server
    deploy:
      restart_policy:
        condition: any
        max_attempts: 3
        window: 120s
    environment:
      EULA: "TRUE"
      TYPE: FORGE
      VERSION: 1.12.2
      FORGEVERSION: <IP_ADDRESS>38
      MEMORY: 5G
      GENERIC_PACK: <URL TO YOUR ZIP FILE>
      GENERIC_PACK_STRIP_DIRS: "1" # This strips off the directory of the zip-file itself.
      DIFFICULTY: easy
      OPS: pixtim
      MODE: survival
      PVP: "true"
      SEED: 1372204
      VIEW_DISTANCE: 4
      MAX_WORLD_SIZE: 10000
      ENABLE_RCON: "true"
      RCON_PASSWORD: secret
      RCON_PORT: 25575
    ports:
      - 25565:25565
      - 25575:25575
      - 8123:8123
    volumes:
      - ./data:/data
      - ./modpacks:/modpacks
  mc-rcon-admin:
    image: itzg/rcon
    deploy:
      restart_policy:
        condition: any
        max_attempts: 3
        window: 120s
    ports:
      - 4326:4326
      - 4327:4327
    environment:
      RWA_USERNAME: admin
      RWA_PASSWORD: secret
      RWA_RCON_HOST: mc-pix
      RWA_RCON_PASSWORD: secret

Replace <URL TO YOUR ZIP FILE> with the URL to a ZIP file that contains your mods. The zip must contain a mods directory that has the Forge mods in it. For example:
- Pix 5.0 server.zip <-- The zip file itself
  - mods
    - mod-1.jar
    - mod-2.jar
    ...

@pixtim GENERIC_PACK_STRIP_DIRS no longer exists, I got rid of it

@ChipWolf for what reason did you remove the strip variable, i just ran into the same problem mentioned here and it would solve it.
What's the alternative?

GENERIC_PACK_URL grabs a zip from a URL on startup and recursively adds it to the root of the server
If that zip has changed in any way since the last startup, it'll remove the files added by the generic pack, then recursively add the new generic pack.

@maxaudron GENERIC_PACK_URL grabs a zip from a URL on startup and recursively adds it to the root of the server
If that zip has changed in any way since the last startup, it'll remove the files added by the generic pack, then recursively adds the generic pack.


Remake the Chart Editor and System

Description
we should remake the chart editor and system (idfk how to do that tbh)
Checks

[X] I checked for duplicate suggestions

the chart system???

the chart system???

like the way charts work

pretty sure that's what mackery meant

yeah


Disable Password Login

Enhancement Proposal
We use SSO exclusively. The password login should be disabled in password_config. This will also avoid the profile settings where it looks like users can change their passwords.

@amandahla while #77 is merged, it appears we haven't actually disabled this for the ubuntu server. can you take a look? QA STR:

Open private window, go to app.element.io
Edit homeserver to be ubuntu.com

Expected:

Actual right now:

This issue has been transferred to a Jira story for further tracking as a feature request. Closing this issue for now. Thanks for your input!


Update more styles.

Change some inputs to height 34px that were missed the first time.
Change the font-size back to 13px.
Change the dropdown item color to pure black (semantic ui has 0.87 opacity)

Also remove some styles that aren't being used any more.


Preferable way to force HTTPS connection?

Preferable way to force HTTPS connection?

maybe this way: https://github.com/alejandroliu/ForceHttpsPlugin

You shouldn't leave this up to a application, but rather configure your webserver accordingly. HTTPS is no application-level setting. For example, if you're using Apache, your virtual host config for HTTP/port 80 shouldn't contain a DocumentRoot directive at all, but a Redirect directive. HSTS headers should be added using Apache's mod_header module. Just google for <your webserver> force ssl.


Revise linter rules enabled

The list of linters that we have currently enabled looks pretty thin. We should evaluate if we want to add more
https://github.com/openfga/openfga/blob/a809bbe0e79a01d4bc9d1ed3c52cf7323832b57e/.golangci.yaml#L5-L10
Consider using this one as a base: https://github.com/auth0/pkg/blob/main/.golangci.yml

@miparnisari we've added a lot more since we originally created this. Can we close? If not, can we make this more specific as to what the outcome/expectation of this is so that we can clarify what remains?

IMO we should do this

Include them all
Fix all the low hanging fruit errors
Comment out the linters that give errors that aren't trivial to solve

Agree with enabling all, and disabling just the ones that cause a lot of issues


Fix removal of error codes from conditions

How to categorize this PR?

/area dev-productivity
/kind bug
What this PR does / why we need it:
The ConditionBuilder will now clean the error codes from the old condition provided with WithOldCondition() if no error codes are added with the WithCondition() function.
Which issue(s) this PR fixes:
Fixes #
Special notes for your reviewer:
While looking at the code I could not understand what the exact intent was with the error codes. In the unit tests and the ConditionBuillder code it is assumed that if the old condition has error codes, they will be kept. However, in code that makes use of the ConditionBuilder it is assumed that if WithOldCondition() is called and WithCodes() is not used or it is used with an empty argument list that the error codes will not be transferred from the old condition to the new one.
Release note:

NONE

/milestone v1.34
/invite @rfranzke @timebertt

Most probably the reason why this issue occurs right now and occurs only in the master branch is #4790 - adapts the condition helper func to use the condition builder. Hence, I think you can remove the release note as we don't have a release that includes #4790.

Yeah it is most likely due to #4790. Forgot to link it in this PR.

@plkokanov Can you clarify how this PR relates to the issue we have observed for the extension controllers? Does it fix it as well?
If I remember correctly, we also observed that error codes were not removed from the worker status even if all health checks were successful.


Typo

In Example 3, your cmdlet is Disable-NetAdapterManagement instead of Disable-NetAdapterPowerManagement.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 4fb5489b-2d89-4e9d-bc6f-f4cb0bd7b5f3
Version Independent ID: 71222004-a56b-fce7-0afc-f6f9ded7e150
Content: Disable-NetAdapterPowerManagement (netadapter)
Content Source: docset/windows/netadapter/disable-netadapterpowermanagement.md
Product: w10
GitHub Login: @brianlic-msft
Microsoft Alias: brianlic

I submitted PR #284 to fix this.


swap description and title

fixes #204
The project title of an offer is now the project title and the description is the description

 Fix issue #204

 Fix issue #204


[Sync status] Include photo upload status in sync status

Starting to think about this, a few questions:
Presently, we don't have our own representation of photos. From what I can tell, we pull directly from the device and queue up an upload via the upload manager. The manager handles the complete lifetime of this work, if it fails it's the only place that we retry This gives us two options:

We keep the current "ephemeral" representation of photos—we don't have our own model, and we don't write anything to the db. At runtime, whenever a photo gets uploaded, we'll just have the work manager publish its status to some readable state that the UI can peek at. One implication of this is that we lose any "upload history" each time you exit the application. We can show you the syncs from your current session, but nothing beyond that.
We write minimal photo information (path, upload status) to the DB. Besides giving us a more persistent and stable place to read information from, this would also presumably give us better control of upload mechanics. We could backoff instead of retrying indefinitely and resume work at a later time (on next app start). e.g. on app start we can look in the DB and queue up any uploads that are in a state of failed/pending etc.

@gino-m Any thoughts on this?

Great questions, thanks for pointing this out. #2 sounds like a better option to me. If we can do something lightweight to start with to get something working that would be ideal. Ultimately I think we'll want to group mutations by Submission, sorted by last change/sync date, but we can tackle that separately.

Chatted tih @scolsen , this task is done. Closing (appears to be addressed in https://github.com/google/ground-android/pull/2242)