x/mobile: network unreachable on Android 10+ via Network request API

What version of Go are you using (go version)?

$ go version
go version go1.17.6 darwin/amd64

$ gomobile version
v0.0.0-20220414153400-ce6a79cf6a13

Note: gomobile version extracted from go.mod file.
Does this issue reproduce with the latest release?
I would say yes, I tried installing go1.18.1 and aliasing go to that in one terminal instance, but gomobile is the underlying CLI that builds the aar and that is the latest version.
What operating system and processor architecture are you using (go env)?
go env Output
$ go env
GO111MODULE=""
GOARCH="amd64"
GOBIN=""
GOCACHE="/Users/myUser/Library/Caches/go-build"
GOENV="/Users/myUser/Library/Application Support/go/env"
GOEXE=""
GOEXPERIMENT=""
GOFLAGS=""
GOHOSTARCH="amd64"
GOHOSTOS="darwin"
GOINSECURE=""
GOMODCACHE="/Users/myUser/Projects/go/pkg/mod"
GONOPROXY=""
GONOSUMDB=""
GOOS="darwin"
GOPATH="/Users/myUser/Projects/go"
GOPRIVATE=""
GOPROXY="https://proxy.golang.org,direct"
GOROOT="/Users/myUser/sdk/go1.18.1"
GOSUMDB="sum.golang.org"
GOTMPDIR=""
GOTOOLDIR="/Users/myUser/sdk/go1.18.1/pkg/tool/darwin_amd64"
GOVCS=""
GOVERSION="go1.18.1"
GCCGO="gccgo"
GOAMD64="v1"
AR="ar"
CC="clang"
CXX="clang++"
CGO_ENABLED="1"
GOMOD="/Users/myUser/Projects/prototypes/tcp-unreachable-repro/gotcp/go.mod"
GOWORK=""
CGO_CFLAGS="-g -O2"
CGO_CPPFLAGS=""
CGO_CXXFLAGS="-g -O2"
CGO_FFLAGS="-g -O2"
CGO_LDFLAGS="-g -O2"
PKG_CONFIG="pkg-config"
GOGCCFLAGS="-fPIC -arch x86_64 -m64 -pthread -fno-caret-diagnostics -Qunused-arguments -fmessage-length=0 -fdebug-prefix-map=/var/folders/p4/m1jmc9zd4k9f799j_vc_zcwh0000gp/T/go-build2377311140=/tmp/go-build -gno-record-gcc-switches -fno-common"

Not sure if go env is relevant when talking about Android, but included anyway.
What did you do?
We have a lib written in go that we compile via gomobile into an aar and use in our android application. When we connect to a Wi-Fi network via Android's Network request API on Android 10 and up, we cannot initiate a TCP connection from the go code.
According to Android's Wi-Fi infrastructure overview

Network request API: targets apps that need to connect to a peer device, such as when configuring an IoT device or transferring files to a camera. In such cases, the peer device starts up a SoftAP and the API allows the app to guide the user to connect to the device. The resulting network is not intended to provide internet access, can't be used by the system, and can't be used by any app except the configuring app.

The problem seems to be that the OS does not recognize the go code as part of the application, but I'm not 100% sure either. We have even tried opening a socket via syscall.Socket() then calling syscall.Connect() on that, but it fails with network unreachable just the same as it does via net.Dial().
If you connect the phone to the Wi-Fi in question via Settings (i.e. not using the Network request API), then everything works without issue.
The weird thing is that we have another team working with C++ and boost, and they also generate JNI bindings for their native code, but in their case using the Network request API works, so the OS recognizes that code as part of the app and lets it open their sockets. For go, though, it does not, even though the code is running in the same process (Getpid return the same PID both in the go code as well as the native android code).
I have made a minimal reproduction repository where you can observe the behavior: https://github.com/myklosbotond/tcp-unreachable-repro . It only works with android 10 and up and it's important to disable cellular data before the tests. We tested on multiple android versions and on phones from multiple brands, and the bug is present in every case.
What did you expect to see?
Network calls can be done via the Wi-Fi bound to the app.
What did you see instead?
Requests are always failing with
dial tcp <IP_ADDRESS>:80: connect: network is unreachable

opening a TCP socket fails.

@hyangah can you give this a look?

If you temporarily connect VPN or cellular network, it will be fixed.

If you temporarily connect VPN or cellular network, it will be fixed.
My problem is a DNS issue.

The issue seems to be with the Connect() system call. If I call the connect() function from within Cgo, the connection is successful, and the socket handle can be used to read and write data with further system calls.
I added some more test cases to my fork of the reproduction repo (TCP connection tests with Android NDK, Go syscalls and C calls from within Go).

We decided to adopt the CGo hack suggested by @s23b until this is properly fixed in gomobile.

If you temporarily connect VPN or cellular network, it will be fixed.

My problem is a DNS issue.

@farhoud, would you please delete your comments from this issue? This issue is neither about VPN, nor about DNS. This page is coming up as a search result on the wrong google searches because of these comments.


Add failing test cases for usage of custom headers

Hi there,
I had some strange handling with fetch-mock and testing custom header definitions.
Therefore, I opened this PR by adding two test cases, that will fail (tested locally).
It would be great if you could check this PR and leave me a reply on it. (Please check the two comments for detailed information.)
IMHO the getHeaderMatcher in compile-route.js should / could be enhanced to handle the two cases.
Don't hesitate contacting me if you have any question on it.

Thank for submitting this. Both seem like a totally valid use cases - I aim for fetch-mock to support any valid call of fetch.
I'll try to look at fixing them. Could you skip the tests in your PR so I can merge into master. Or if you feel like fixing the bugs yourself be my guest

@wheresrhys, thank you for your very quick response!
I commented out the custom-header.spec, so all PR checks have been passed.
I'll give it a try fixing these two cases (maybe tomorrow) and let you know in a PR.

Finally, removed some unnecessary guard clauses and all fetchMock.restore() calls (where possible).
If there's anything to be done, don't hesitate contacting me.
Otherwise feel free to squash&merge it. :-)

great effort - thanks for all this. Will release it as a patch

https://github.com/wheresrhys/fetch-mock/releases/tag/v5.10.1


Inference on M2 running extremely slow

M2 32g Mac Pro inference running extremely slow on llama 7b.
python generate.py --base_model=h2oai/h2ogpt-gm-oasst1-en-2048-open-llama-7b
Same system benchmark running Llama.cpp:
vicuna-7b-1.1.ggmlv3.q4_0.bin
(   36.22 ms per token,    27.61 tokens per second)
codeup-llama-2-13b-chat-hf.ggmlv3.q4_0.bin
(   68.98 ms per token,    14.50 tokens per second)
llama-30b.ggmlv3.q4_0.bin
(  165.31 ms per token,     6.05 tokens per second)

pip list | grep torch
torch                     2.1.0.dev20230802
torchaudio                2.1.0.dev20230802
torchvision               0.16.0.dev20230802

cpu show ~300% during inference with H20gpt
cpu shows >800% when using llama.cpp

Torch's support of MPS is basic, so if you use a full HF model you cannot expect good performance as it's not quantized when you run like the above.

Can you check that torch can see MPS?

Please compile/install llama_cpp_python for MPS and then use GGML models that would be used with --base_model=llama after adding the model to the .env_gpt4all file.  Some discussion here may help clarify if the other readme's didn't help: https://github.com/h2oai/h2ogpt/blob/main/docs/FAQ.md#adding-models

MPS Validation:
python mps.py
tensor([1.], device='mps:0')
Compile/install llama_cpp:
pip uninstall llama-cpp-python -y
Found existing installation: llama-cpp-python 0.1.77
Uninstalling llama-cpp-python-0.1.77:
Successfully uninstalled llama-cpp-python-0.1.77
(h2ocpu) jenochs@MacBook-Pro h2ogpt % CMAKE_ARGS="-DLLAMA_METAL=on" FORCE_CMAKE=1 pip install -U llama-cpp-python --no-cache-dir
...Successfully built llama-cpp-python
Installing collected packages: llama-cpp-python
Successfully installed llama-cpp-python-0.1.77
Updated .env_gpt4all:
cat .env_gpt4all
GPT4ALL or llama-cpp-python model_kwargs
GPT4ALl GPT-J type, from model explorer choice, so downloads
model_name_gptj=ggml-gpt4all-j-v1.3-groovy.bin
llama-cpp-python type, supporting version 3 quantization, here from locally built llama.cpp q4 v3 quantization
below uses prompt_type=llama2
model_path_llama=llama-2-7b-chat.ggmlv3.q8_0.bin
below assumes max_new_tokens=256
max_tokens=1792
uncomment below if using llama-cpp-pyton with cublas built in
n_gpu_layers=20
GPT4ALl LLaMa type, supporting version 2 quantization, here from model explorer choice so downloads
model_name_gpt4all_llama=ggml-wizardLM-7B.q4_2.bin
PDF_CLASS_NAME=UnstructuredPDFLoader
model_name_exllama_if_no_config=TheBloke/Nous-Hermes-Llama2-GPTQ
download base model:
wget https://huggingface.co/TheBloke/Llama-2-7B-Chat-GGML/resolve/main/llama-2-7b-chat.ggmlv3.q8_0.bin
Saving to: ‘llama-2-7b-chat.ggmlv3.q8_0.bin’
llama-2-7b-chat.ggmlv3.q8_0.b 100%[==============================================>]   6.67G  70.6MB/s    in 84s
2023-08-03 03:03:27 (80.8 MB/s) - ‘llama-2-7b-chat.ggmlv3.q8_0.bin’ saved [7160799872/7160799872]
python generate.py --base_model=llama --prompt_type=llama2 --score_model=None
Auto set langchain_mode=LLM.  Could use MyData instead.  To allow UserData to pull files from disk, set user_path or langchain_mode_paths, and ensure allow_upload_to_user_data=True
Using Model llama
Prep: persist_directory=db_dir_UserData does not exist, regenerating
Did not generate db since no sources
Starting get_model: llama
Could not determine --max_seq_len, setting to 2048.  Pass if not correct
Fatal Python error: Illegal instruction
Whane i run it like this i get an error...Am i missing something. what location should I download the .bin?

@jenochs AFAIK currently llama only supports q4 models for MPS

So download https://huggingface.co/TheBloke/Llama-2-7B-Chat-GGML/resolve/main/llama-2-7b-chat.ggmlv3.q4_0.bin and try it

@jenochs any updates?

will update asap thank you

I had the same issue on the same hardware specs and your solution works! @Mathanraj-Sharma .
(1) I downloaded the link to the repo using:
wget https://huggingface.co/TheBloke/Llama-2-7B-Chat-GGML/resolve/main/llama-2-7b-chat.ggmlv3.q4_0.bin
(2) Then i ran
python3 generate.py -base_model=llama --model_path_llama=llama-2-7b-chat.ggmlv3.q4_0.bin --max_seq_len=4096 --prompt_type=llama2

@jenochs any updates?

Validated is working with:
python3 generate.py -base_model=llama --model_path_llama=llama-2-7b-chat.ggmlv3.q4_0.bin --max_seq_len=4096 --prompt_type=llama2

@jenochs if you have it working could you share some dots on the performance you've seen here? https://github.com/h2oai/h2ogpt/issues/881


fix ts compile issues

Basically platform.ts needs to support strict null checks.

closed by depending on PowerShell extension's API


Myntra Clone Website

Title: Myntra Clone Website
Tech Tools: Html,Css and Js
Screenshort

Please assign me under OSEN

@Geeks-Arpan start working


Fix link to controller was broken with directory changes

Not totally sure if this is the same as the original linked code. But it seemed the most similar of the code I could see.

Thanks for this! The fix for data.rs looks good, but the equivalent path to inner.rs is now server/src/controller/inner.rs.

@ms705 ah cool! will fix that now!

Should I rewrite that part of the README given the code is no longer in the noria crate? I would propose moving that line including the controller/inner.rs to the server section of the README.

Thanks! The README is fine as-is, since it refers to the client invoking controller RPCs.


.gitignore improvements

I've deleted the schemas-related items because it is no longer needed since one of the last updates.
In addition, I've added the coverage.txt file, which corresponds to the coverage tool output, as the items that satisfy *.out.
Thanks!

Codecov Report

Merging #22 into master will decrease coverage by 2.12%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master      #22      +/-   ##
==========================================
- Coverage   97.16%   95.03%   -2.13%
==========================================
  Files           5        5
  Lines         141      141
==========================================
- Hits          137      134       -3
- Misses          2        4       +2
- Partials        2        3       +1

Impacted Files
Coverage Δ

internal/route_matchers.go
91.42% <0%> (-8.58%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 50ed9a9...d7f547d. Read the comment docs.

It's quite funny!
How a single change on the .gitignore file can reduce the coverage?


Using base model on GPU with no bfloat16

Hi. I'm trying to run mistral-7B-v0.1 model using mistral-inference with a Nvidia Tesla V100 32GB GPU. Considering that my GPU doesn't have bfloat support, I would like to know if it is possible to configure the runtime code to run under fp16 mode, or it will raise an error identical to that in Issue #160. I've tried both mistral-demo and the sample Python code in README and yielded the same error. Thanks in advance.

@yichen0104 The library underneath actually supports it, the problem is just that dtype is not exposed via the CLI. I was able to make it work on my 2x3060+2xP100 machine by applying the following patch:
diff --git a/src/mistral_inference/main.py b/src/mistral_inference/main.py
index a5ef3a0..d97c4c9 100644
--- a/src/mistral_inference/main.py
+++ b/src/mistral_inference/main.py
@@ -42,7 +42,7 @@ def load_tokenizer(model_path: Path) -> MistralTokenizer:

 def interactive(
     model_path: str,
-    max_tokens: int = 35,
+    max_tokens: int = 512,
     temperature: float = 0.7,
     num_pipeline_ranks: int = 1,
     instruct: bool = False,
@@ -62,7 +62,7 @@ def interactive(
     tokenizer: Tokenizer = mistral_tokenizer.instruct_tokenizer.tokenizer

     transformer = Transformer.from_folder(
-        Path(model_path), max_batch_size=3, num_pipeline_ranks=num_pipeline_ranks
+        Path(model_path), max_batch_size=3, num_pipeline_ranks=num_pipeline_ranks, dtype=torch.float16
     )

     # load LoRA


Removed all references to holocube and deleted interface

This PR deletes all references to the holocube package and the HoloCube class, instead relying on HoloViews to provide the CubeInterface. This should be merged once https://github.com/ioam/holoviews/pull/624 has been merged in HoloViews.

The PR you mention how now been merged. Is this one ready to merge too?

:+1:


show_all fails if you have a sketch that uses a solid's face as a workplane

It seems simply having a sketch that uses the face of a part as the workplane causes show_all to blow up.
Here's my code:
# %%
from build123d import *
from ocp_vscode import *

# %%
reset_show()
show_clear()
set_defaults(
   axes0=True,
   helper_scale=50,
   reset_camera=False,
)

grid_unit = 42 * MM
baseplate_height = 7.2 * MM
baseplate_corner_radius = 4 * MM

with BuildPart() as baseplate:
    Box(
        length=grid_unit,
        width=grid_unit,
        height=baseplate_height,
        align=(Align.CENTER, Align.CENTER, Align.MIN),
    )

    top_face: Face = baseplate.faces().filter_by(Axis.Z).sort_by(Axis.Z)[-1]
    with BuildSketch(top_face) as plan:
        RectangleRounded(
            width=grid_unit,
            height=grid_unit,
            radius=baseplate_corner_radius,
            align=(Align.CENTER, Align.CENTER),
        )

show_all()

Which produces the error:
File c:\Users\ryans\miniforge3\envs\cad\Lib\site-packages\ocp_vscode\show.py:441, in show(**truncated**)
    438 progress = Progress([] if progress is None else [c for c in progress])
    440 with Timer(timeit, "", "overall"):
--> 441     data = _convert(
    442         *cad_objs,
    443         names=names,
...
    791         and coordSystem1.YDirection().IsEqual(coordSystem2.YDirection(), 1e-6)
    792         and coordSystem1.Direction().IsEqual(coordSystem2.Direction(), 1e-6)
    793     )

AttributeError: 'OCP.TopoDS.TopoDS_Face' object has no attribute 'Position'

If you change the sketch line to with BuildSketch() as plan:, (i.e. use the default XY workplane), it works fine.

I just discovered that wrapping the face in a Plane first works!
with BuildSketch(Plane(face)) as plan:

It seems that ocp_tesselate is expecting workplanes to be actual planes, not faces here.
https://github.com/bernhard-42/ocp-tessellate/blob/0fd5aad8534932cd682818d382132c0af12aad9f/ocp_tessellate/convert.py#L639-L646
I'm not sure the ideal location for a fix. Either build123d could ensure faces get wrapped in planes sooner up the chain, or ocp_tesselate could check that it's actually dealing with a plane.

I'm just trying the example in the README and is having the same error. The example doesn't contain any BuildSketch.
from build123d import *
from ocp_vscode import *

with BuildPart() as bp:
    with PolarLocations(3, 8) as locs:
        Box(1, 1, 1)

show_all()

@shayded-exe Agreed, this is a bug in ocp-tessellate. btw. show(plan) fails, show(plan.sketch) works.

@LeLocTai I tried this on a fresh Python interpreter and it works.
Since show_all tries to show all variables, could it be that you have some other variable in scope?

note to myself:
File [~/Development/CAD/ocp-tessellate/ocp_tessellate/convert.py:644](https://file+.vscode-resource.vscode-cdn.net/Users/bernhard/Development/CAD/build123d/~/Development/CAD/ocp-tessellate/ocp_tessellate/convert.py:644), in _to_assembly(names, colors, alphas, render_mates, render_joints, helper_scale, default_color, show_parent, loc, mates, instances, progress, is_assembly, *cad_objs)
    [636]         else:
    [637]             pg.add(part)
    [639] elif (
    [640]     is_build123d(cad_obj)
    [641]     and hasattr(cad_obj, "sketch_local")
    [642]     and not (
    [643]         len(cad_obj.workplanes) == 1
--> [644]         and is_plane_xy(cad_obj.workplanes[0].wrapped)
    [645]     )

is_plane_xy needs to check for faces instead of planes and convert them before check

@LeLocTai I tried this on a fresh Python interpreter and it works. Since show_all tries to show all variables, could it be that you have some other variable in scope?

That is probably it. Sorry for the confusion.

fix with 1.2.2


How to customize the color of the terminal command and how to customize the text

https://s1.ax1x.com/2018/11/19/FSIW5j.png
I try to use  "terminal.foreground":  to settings color.
but all fonts have changed.

The setting controls the default text color but for an effect like that, you have to configure your shell. I suggest searching "customize prompt" with the name of your shell, e.g. "bash"


Added Liberty University domain

https://www.liberty.edu

After looking into the other pull requests, I see Liberty University was blocked for abuse? Unfortunate to hear...
As a result, I've closed the request.


feat: webComponent

Some more thoughgs:

Naming: Let's not the main component. repco-post, we don't use post anywhere else. I'd propose <repco-content-items> for the root component, and <repco-content-item>, <repco-content-item-body> etc for the individual items.
I'm not sure about the <repco-fetch-api> component, I don't currently see how this increases composability. What we want, I think, is to a) have a ready-to-use component that fetches and displays data, and b) allow the component to be reused if data is already fetched. For this, why don't we add a fetch=false data="{{JSON}}" mode to the repco-content-items component? So: if fetch=false, parse the data in data and set that as the state. Otherwise, fetch from the endpoint  and then use the result.

Styling: In the horizontal LAyout, the cards still need a minimum height. so that they are the same size when in a card is very little text. otherwise I find the changes good


Bug 1874612: Add icon to release 4.4 branch

/close
wrong branch

Replaced by https://github.com/openshift/cluster-kube-descheduler-operator/pull/129


moment('31-10-2021', 'YYYY-MM-DD').isValid() is true

Describe the bug
moment('31-10-2021', 'YYYY-MM-DD').isValid() is giving true when it's not.
To Reproduce
Steps to reproduce the behavior:

moment('31-10-2021', 'YYYY-MM-DD').isValid()  -- run it.

Expected behavior
moment('31-10-2021', 'YYYY-MM-DD').isValid() //false

I've the same issue for
moment('4567', moment.ISO_8601, true).isValid() // true

Which should be definitely false. The behavior was like that in Version 2.10.3 if this helps.

As mentioned in the doc,
YYYY : 4 or 2 digit year. Note: Only 4 digit can be parsed on strict mode
Pass the third param which sets the strict mode as true
moment('31-10-2021','YYYY-MM-DD',true).isValid() // false
moment('31-10-2021','DD-MM-YYYY',true).isValid() // true


Feat/modular

This modularizes multiaddr, and adds a value getter method that i've wanted for forever and a half.

couple improvements suggested. but overall looks good

@jbenet addressed your concerns, rfm?


Sandbox error in Orca 1.3.0

With the recently released Orca 1.3.0 I see the following message when running orca --help in an Ubuntu Docker container with Anaconda 2019.10 and Chromium 80.0.3987.87:

[18:0313/185321.369451:FATAL:atom_main_delegate.cc(210)] Running as root without --no-sandbox is not supported. See https://crbug.com/638180.
/bin/bash: line 1:    18 Trace/breakpoint trap   (core dumped) orca --help

With the same underlying configuration this error is not thrown in Orca 1.2.1.
The image build by the Dockerfile found below  reproduces this error. Simply run

docker build -t orca-test:latest .
docker run --rm orca-test
Running the image as another user does not help either:
docker run --rm -u daemon orca-test

On the other hand, the container built using the same Dockerfile with Orca 1.2.1 does not show errors:

docker build -t orca-test:1.2.1 --build-arg "PLOTLY_ORCA_VERSION==1.2.1" .
docker run --rm orca-test:1.2.1

Is there any workaround or did I miss anything?
The dockerfile.txt:
FROM ubuntu

ARG ANACONDA_INSTALL_URL=https://repo.anaconda.com/archive/Anaconda3-2019.10-Linux-x86_64.sh
ARG PLOTLY_ORCA_VERSION

RUN apt-get update --fix-missing && \
    # Install Orca dependencies
    apt-get install --no-install-recommends -y \
     ca-certificates curl chromium-browser libgtk2.0-0 libgconf-2-4 xvfb && \
    apt-get clean && \
    #
    # Install Anaconda 3 2019.10 X86-64
    curl ${ANACONDA_INSTALL_URL} -o /anaconda.sh && \
    mkdir ~/.conda && \
    /bin/bash /anaconda.sh -b -p /opt/conda && \
    rm /anaconda.sh && \
    ln -s /opt/conda/etc/profile.d/conda.sh /etc/profile.d/conda.sh && \
    . /opt/conda/etc/profile.d/conda.sh && \
    conda activate base && \
    find /opt/conda/ -follow -type f -name '*.a' -delete && \
    find /opt/conda/ -follow -type f -name '*.js.map' -delete && \
    #
    # Install Plotly and Plotly Orca
    conda install -y plotly && \
    conda install -y -c plotly plotly-orca${PLOTLY_ORCA_VERSION} && \
    /opt/conda/bin/conda clean -afy

ENTRYPOINT ["/bin/bash", "-c"]
CMD ["source /opt/conda/etc/profile.d/conda.sh; conda activate base; orca --help"]

@kordian2k it seems like you're hitting a new security measure introduced in more recent versions of electron which discourage running an app as root. Can you run Orca as another user?

@antoinerg Thanks for the quick reply. If I run the above image as another user, e.g. sudo docker run --rm -u daemon orca-test I get the following error:
[16:0319/131859.784153:FATAL:setuid_sandbox_host.cc(157)] The SUID sandbox helper binary was found, but is not configured correctly. Rather than run without sandboxing I'm aborting now. You need to make sure that /opt/conda/lib/orca_app/chrome-sandbox is owned by root and has mode 4755.
/bin/bash: line 1:    16 Trace/breakpoint trap   (core dumped) orca --help

Setting the mode of  /opt/conda/lib/orca_app/chrome-sandbox to 4755 as indicated by the error message and running orca --help as the daemon user throws the following error:
Failed to move to new namespace: PID namespaces supported, Network namespace supported, but failed: errno = Operation not permitted
Trace/breakpoint trap (core dumped)

This error can be avoided by running the image in --privileged mode which is no option for me. Is there another way to fix this issue? Is it possible to run Orca  w/ the --no-sandbox option?

@kordian2k thank you for following up. Running orca with --no-sandbox flag seems to resolve the issue. This argument is supposed to be added automatically:
https://github.com/plotly/orca/blob/577bc014029190da6629adac0c2a55782bd48a03/bin/orca.js#L13
but somehow it didn't find its way into the executable published in conda.

@jonmmease I thought the executable built for conda release would reuse bin/orca.js. Is that really the case?

Is that really the case?

As I recall, the conda package uses the executable from the AppImage build after is has been extracted.
I would have thought that would use orca.js under the hood, but I don't know off hand.

It turns out that the electron-builder actually creates an AppImage which run orca_electron.js not orca.js:
https://github.com/plotly/orca/blob/577bc014029190da6629adac0c2a55782bd48a03/package.json#L6-L9
Someone using the Linux AppImage will have to specify --no-sandbox when running as root. In the case of Conda packages, maybe adding --no-sandbox to this line may work:
https://github.com/plotly/orca/blob/577bc014029190da6629adac0c2a55782bd48a03/recipe/bin/orca#L7


Is there a Roadmap?

This project looks really great, and it's a brilliant use of directives. I saw that it's in beta, and I wondering if there was a roadmap and timeline for a first major cut. It looks like a much better fit than say join-monster for my needs.

Nvm I found it! https://github.com/danielrearden/sqlmancer/milestones

👍 Additional feedback and contributions are always welcome!


Suggestion: option to select interpreter when opening new console

Issue Report Checklist

[x] Searched the issues page for similar reports
[x] Read the relevant sections of the Spyder Troubleshooting Guide and followed its advice

Problem Description (Suggestion)
In order to open a kernel that uses a different python interpreter (e.g. a different conda environment), we need to go to preferences, change the python interpreter from the default one to another one. Then we can open a new python console with this interpreter for the kernel. We then need to switch back to the default interpreter in the preferences, so that new consoles will be opened with the default interpreter.
I suggest to have an option (in the menu that appears by clicking on the three lines of the top right of the console)  to open a new console with a specific interpreter instead of the default, to avoid doing all that was mentioned before.
Ideally, it would be nice to have an option to choose between available conda environments, but I understand this might be quite difficult to ensure for each type of installation. Also ideally, the name of the console could tell to which environment it corresponds.

There seems to be a PR #20421 that implements a menu to start a console with a specific interpreter, but apparently it did not make its way to the main release yet.
(Also I just made my own similar suggestion #22022, not realising that this new issue was posted.)

Can conda environment be incorporated into the "Configuration per file" dialog?  So you can say which environment a particular file should be run in, and then it always is?

Hi there, sorry for the late response! Just in case, indeed PR #20421 kind of solves this issue. That work and some improvements to it that have been done/are being done like https://github.com/spyder-ide/spyder/pull/22200 will be part of Spyder 6. If you want to check the funtionality done at #20421 you can install the latest Spyder 6 beta release (see the Spyder GitHub release page at https://github.com/spyder-ide/spyder/releases?q=pre-release&expanded=true)

Can conda environment be incorporated into the "Configuration per file" dialog? So you can say which environment a particular file should be run in, and then it always is?

I would say that idea is more closely related with #22022 (quite an interesting idea though :))

@ccordoba12 should we close this as solved by #20421 or maybe use #22200 to close this?

Hi, thank you for your answers. I have not had the time to update and test
the new feature mentioned in the issue and PR that you linked. But the
solution given seems to address my request, so this issue can probably be
closed if it's released already.
Thank you.
Miguel
El mar., 9 jul. 2024 23:50, Daniel Althviz Moré @.***>
escribió:

@ccordoba12
https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fccordoba12&data=05|02|miglla-9%40student.ltu.se|4f316896168848ced44608dca06127d4|5453408ba6cd4c1e8b1018b500fb544e|0|0|638561586339093482|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|0|||&sdata=Hc65ygOPmEczsrwgE5O4JNCHJedltSF6pdIkE52MT%2Fw%3D&reserved=0
should we close this as solved by #20421
https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fspyder-ide%2Fspyder%2Fpull%2F20421&data=05|02|miglla-9%40student.ltu.se|4f316896168848ced44608dca06127d4|5453408ba6cd4c1e8b1018b500fb544e|0|0|638561586339093482|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|0|||&sdata=Ny3hsirzFWwzC5bVSXtaRkWMcxeYVd3Bc12z1owV6II%3D&reserved=0
or maybe use #22200
https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fspyder-ide%2Fspyder%2Fpull%2F22200&data=05|02|miglla-9%40student.ltu.se|4f316896168848ced44608dca06127d4|5453408ba6cd4c1e8b1018b500fb544e|0|0|638561586339093482|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|0|||&sdata=nk5mRxzNK1G4JvkYlude6ISI0fbL49qwIXb5ytA1rRc%3D&reserved=0
to close this?
—
Reply to this email directly, view it on GitHub
https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fspyder-ide%2Fspyder%2Fissues%2F22020%23issuecomment-2218791003&data=05|02|miglla-9%40student.ltu.se|4f316896168848ced44608dca06127d4|5453408ba6cd4c1e8b1018b500fb544e|0|0|638561586339093482|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|0|||&sdata=L4LYGdKA805BFPR4UOnyJRkMgEh%2BhQ%2Ff9RXbdM2mS4E%3D&reserved=0,
or unsubscribe
https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAPJZAIQ7N5CVGJ4NW5UBKLLZLRLKNAVCNFSM6AAAAABGXIKZ5WVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEMJYG44TCMBQGM&data=05|02|miglla-9%40student.ltu.se|4f316896168848ced44608dca06127d4|5453408ba6cd4c1e8b1018b500fb544e|0|0|638561586339093482|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|0|||&sdata=jQJq5lGq5DpSJhybCQyfGKRd8IMw0%2BuXKN2bnIA2%2BlQ%3D&reserved=0
.
You are receiving this because you authored the thread.[image: Web Bug
from
https://github.com/notifications/beacon/APJZAIRALMXIN5Q3QXPL62LZLRLKNA5CNFSM6AAAAABGXIKZ5WWGG33NNVSW45C7OR4XAZNMJFZXG5LFINXW23LFNZ2KUY3PNVWWK3TUL5UWJTUEIAIFW.gif]Message
ID: @.>
[ { @.": "http://schema.org", @.": "EmailMessage",
"potentialAction": { @.": "ViewAction", "target": "
https://github.com/spyder-ide/spyder/issues/22020#issuecomment-2218791003",
"url": "
https://github.com/spyder-ide/spyder/issues/22020#issuecomment-2218791003",
"name": "View Issue" }, "description": "View this Issue on GitHub",
"publisher": { @.***": "Organization", "name": "GitHub", "url": "
https://github.com" } } ]

Closing as solved by https://github.com/spyder-ide/spyder/pull/20421 and https://github.com/spyder-ide/spyder/pull/22200

Can conda environment be incorporated into the "Configuration per file" dialog? So you can say which environment a particular file should be run in, and then it always is?

I would say that idea is more closely related with #22022 (quite an interesting idea though :))

Should I file a separate feature request now that the environment stuff has been implemented?

@endolith, do you think issue #22022 doesn't cover your request?

@endolith, do you think issue #22022 doesn't cover your request?

Sorry yes, that sounds like the same thing


Support for shared base volume.

Fixed at:
commit cb0077096ec85b91955851e015d6c7e7711ea4d3
Author: Sheng Yang<EMAIL_ADDRESS>Date:   Tue May 19 17:01:02 2015 -0700
blockstore: Add backup/restore support for image based volume

commit bf99ca3353d6047e20723fbcfb4b7ba94ed2a08d
Author: Sheng Yang<EMAIL_ADDRESS>Date:   Tue May 19 17:01:02 2015 -0700
devmapper: allow creating volume with external image

Also updated the pkg devmapper from docker in godep.


Custom open modules windows

Description
Starting from JDK17 there are no special cli switch illegal-access which opens for reflection all jdk internal modules such as java.base - ref.
UtBot requires some internal jdk modules to be open for reflection. Current set of modules are available here. This set is used every time EngineProcess is started.
However, there can be many other modules which are used via reflection either directly or indirectly. Accessing them would break UTBot. Although we have OpenModulesContainer, it cannot suffice because:

User code might have it's own modules
User code might access internal modules in unpredictable way
There are additional JDK providers which differs by JDK vendors - see #1138.

All 3 options implicate that whatever set of open modules we use - it is still possible for UTBot to access modules closed for reflection. This will break UTBot execution.
To mitigate that problem I propose to provide user a tool to customly set required modules open. The motivation is that user have much better understanding of the project UTBot is used on. In case if our module list is incomplete - he will manully provide additonal modules.
This feature involves:

[ ] At least 1 working example when our list is insufficient
[ ] Detect and catch all similar error
[ ] UI developement

If we are discussing the generated tests, we have information about incorrect modules set-up even on concrete execution's phase.   We can use this information to specify open modules automatically (on the fly).

@denis-fokin do we have any plans on this? module-info.test seems not the best option, because that's unofficial suggestion and is not supported by tools out of the box (see for example discussion, especially last comment, for IDEA ). Also one maybe don't want to modularize his own project, so adding module-info.java/test would make more harm than good. For now I would suggest to disable such problematic cases and add some type of the comment, what's needed to be 'fixe' in project configuration.
Illustration for current user problem:

Use standalone (not UTbot) JDK 17 project
Generate test with mocks for following code:

public class PrivateFieldProblem {
    private int n = 1;

    public int div(int a) {
        return a / n;
    }
}

Generated code contains:

setField(privateFieldProblem, "org.example.PrivateFieldProblem", "n", 0);

which fails during test execution with:
Unable to make private native java.lang.reflect.Field[] java.lang.Class.getDeclaredFields0(boolean) accessible: module java.base does not "opens java.lang" to unnamed module @313ac989
java.lang.reflect.InaccessibleObjectException: Unable to make private native java.lang.reflect.Field[] java.lang.Class.getDeclaredFields0(boolean) accessible: module java.base does not "opens java.lang" to unnamed module @313ac989
	at java.base/java.lang.reflect.AccessibleObject.checkCanSetAccessible(AccessibleObject.java:354)


Command Line Arguments or Config File for "--san" option

When using the "--san" option, you have to do everything from the command line after that, such as selecting "M" and entering in the host name and alternative names. Would it be possible to have these as either command line arguments or grabbed through a config file so that if I want to add an alternative name later to an existing cert I wouldn't have to type all those alternative names in again?

Right now there isn't a way.
This is what #151 is about.

Thank you for pointing this out. I wasn't aware the issue had been raised.
On Mar 9, 2016 12:41 PM, "Robert Kerber"<EMAIL_ADDRESS>wrote:

Right now there isn't a way.
This is what #151
https://github.com/Lone-Coder/letsencrypt-win-simple/issues/151 is
about.
—
Reply to this email directly or view it on GitHub
https://github.com/Lone-Coder/letsencrypt-win-simple/issues/163#issuecomment-194418293
.

If anyone wants to see this enhancement, add your +1 (via add your reaction) to the first comment of issue #151.


cmake.verbose -> build.verbose (and build.parallel)

This is related to the build step, not the configuration step (and cmake is a standin for configure the way we are using it). Needs to be backward compat if min version is set < 0.2.

cmake.parallel is too restrictive. Good docs should be helpful instead.


AsciiString Type

To match Utf8String. Somethings are Ascii only (like headers, raw urls etc) and should only be ascii and not accept > 0x7f bytes (also probably not < 32?)

To work with all possible HTTP Headers you'd actually need to use ISO-8859-1 (Latin-1) not ASCII, from RFC 5987

By default, message header field parameters in HTTP (RFC2616)   messages cannot carry characters outside the ISO-8859-1 character set (ISO-8859-1).

Although ISO-8859-1 (Latin-1) takes up the same space as ASCII so it's still a saving on UTF-8.

Updated to ascii in RFC 7230 3.2.4. Field Parsing

Historically, HTTP has allowed field content with text in the ISO-8859-1 charset [ISO-8859-1], supporting other charsets only through use of [RFC2047] encoding.  In practice, most HTTP header field values use only a subset of the US-ASCII charset [USASCII]. Newly defined header fields SHOULD limit their field values to US-ASCII octets.  A recipient SHOULD treat other octets in field content (obs-text) as opaque data.

Updated to ascii in RFC 7230 3.2.4. Field Parsing

Ahh my bad, didn't realise I was looking at an old spec

Its because Latin-1 conflicts with Utf8 whereas Ascii is compatible (so you can cross detect between the two)

I wonder if this could not be addressed with a setting/mode/parameter on Utf8String (possibly renamed) without introducing a new type. There are so many variants of encodings with byte code units.
Also, today, we don't do any validation of the Utf8String contents (when it's created). Would we do any such validation in the AsciiString?

There are so many variants of encodings with byte code units.

The relationship of ASCII with all the other encodings is special; in that isn't not just another byte type encoding; but is the basis for all of them (EBCDIC etc aside) and it has fast-path operations (uppercase, lowercase, insensitive compare); as well as being a constraint on many protocol comms.

we don't do any validation of the Utf8String contents (when it's created). Would we do any such validation in the AsciiString?

Raw byte or span .ctor probably should follow that convention. However like utf8string validates for a narrowing conversion (String -> Utf8String); the validation should be on the narrowing cast Utf8String -> AsciiString and the conversion String -> AsciiString.
Having the AsciiString type would allow the ascii only constraint to be type system specified; rather than runtime checked. If you passed an AsciiString no validation would take place; if you passed Utf8String or String then the (ex?)implicit operator would be doing the validation.
Utf8String and AsciiString should probably have a bool TryParse(ReadOnlySpan<byte>, out ...) method that does validation?

@benaadams, I would like to start with:

Adding IsAscii to Utf8String
Adding fast-path methods operating on Utf8String that assume ASCII.

If it's not enough, we can add AsciiString later.
The main reason I am pushing back is that there is already lots of concern (from various people) about the fact that we are introducing Utf8String to .NET. People still have scars from battling C++ strings.

Well Utf8Sting is a must have and AsciiString is a nice to have; so if it increases the resistance to Utf8String, then its a no go ;-)
Will close.

exactly my thinking :-)


further improve the aws 4.0 provider upgrade path

This PR will be used as the basis of a breaking change upgrade to v13 of this module.
This is a follow-up to these PRs:

https://github.com/trussworks/terraform-aws-logs/pull/271
https://github.com/trussworks/terraform-aws-logs/pull/270
https://github.com/trussworks/terraform-aws-logs/pull/268
https://github.com/trussworks/terraform-aws-logs/pull/264
https://github.com/trussworks/terraform-aws-logs/pull/261

There are 4 main components to this PR:

Add more lifecycle ignore_changes rules. This makes it so that when you perform the upgrade to the new S3 bucket resources, the aws_s3_bucket resource does not attempt to change things. It avoids issues where if you do a staggered upgrade, sometimes the aws_s3_bucket can undo changes made by the new S3 bucket resources, causing drift and conflicts. The ignore_changes rules avoid that.
Replace the enable_versioning boolean variable with the versioning_status string variable due to the more nuanced behavior of the aws_s3_bucket_versioning resource. With the new behavior, the AWS provider distinguishes between Disabled versioning (versioning has never been enabled) and Suspended versioning (versioning was once enabled, but is now turned off). The old behavior did not include this differentiation.
Bump the minimum AWS provider version to 3.75, which incorporates the new S3 bucket Terraform resources that were introduced in the 4.x version of the AWS provider.
Further improve the upgrade path instructions in the README.

Upon further review, this line should have caused a failure:
https://github.com/trussworks/terraform-aws-logs/blob/20ef7e8b98dfb48c7e2a83544237567e0d0b995d/examples/versioning/main.tf#L6
However, it did not. I checked to see if this test ran: https://github.com/trussworks/terraform-aws-logs/blob/20ef7e8b98dfb48c7e2a83544237567e0d0b995d/test/terraform_aws_logs_versioning.go#L13
I don't see TestTerraformAwsLogsVersioning anywhere in the output log: https://circleci.com/api/v1.1/project/github/trussworks/terraform-aws-logs/793/output/105/0?file=true&allocation-id=6262e9bd1e80462633774647-0-build%2F5DF98076
This warrants further investigation before merging.

The test now runs and passes.


Fix leakage when the cacheline is 32-bytes in CBC_MAC_ROTATE_IN_PLACE

rotated_mac is a 64-byte aligned buffer of size 64 and rotate_offset is secret.
Consider a weaker leakage model(CL) where only cacheline base address is leaked,
i.e address/32 for 32-byte cacheline(CL32).
Previous code used to perform two loads
1. rotated_mac[rotate_offset ^ 32] and
2. rotated_mac[rotate_offset++]
which would leak 2q + 1, 2q for 0 <= rotate_offset < 32
and 2q, 2q + 1 for 32 <= rotate_offset < 64
The proposed fix performs load operations which will always leak 2q, 2q + 1 and
selects the appropriate value in constant-time.

Rather than making assumptions about cachelines, we switched to a simpler cacheline-independent O(N log N) algorithm in BoringSSL. It removes the need for the CBC_MAC_ROTATE_IN_PLACE toggle and still performs fine: Rotate by powers of up 2, up to md_size. At each iteration, constant-time select either the rotated version, or the unrotated version, based on the corresponding (secret) bit of rotate_offset.

This pull request is ready to merge

Merged to 1.1.1 branch. Thank you for your contribution.


Trainable model

ver 2.0.0 update, model now trainable on Watson Machine Learning.
incorporates all suggestions from previous review:
https://github.com/kmh4321/MAX-Image-Segmenter/pull/4
Based on https://github.ibm.com/CODAIT/Model-Asset-Exchange/blob/master/.github/ISSUE_TEMPLATE/enable-model-for-training.md
Documentation

[x] Model /README.md in the root directory includes a training section (use this template)
[x] Model index.md (in https://github.ibm.com/IBMCode/Code-Models) includes a training section (use this template

Model training assets

[x] All model training artifacts are located in the /training/ directory.
[x] How to train this model readme /training/README.md is customized.
[x] How to prepare data for model training readme /training/data_preparation/README.md is customized.
[x] /training/...-model-training.yaml (model training configuration file) is customized (for the model) but does not define values for the three bucket properties, compute_configuration.name is k80, training_data_local.path is set to sample_training_data/ or not set.
[x] /training/wml_setup.py (setup for model training) works as expected
[x] /training/wml_train.py (model training) works as expected
[x] /training/model_training_code/ contains customized versions of train-max-model.sh, training_requirements.txt and model-specific Python training code

Sample assets

[x] Existing sample assets (images, audio files, notebooks, etc) were moved from the /assets directory to /samples (if applicable) and references to them (e.g. in the /README.md updated)

Pre-trained model assets

[x] Pre-trained model assets on COS have been refreshed (if required)
[x] No pre-trained model assets are located in the /assets directory (if applicable)
[x] The /assets directory is no longer present in github.

Model-serving microservice

[x] Docker image is based on MAX-Base image v1.1.3+

[x] Docker image can be built using /Dockerfile to serve pre-trained model assets

[x] Docker image can be built using /Dockerfile to serve custom-trained model assets

[x] Model-serving microservice can serve pre-trained model assets

[x] Model-serving microservice can serve custom-trained model assets

[x] .dockerignore was updated to exclude model training output/temp files (exception generated content in the /custom_assets/ directory), e.g. training/training_output/

[x] .gitignore was updated to exclude model training output/temp files, e.g. training/training_output/

A training-enabled model should meet these requirements:

[x] /training/sample_training_data/README.md was customized (if a small sample data set is provided)
[x] /training/sample_training_data/ contains a small sample training data set

remove custom_assets/frozen_inference_graph_mobile.pb: https://github.com/IBM/MAX-Image-Segmenter/pull/41/files#diff-0b3b3807373e38270f32637bd1410b2c

@kmh4321 some merge conflicts also need to be resolved.

Fixed COS files (updated) and moved to dev bucket, will update to prod bucket once approved.

@kmh4321  the flake command for travis needs to exclude the 3rd party deeplab code?

@kmh4321 please cut a new release (bump version to 2.0.0 if not already done)


Wanted: LuaJit update

We are building LuaJit from source, and we have pinned the source to the latest "released" version, which is 2.1.0-beta from 2017: https://github.com/deepmind/lab2d/blob/ff8853a3ba4c181adccfff2ce6aeae5635f9bba5/WORKSPACE#L102-L108
Unfortunately there doesn't seem to be any indication that there will be another stable release any time soon, but it would nonetheless be good if we could update our dependency to a more modern version. It would probably be OK to just use the 2.1 branch, which is the active development trunk. A major motivation for the update is that a it's hard to support MacOS without the update. (The 2017 version requires working in the first 4GB of address space, which is an obsolescent feature of MacOS that is deprecated in MacOS 13. More recent versions of LuaJit no longer have this limiting requirement.)
Making the update requires, apart from updating the WORKSPACE file, updating bazel/luajit.BUILD with the list of source files, and perhaps with some new macro defines for the build; this would have to be figured out. Presumably it would be a good start to compare the changes in the Makefile between versions.

Done by 02d4d547d66887a9501caaa8522bea50a5b8aef6.

Oh wow, thank you so much! ✨


Fix tox warning for non-whitelisted find command

R: @vikkyrk

Coverage decreased (-0.01%) to 69.873% when pulling 62cdd6ad0b3a278d102114f49dff1f597c81ce01 on aaltay:warn into de9e8528c0ed893a575f810e697b90e57b34a2cb on apache:master.

R: @sb2nov

LGTM


fix: [CDS-59442]: fix for force delete infra test case

Describe your changes
Comment Triggers

PR Check triggers

Build: trigger build
Sub Category Field Check: trigger subcategoryfieldcheck

trigger subcategoryfieldcheck


Add support for using the library with mypy

At the moment if I import your module I have
error: Skipping analyzing "yaml_settings_pydantic": module is installed, but missing library stubs or py.typed marker  [import-untyped]

Hi @ZeeD!
Thank you for using this library. I've reproduced this error in nvim. I'll take care of this. I'm currently occupied but I can get it done. It looks like I just need to add this
[tool.setuptools.package-data]
"pkgname" = ["py.typed"]

to pyproject.toml and add py.typed to the source folder and it should be good to go.

I added the above and installed the package in editable mode and it works in nvim:

Changes are on fix/py-typed. Let me know that it works for you and I'll merge and release it.

Hi @acederberg !
thanks for the quick response and the changes!
yeah, it should be good with just the py.typed in the published package

I am not sure why the fix/py-typed branch was never merged, but I just submitting a similar PR

I thought I had fixed this, sorry @ZeeD! It is now merged in tag 2.3.1.


@ApiModel strange behaviour when giving an existing class as the value string

Hello,
While using version 2.6.1 I ran into a peculiar issue. I have backend model classes that I would like to limit to internal-use only. For this reason, I have API models that contain the backend model as a private member variable, and expose only the fields I wish to expose using public getters and @JsonProperty. This looks as follows:
ApiModel(value = "Address")
public class AddressResource {
private Address address; // internal model class

SingleAddressResource(Address address) {
    this.address = address;
}

@JsonProperty("addressUuid")
@ApiModelProperty(value = "The Address UUID")
public UUID getAddressUUID() {
    return address.addressUUID;
}

The problem here is that if the value string is set to something that is not a class name (e.g. AddressObject), it works as I wish it to and it renders correctly on the Swagger UI page.
However, if as above, the string is a class that exists (Address), it takes the fields from the class (in my case, the internal only class). This then exposes fields I do not wish exposes.
The @ApiModel comments on value() say the following:
Provide an alternative name for the model. By default, the class name is used.

Which to my mind sounds different from the actual behaviour I describe above (as it is more than just an alternative name - it inspects the class of that name if it exists!).
Is the description of the value() function wrong, or is this a bug?

Hello, @fpanovski
I guess, SpringFox see your private Address model, may be you have a getter somewhere...
Could you provide a whole source listing and output of the Swagger UI page ?
You've got such a situation because of model merging.
For now, if you have two different models, but with same names, SpringFox will merge it in to one model.
Otherwise, unfortunately, there is no way, to introduce two models in the api listing with same names.
There is a PR #1671, that can fix it. According to the PR, you will get two models one with 'original_name' and one with 'original_name_1', so, your listing will be correct.
To fix that now you should add class Address to ignorable types, or just add
@ApiModelProperty(hidden = true) on private Address address

@fpanovski While you are correct that that is the intent of the value object. We use it to override the type name of the class that represents. So if it finds a model in the model definitions with that class name it will use that definition.
We deviate from the intent of the annotations sometimes to preserve the spirit of this library, which is to only use the annotations for hints to help the inference of models and types be better.
If you will notice the type inference in this library is much superior to the generics support provided by swagger-core. So while its useful in swagger-core, which relies on this metadata via annotations, in this library it is only to provide hints to make it better.


Add github action for build_docker on merge

This allows for docker images to be built and pushed via github actions. Resolves #86
@oliverchang We will need to add the necessary secrets via the repository configuration for pushing to gcr.io

analysis dockerfile podman pull has been changed to use vfs as the storage driver, without this the action encountered an error relating to the mounting of the aufs storage folder as seen here.
This continues to work fine for me locally.

I tried this on cloudbuild, but get a similar aufs error. Will look into a bit more next week.

I tried this on cloudbuild (#89), but get a similar aufs error. Will look into a bit more next week.

I'd hazard a guess that this is related to podman being ran within several containerised layers (CI container, docker build container) with some permissions issues from the nonroot distroless container. I'll leave this PR open as a discussion point until we resolve this.
Additionally, even without the push credentials we probably want the containers to be built as part of the PR CI process. If we fix the aufs issues for cloudbuild we should aim to translate those fixes into this at least.

Hey @Qinusty sorry for the delay here.
I'm still not sure how to fix the permission issue (we probably need something similar to --privileged, but this isn't available for docker build).
In the meantime, to unblock this PR, we can do something like:
ARG NO_PODMAN_PULL
RUN test -n "$NO_PODMAN_PULL" || \
    (podman pull gcr.io/ossf-malware-analysis/node && \
     podman pull gcr.io/ossf-malware-analysis/python && \
     podman pull gcr.io/ossf-malware-analysis/ruby)

Then build with docker build --build-arg NO_PODMAN_PULL=1 ... on CI.
We can also remove --squash from the docker build arguments, since we don't need it anymore. We squash inside the Dockerfile in the relevant images instead.

That makes sense for the build phase as we're not looking to push these images here, they don't need to be pre-loaded with the individual analysis images. I'll get this pushed up later today.


Add Jenkins

Image: https://hub.docker.com/r/jenkins/jenkins
Documentation: https://github.com/jenkinsci/docker/blob/master/README.md
important:
NOTE: Avoid using a [bind mount](https://docs.docker.com/storage/bind-mounts/) from a folder on the host machine into /var/jenkins_home, as this might result in file permission issues (the user used inside the container might not have rights to the folder on the host machine). If you really need to bind mount jenkins_home, ensure that the directory on the host is accessible by the jenkins user inside the container (jenkins user - uid 1000) or use -u some_other_user parameter with docker run.

Done


markAsReadAll not working.

When trying to use markAsReadAll it doesn't work.
But markAsRead works fine.

does it throw any error?

Nope. There is nothing.


mac/keg_relocate: use relative install names

[X] Have you followed the guidelines in our Contributing document?
[X] Have you checked to ensure there aren't other open Pull Requests for the same change?
[X] Have you added an explanation of what your changes do and why you'd like us to include them?
[ ] Have you written new tests for your changes? Here's an example.

Adds to the logic for how install_names and rpaths are fixed (after a build) and relocated (from bottles) on macOS, so that the installed binaries will load other Homebrew-installed dynamic libraries using relative paths instead of absolute paths.
For example, a reference to a library with an install_name currently set in an executable as:
/opt/homebrew/Cellar/<same_formula>/<same_version>/lib/lib<some_lib>.dylib
will be changed to something like:
@loader_path/../lib<some_lib>.dylib
instead, and references to libraries from dependencies are changed to:
@loader_path/../../../../opt/<other_formula>/lib/lib<other_lib>.dylib.
It should cover both bottled installs as well as builds from source. I've tried both—with default and custom Homebrew prefixes—and didn't run into any issues.
Note: there are also other ways to accomplish this same behavior (e.g., by adding a relative rpath entry to the binaries pointing to some known anchor point—such as the Homebrew prefix—, and then rewriting all install names to be prefixed with @rpath), but this ways keeps the code changes small. Also, Homebrew will already add a @loader_path-relative path to fix some unqualified library entries, while some formulae already set rpaths for their own purposes (which we shouldn't interfere with).
Rationale
The point of this is proposed change is to have a Homebrew install be able to survive a filesystem move of the entire prefix, as long as the internal directory structure is preserved (not all formulae can gracefully handle being moved right now, but future PRs at Homebrew/core could help with that). It is a small step towards the Homebrew installation itself eventually being fully relocatable/"portable", which for instance would help with some currently non-standard uses of Homebrew, such as project-specific installs or as a bundler for application dependencies.
I understand that anything other than installing at the default prefix is outside the scope of official support, which is why I went for a PR instead of opening an issue; and why I've intentionally kept it as simple as I could. I hope this change can be considered for review.

To make sure we're on the same page about all the consequences of this pull request: can you show an example of the output of otool -L for a dylib before and after this change?

Seems reasonable to me so far but I'll want a few others to give it some 👀.
This seems like a big enough change that it may warrant being optionally enabled by an environment variable first in CI, then for HOMEBREW_DEVELOPERs, etc. so we don't merge a single PR that potentially breaks a lot of people's setups.

Agree completely. This needs many careful eyes and ideally should take effect gradually, as things can easily go ugly if we happen to miss something.

Would love to hear how you've tested this and what e.g formulae/systems/prefixes you tried it with.

I've tested mostly by building this project of mine, which by default uses Homebrew to bundle dependencies (custom Homebrew prefix at /Volumes/<something>/usr in a case-sensitive FS), but also has the option to use a system Homebrew install (a the default prefix); so I tried both. Here's the Brewfile with the formulae that that project uses; it uses a custom tap, and in the case of the custom prefix many of the formulae need to be built from source.
I've also tried requesting a build from source in the default prefix, bottling it, and then installing that bottle to see if the relative paths remained there untouched.
I've then tried moving the entire Homebrew prefix. In this case for example, open-mpi will still fail to work properly. However, as expected, the error changes from the loader not finding the required libraries, to the package itself not finding its own stuff (i.e., the other reason you mention that affects relocatability). In this particular case, upstream offers instructions for making the install relocatable, but I haven't gotten it to work yet.
This is by no means thorough, but it does cover a bunch of different cases. A major thing is that I've only tested Apple silicon (and not Intel). Does the CI also test formulae installed from bottles and from source? (all this time I'm assuming it does; otherwise we'd need to be even more careful with this...)

This is desirable, I agree, but the main issue here I'd argue is not lack of relocatability of Homebrew's prefix but the lack of relocatability of many of Homebrew's bottles. That's not to block this PR, if/when it works we should consider merging it, but just to note that if you want to tackle this problem then something like #10846 would probably be the highest impact next direction after this PR.

Yes. This is another problem, as open-mpi shows. Thanks for the link, I've not though about directly patching the binary contents before, so it kind of scares me (I'd rather try to add relocatability on a formula-by-formula basis); but if Conda does it successfully then it can't be that bad (and would be more resilient against updates to formulae that unexpectedly break relocatability). Configuration and script files can also contain hardcode paths, so I guess that would need addressing too.
From the changes I've made to mac/keg_relocate.rb, I also saw that it some instances Homebrew itself will set an absolute path to its Perl or Java installs (which should be made relative), but I decided that was also beyond the scope of this PR (I'd prefer to focus this PR on dynamic linker paths only).

Thanks for the PR!

Thanks for being open to this change. Let's see if we can get it into some mergeable state.

To make sure we're on the same page about all the consequences of this pull request: can you show an example of the output of otool -L for a dylib before and after this change?

Sure, here's an output for open-mpi for example (otool -L /opt/homebrew/opt/open-mpi/lib/libmpi.dylib):
Before:
/opt/homebrew/opt/open-mpi/lib/libmpi.dylib:
	/opt/homebrew/opt/open-mpi/lib/libmpi.40.dylib (compatibility version 71.0.0, current version 71.5.0)
	/opt/homebrew/Cellar/open-mpi/4.1.5/lib/libopen-rte.40.dylib (compatibility version 71.0.0, current version 71.3.0)
	/opt/homebrew/Cellar/open-mpi/4.1.5/lib/libopen-pal.40.dylib (compatibility version 71.0.0, current version 71.3.0)
	/usr/lib/libz.1.dylib (compatibility version 1.0.0, current version 1.2.11)
	/opt/homebrew/opt/hwloc/lib/libhwloc.15.dylib (compatibility version 22.0.0, current version 22.2.0)
	/opt/homebrew/opt/libevent/lib/libevent_core-2.1.7.dylib (compatibility version 8.0.0, current version 8.1.0)
	/opt/homebrew/opt/libevent/lib/libevent_pthreads-2.1.7.dylib (compatibility version 8.0.0, current version 8.1.0)
	/usr/lib/libSystem.B.dylib (compatibility version 1.0.0, current version 1319.100.3)

After:
/opt/homebrew/opt/open-mpi/lib/libmpi.dylib:
	/opt/homebrew/opt/open-mpi/lib/libmpi.40.dylib (compatibility version 71.0.0, current version 71.5.0)
	@loader_path/libopen-rte.40.dylib (compatibility version 71.0.0, current version 71.3.0)
	@loader_path/libopen-pal.40.dylib (compatibility version 71.0.0, current version 71.3.0)
	/usr/lib/libz.1.dylib (compatibility version 1.0.0, current version 1.2.11)
	@loader_path/../../../../opt/hwloc/lib/libhwloc.15.dylib (compatibility version 22.0.0, current version 22.2.0)
	@loader_path/../../../../opt/libevent/lib/libevent_core-2.1.7.dylib (compatibility version 8.0.0, current version 8.1.0)
	@loader_path/../../../../opt/libevent/lib/libevent_pthreads-2.1.7.dylib (compatibility version 8.0.0, current version 8.1.0)
	/usr/lib/libSystem.B.dylib (compatibility version 1.0.0, current version 1319.100.3)

@carlocab I've updated the LinkageChecker so it now expands install names with @loader_path instead of skipping them.
I've also added expansion of @executable_path when the file in question is an executable, as in that case it will always be a synonym for @loader_path (unless one can load another executable as a library? I don't believe that to be possible).

@carlocab and @MikeMcQuaid Thanks again!
I've factored out the new name substitutions into a loader_name_for function (can be bikeshedded), which only gets called when dealing with install_names and rpaths (and never for ids), and only at two clear points: when fixing paths of a build from source (fix_dynamic_linkage), and after pouring a bottle (relocate_dynamic_linkage).
Following @carlocab's suggestion, I've also updated linkage_checker.rb so that it it is now able to check these relative paths to ensure they are not broken. I see that this is tested by the "test default formula" jobs, which are passing (BTW, the "cask audit" job failure looks like just some server being down). This part gives me a little more confidence that this change won't immediately break other people's installs.
I'll wait for more comments/reviews/guidance before making any more changes.
P.S. I think we could also add a test to prevent any accidental regressions, but I'm not sure where that would go.

I'm currently neck-deep in Homebrew/homebrew-core#134251, so I haven't had a chance to take a proper look here. Will come back to it next week.

Another thought that occurs to me, that would be useful for your use case, but would likely have to stay permanently gated behind an environment variable (e.g. HOMEBREW_USE_RPATH_PREFIXES):
If this environment variable is set, brew will rename all dylib IDs so that they are @rpath-prefixed, e.g., @rpath/libbasename.1.2.3.dylib. This should be implemented alongside #15354, since the desired behaviour is similar (except one is driven by a formula definition, the other by an environment variable).

Another thought that occurs to me, that would be useful for your use case, but would likely have to stay permanently gated behind an environment variable (e.g. HOMEBREW_USE_RPATH_PREFIXES):
If this environment variable is set, brew will rename all dylib IDs so that they are @rpath-prefixed, e.g., @rpath/libbasename.1.2.3.dylib. This should be implemented alongside #15354, since the desired behaviour is similar (except one is driven by a formula definition, the other by an environment variable).

Thanks! Interesting. I did play around with something similar to that just before opening this PR: I actually chose $HOMEBREW_PREFIX as the anchor point for rpath and then replaced every install_name and id to be defined relative to @rpath. In that case, you can easily link anything as long as there's an rpath that points to the Homebrew install (via a compiler/linker flag or by adding an rpath entry afterwards—you can use a relative rpath for maximum relocatability!).
You're right that my use case could benefit from something like this, even if it needs to be gated behind an env var as it would break stuff for regular users (I still wonder whether a change like this can be made to work in a transparent way for regular usage too...)

Let's ship this so we can get to testing it soon-ish.

This broke julia: https://github.com/Homebrew/homebrew-core/pull/135398#issuecomment-1643041541 by altering the order of rpath's (see details in the linked comment and the one above).

I don't think it's this change, because this shouldn't affect rpaths unless HOMEBREW_RELOCATABLE_INSTALL_NAMES is set.
https://github.com/Homebrew/brew/commit/27032e002fb51fc5554145cef1a54fba2b32505f sounds more likely.

Didn't https://github.com/Homebrew/brew/commit/27032e002fb51fc5554145cef1a54fba2b32505f go in 3 days ago?
RPATH issue has been happening for a week now, e.g. https://github.com/Homebrew/homebrew-core/pull/136273


arduino-as-component  (IDFGH-9321)

Answers checklist.

[X] I have read the documentation ESP-IDF Programming Guide and the issue is not addressed there.
[X] I have updated my IDF branch (master or release) to the latest version and checked that the issue is present there.
[X] I have searched the issue tracker for a similar issue and not found a similar issue.

General issue report
fatal error: Arduino.h: No such file or directory
1 | #include "Arduino.h"
|          ^~~~~~~~~~~
compilation terminated.
#include "Arduino.h"
extern "C" void app_main()
{
initArduino();
pinMode(4, OUTPUT);
digitalWrite(4, HIGH);
// Do your own thing
}
Test on Windows 10, pop OS, and Mint.

Hi @RodrigoRamosRibeiro,
Could you please add more information to help us troubleshoot this issue:

What steps have followed to set up the project with Arduino-esp32 as a component?
Which versions of ESP-IDF and arduino-esp32 are you using? You can run git describe command in ESP-IDF and arduino-esp32 directories to get this.
What is the content of your project's CMakeLists.txt?
What is the content of main/CMakeLists.txt in your project?
Please run idf.py fullclean, then idf.py build and attach the entire output you get from that command. (Preferably, as a text file.)

logs.txt
New project - "Arduino-as-component" template-compile.
idf 5.0
CMakeLists.txt project 👍
The following lines of boilerplate have to be in your project's
CMakeLists in this exact order for cmake to work correctly
cmake_minimum_required(VERSION 3.5)
include($ENV{IDF_PATH}/tools/cmake/project.cmake)
project(project-name-teste)
main/CMakeLists.txt
idf_component_register(
SRCS "main.cpp"
INCLUDE_DIRS ""
)
I made a video and it is linked below:
https://youtu.be/ECQuXF6eFtY
pop os

The main issue, as far as I can tell, is your project doesn't include and doesn't have any reference to arduino-esp32 component.
You can confirm it by looking at "Components: " and "Component paths: " lines in logs.txt. With arduino-esp32 component added successfully, you should see its name in that list. Please refer to the docs for using arduino-esp32 as an IDF component: https://docs.espressif.com/projects/arduino-esp32/en/latest/esp-idf_component.html.
The second issue which you aren't running into, yet, is that you are trying to use arduino-esp32 with IDF v5.0. At the moment, arduino-esp32 project uses IDF v4.4.3, and will not compile successfully with IDF v5.x. So you will need to use IDF v4.4.x if you'd like to use arduino-esp32 as an IDF component.

i am running various projects with arduino as a component. It is as @igrr said, you have to register the component, and also have both the arduino as well as the esp-idf on the correct version.
This is not exactly trivial, because lets say that you are developing something on esp-idf 5 and another project on the esp-idf 4, you would have to have both of them installed. To make things worse, sometimes the idf version that the arduino build was based it wasn't a specific release of idf but a random commit. This was at the time of arduino 1.0.6, so i am not sure if this has changed right now.  To avoid this you have to also use the esp-idf as a component on the project folder.
In any case for the instructions i assume:

that you have installed the ESP-IDF 4.4.3.
that you are using git

To make it clearer you have to do the following steps.

Download arduino on the project folder.
mkdir -p components && \ cd components && \ git clone https://github.com/espressif/arduino-esp32.git arduino && \ cd arduino && \ git submodule update --init --recursive && \ cd ../..

add the arduino as a submodule.
git submodule add 'components/arduino'

Change the arduino in the correct commit. By default you got the master branch, which is probably not the correct version. Go to the folder of arduino and checkout the 2.0.6 tag, then another git submodule update --init --recursive

commit your project changes on git, and now the submodule should be on the correct version from now on.

run idf.py menuconfig to configure the project. You need to enable some settings for the arduino to compile. This may be inaccurate nowdays and this step is probably NOT needed, because last time i tried that i was still on 1.0.6, but better to give you all the information.

Arduino Configuration / Autostart arduino setup and loop on boot

Component configuration / MbedTLS / TLS key exchange methods / Enable preshared-key-ciphersuits / enable PSK based Ciphersuit modes

change on the component configuration/freertos/tick rate and set it ot 1000
because delay() function will only work in multiples of 10ms. That is because, by default, esp-idf handles task events 100 times per second. To fix that behavior you need to set FreeRTOS tick rate to 1000Hz in Component config -> FreeRTOS -> Tick rate.

enable on Component configuration/bluetooth the bluetooth module.

finally on the CMakeList.txt you need to have something equivalent:

idf_component_register(SRCS "whatever.c"
 INCLUDE_DIRS "."
 REQUIRES arduino)

Any arduino libraries you want to add need a similar approach + a make file
for example a component of the "Adafruit sensor" needs the following in its own CMakeLists.txt

idf_component_register(SRCS "Adafruit_Sensor.cpp"
                       INCLUDE_DIRS "."
                       REQUIRES arduino)

Finally, this applies only the normal development boards. if you have anything from another manufacturer (for example maybe an esp32 firebeetle from dfrobot, you also need to replace the arduino/variants/esp32/pins_arduino.h file from the file of the correct variant.

if you do this you need to edit the .gitmodule file to set the submodule status as dirty for the arduino
[submodule "components/arduino"]
	path = components/arduino
	url = https://github.com/espressif/arduino-esp32.git
	ignore = dirty

Good luck. Personally after messing a while with all that (and some other issues that i had with the arduino wrappers). , i found it easier to just rewrite any driver to pure esp-idf and avoid arduino all together.

run idf.py menuconfig does not work until manually change sdkconfig to:CONFIG-FREERTOS-HZ=1000


Consider renaming GO:0036335 to 'intestinal crypt stem cell homeostasis'

From https://github.com/obophenotype/cell-ontology/issues/79:
From @addiehl's comment:
"I think the CL class 'intestinal crypt stem cell' (CL:0002250) is the appropriate choice for the required logical definition of GO:0036335, based on a simple Google search for "intestinal stem cell" and reading what I found. Arguably GO:0036335 should be renamed "intestinal crypt stem cell homeostasis," but I will leave that to GO to ponder."

Thank you for the insight, @raymond91125.
If a reference can be identified to justify whether to close the ticket or make an edit, can that be provided?

Indeed, there are no crypts in the Drosophila midgut – though people sometimes use that term even in flies, by analogy with the mammalian gut.
For reference, you may have a look at Figure 2 in Jiang and Edgar, 2012 (PMID:22608824).
So if intestinal stem cell homeostasis is intended to also apply to Drosophila (which seems to be the case, I can see that it has been used to annotate fly genes), I agree that it should probably not be renamed to mention “crypt” in the label – though maybe this could be added as a synonym?

By the way, I meant Figure 1 in the Jiang and Edgar paper, sorry.

I can add a 'narrow' synonym "intestinal crypt stem cell homeostasis" if that's helpful. Also PMID:22608824 is a good ref to add. Thanks.


on the Network connections swap the local address with the foreign address

or the vice versa, i.e. is this a bug on the backend?  seems like it......

Kopik, can you please investigate?  Thx.

foreign vs local address seems to be swapped?

foreign really is local wtf

closed


Fail to build on Ubuntu 20.04 WSL

Following the instructions from the README.MD file I ran:
apt install build-essential libcurl4-openssl-dev libboost-regex-dev \
libjsoncpp-dev librhash-dev libtinyxml2-dev libhtmlcxx-dev \
libboost-system-dev libboost-filesystem-dev libboost-program-options-dev \
libboost-date-time-dev libboost-iostreams-dev help2man cmake libssl-dev \
pkg-config zlib1g-dev qtwebengine5-dev

mkdir build
cd build
cmake .. -DCMAKE_INSTALL_PREFIX=/usr -DCMAKE_BUILD_TYPE=Release -DUSE_QT_GUI=ON

make

and the make step outputs the following
[100%] Automatic MOC and UIC for target lgogdownloader
[100%] Built target lgogdownloader_autogen
[100%] Built target lgogdownloader
[100%] Building man page
help2man: can't get `--help' info from "/home/philipedwards/lgogdownloader/build/lgogdownloader"
Try `--no-discard-stderr' if option outputs to stderr
make[2]: *** [man/CMakeFiles/manpage.dir/build.make:62: man/lgogdownloader.1.gz] Error 127
make[1]: *** [CMakeFiles/Makefile2:151: man/CMakeFiles/manpage.dir/all] Error 2
make: *** [Makefile:130: all] Error 2

I saw in here that there seemed to be a way to skip manpage generation if help2man wasn't installed so I tried to work around this by running, from the build directory, but it didn't work.
make clean
sudo apt-get remove help2man
cmake .. -DCMAKE_INSTALL_PREFIX=/usr -DCMAKE_BUILD_TYPE=Release -DUSE_QT_GUI=ON

make

I worked around this by editing CMakeLists.txt and removing the last line which added the man dependency.

Please report if the generated executable still randomly stops downloading after 5-10 minutes which it did Ubuntu 18.04 with WSL2.
I made a build for a friend and did some debugging, but it seems that amount of file handles and or sockets are getting filled up until lgogdownloader under this environment just stops (did verbose debugging).


Project still maintained?

Hi! :wave:
Is this package still actively maintain and used?
I made a version here: https://github.com/ChristianMurphy/react-remark, building a markdown renderer for react using remark, and I just found out  AaronCCWong/react-remark exists when I tried to publish it to npm!
Are you interested in maintaining this & continuing work on it? If not, could I use the name on npm?

@AaronCCWong Ping!

Hey guys, thanks for pinging me about this. A company I used to work for use this. Let me verify this is ok and get back to you guys. ETA: 11/17.
If they are still using this, I will have them move off of it and pass ownership to you guys.

Wanted to give you guys an update, they are still using it. I have told them to move off of it. I expect to be able to transfer ownership of the npm package to you in the first week of December. Please let me know who I should add as the new owner of react-remark.

@AaronCCWong thanks for the update! You can add me (wooorm on npm) to the package!

Done


Update manage-updates-baselines-windows-defender-antivirus.md

We may extend with 1 column in the future

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.:x: kurtsarens sign nowYou have signed the CLA already but the status is still pending? Let us recheck it.


If I implement dart-locust, will it be accepted?

Is your feature request related to a problem? Please describe.
Hi thanks for this wonderful library! I propose to implement a locust-like testing framework but in the Dart language.
The benefits are:

For those with complicated Flutter frontend related to user behavior (like me), they do not need to re-implement complex logic in Python again, but can reuse code in Dart. For example, my web-socket logic.
Dart is staticially typed and has even sound null safety. So tester code in Dart will be less buggy compared with Python one (of course Python is also a wonderful language).
Python Locust is a bit dynamic (with magic here and there), so new learners may not be that clear about it; but locust reimplemented in Dart will be easier to read since there will be almost no magic in Dart.
The performance of Dart is high. Dart supports async/await and supports AOT compilation into machine codes.

Describe the solution you'd like
N/A

Describe alternatives you've considered
N/A

Additional context
N/A

@cyberw Good idea! But indeed I also want to improve some features of locust. For example, I want to

Allow one-click code push. After changing my local code, I can just do something like my-command push ./my_code and master & workers will see the new code and use it to stress test
Make it cloud-native (live with k8s). In other words, every worker/master will be a Pod, and then we can schedule the number of workers very easily by using the nature of k8s.
 I love locust's way of specifying probability of going from one action to another. But IMHO it is most likely that we only know "what is the TPS of some http endpoint", so I hope I can make dart-locust support this.

Thanks for suggestions!

@cyberw Good question - I think it is the spirit that fits my plan. You know, before finding out locust, I only saw Jmeter and LoadRunner and so on, which uses terrible UI/xml to define load tests. Then I find locust and love it because we can write tests in code. Now, since locust lacks some features, we want to implement the proposed one.

Ok, then it doesnt really fit here. But good luck!

Thank you!


theano.gof.fg.MissingInputError when stateful

This is my code
in_out_neurons = 1
hidden_neurons = 10
batch_size = 10

model = Sequential()
model.add(GRU(hidden_neurons, batch_input_shape=(batch_size, 5, in_out_neurons), return_sequences=True, stateful=True))
model.add(Dropout(0.2))
model.add(TimeDistributedDense(in_out_neurons))
model.add(Activation("linear"))
model.compile(loss="mean_squared_error", optimizer="rmsprop")

and I get this error on compile
theano.gof.fg.MissingInputError
MissingInputError: ("An input of the graph, used to compute DimShuffle{1,0,2}(<TensorType(float32, 3D)>), was not provided and not given a value.Use the Theano flag exception_verbosity='high',for more information on this error.", <TensorType(float32, 3D)>)

This is the traceback
model.compile(loss="mean_squared_error", optimizer="rmsprop")

keras/models.py", line 372, in compile
self.y_train = self.get_output(train=True)

keras/layers/containers.py", line 82, in get_output
return self.layers[-1].get_output(train)

keras/layers/core.py", line 527, in get_output
X = self.get_input(train)

keras/layers/core.py", line 117, in get_input
return self.previous.get_output(train=train)

keras/layers/core.py", line 807, in get_output
X = self.get_input(train)

keras/layers/core.py", line 117, in get_input
return self.previous.get_output(train=train)

keras/layers/core.py", line 503, in get_output
X = self.get_input(train)

keras/layers/core.py", line 117, in get_input
return self.previous.get_output(train=train)

keras/layers/recurrent.py", line 82, in get_output
K.set_value(self.states[i], K.eval(states[i]))

keras/backend/theano_backend.py", line 74, in eval
return x.eval()

theano/gof/graph.py", line 519, in eval
self._fn_cache[inputs] = theano.function(inputs, self)

theano/compile/function.py", line 317, in function
output_keys=output_keys)

theano/compile/pfunc.py", line 526, in pfunc
output_keys=output_keys)

theano/compile/function_module.py", line 1777, in orig_function
output_keys=output_keys).create(

theano/compile/function_module.py", line 1429, in __init__
accept_inplace)

theano/compile/function_module.py", line 177, in std_fgraph
update_mapping=update_mapping)

theano/gof/fg.py", line 171, in __init__
self.__import_r__(output, reason="init")

theano/gof/fg.py", line 363, in __import_r__
self.__import__(variable.owner, reason=reason)

theano/gof/fg.py", line 477, in __import__
r)

This is now fixed.
However, one remaining gotcha with statefulness is that the RNN states won't be updated if you use predict, evaluate, etc. In other words, statefulness only works in training mode. The reason being that predict & co are implemented to be idempotent. Changing that would require crafting an exception specifically for RNN statefulness.

which is a horrible thing, as one of the main issues with the lack of states is that you can't let your network generate stuff without redundantly iterating through your sequence over and over and over.

"In other words, statefulness only works in training mode. "
Hi, Is this still the case? I am afraid "Stateful LSTM" will be much less useful if "statefulness" does not work for testing mode.


Broken after upgrade

Today I did a ee update becuase it's been a while. Now ee is broke for me.

ee site create demo.redux.io --wpfc

Downloading WP-CLI               [Errno 2] No such file or directory: '/usr/bin/wp'

root@reduxframework:/usr/bin# ee --version

EasyEngine v3.0.5
Copyright (c) 2015 rtCamp Solutions Pvt. Ltd.

Any ideas?

Wird thought the ee update was removed and you had to use https://rtcamp.com/easyengine/docs/commands/ee-update/

Try the following
ee stack install --wpcli
And then try and create a --wpfc site again.

root@reduxframework:/var/www# ee stack install --wpcli
Downloading WP-CLI               [Errno 2] No such file or directory: '/usr/bin/wp'

Just manually installed wp-cli and all is well with the world.  :)

Bah, now I'm getting:
root@reduxframework:/var/www# ee site create demo.redux.io --wpfc
Setting up NGINX configuration 	[Done]
Setting up webroot 		[Done]
Downloading Wordpress 		[Done]
Setting up database		[Done]
Unable to Generate wp-config

Seems like I just need to re-install.

Wird issues you got going, just tryed to update my servers my self, no issues or what so ever :(

have you tryed ee stack install --web

root@reduxframework:/home# ee stack install --web
Nginx already installed
PHP already installed
MySQL connection is already alive
Postfix is already installed
WP-CLI is already installed
However now it does this:
root@reduxframework:/var/log/ee# ee site create demo.redux.io --wpfc
Setting up NGINX configuration 	[Done]
Setting up webroot 		[Done]
Downloading Wordpress 		[Done]
Setting up database		Cannot setup database user

Which probably means on the upgrade it lost my mysql user/pass. Were are those stored?

So I thought it was related to #454. So I made sure and reset the root password to the one listed in ~/.my.cnf. However, the problem still persists.
root@reduxframework:~# ee site create demo.redux.io --wpfc
Setting up NGINX configuration 	[Done]
Setting up webroot 		[Done]
Downloading Wordpress 		[Done]
Setting up database		Cannot setup database user

Do you have an odd command in your most recent version? Do I need to update mysql? I originally had ee setup this server. So I'm confused by these issues.

Great. Now my whole server is getting 502 Bad Gateway...

Ok, so ee update forced a new update to /etc/php5/fpm/pool.d/www.conf. I allowed it to create a new file, thus throwing my server into shock.
Luckily it was smart enough to make a www.conf.dpkg-old backup. I restored that, did a service php-fpm restart and my server started working again.
However, now "cannot create database" or "cannot create database user" keeps happening...

ee.log:
root@reduxframework:/var/log/ee# tail ee.log
2015-03-18 23:04:08,358 (DEBUG) ee : Changing directory to /var/www/demo.redux.io/htdocs/
2015-03-18 23:04:08,358 (DEBUG) ee : Running command: wp --allow-root core download
2015-03-18 23:04:09,233 (INFO) ee : [Done]
2015-03-18 23:04:09,234 (INFO) ee : Setting up database
2015-03-18 23:04:09,234 (DEBUG) ee : Creating databse demo_redux_io
2015-03-18 23:04:09,241 (DEBUG) ee : Executing MySQL statement: create database `demo_redux_io`
2015-03-18 23:04:09,242 (DEBUG) ee : Creating user demo_redux_io
2015-03-18 23:04:09,242 (DEBUG) ee : create user `demo_redux_io`@`localhost` identified by ''
2015-03-18 23:04:09,244 (DEBUG) ee : (1396, "#HY000Operation CREATE USER failed for 'demo_redux_io'@'localhost'")
2015-03-18 23:04:09,244 (ERROR) ee : Cannot setup database user

Not sure if this is helpfull in any way, try and do ee stack migrate --mariadb
Make sure you got backup of your stuff, but ye if it's nothing big you got on the server, it might be faster to do a re-install.
I would hate reinstalling right now, since i got some quite large sites running.

I have a few sites running... I'm worried about crashing.

It's not ee. It's all in mysql. Can't create the user accounts after update of the stack...

Ye that sound like a pain i the a**
Hope one of the dev's can kick in with some info on this, would be nice to know if it happens to me ad some point.

OK, here's the resolution.
If for some reason the creation fails (wp-cli wasn't properly installed via an upgrade), then things linger.
So I had to do the following:

Install wp-cli manually since it didn't install via upgrade.
Remove the database manually - Even though it said the DB didn't exist, I had to manually delete it.
Remove the user manually. If the DB isn't found, ee doesn't search for the user to clean things up.
Delete the site and try again.

I think we should have extra checks. Even if it's not in the EE database, we should check if the db or user is there and prompt the user to delete them. It would have solved a whole ton of pain.
Also on creation we should check for an existing user. If there is, create another and go.
Either way, that's the resolution. Not enough error checking in the setup site process.  ;)

@dovy what was the ee version from which you updated?

I honestly do not know, but here's the log of the update.
https://gist.github.com/dovy/ec94a8f4db1ff280e9a9

Thanks. I'll take a snapshot of the VM before I try!

I have a backup of my server I may be able to get from linode if you need.

@dovy ,
I would like to check your server if you are not destroyed it yet.
You can add my SSH key fromhere http://docs.rtcamp.com/easyengine/keys.html

I will get you access tomorrow. On the road today.

I just updated from 3.0.3 to 3.0.5 and I'm getting the same "Unable to
Generate wp-config" issue.  Tried a site delete command and it says my site
doesn't exist in the database. At this point I'm going to simply create a
new AWS instance and start from scratch - but this would be a nightmare on
an active server with live sites.
Have any checks been put into place to make sure wp-cli gets installed
during the updates? If that is the actual culprit?
Thanks,
Matt
On Thu, Mar 19, 2015 at 10:46 AM, Dovy Paukstys<EMAIL_ADDRESS>wrote:

I will get you access tomorrow. On the road today.
—
Reply to this email directly or view it on GitHub
https://github.com/rtCamp/easyengine/issues/464#issuecomment-83639824.

I have the same issue.
Downloading WP-CLI               [Errno 2] No such file or directory: '/usr/bin/wp'
That's the first thing that shows up upon any attempt at making a new site. I already have 5 sites created on this droplet (Ubuntu 12.04.5 Digital Ocean), but I haven't made a new site in months. Now that I try, this happens.

Follow all of my steps and it will work again. I had the same issue.

Just did that, installed wp-cli manually from here and it works. http://wp-cli.org
So glad!
Now if I could figure out why my server won't update from 12.04 to 14.04 that would be even more awesome. (always errors at the end). - Would there be any advantages to updating from 12.04 to 14.04


Asp.net core 3.0 how read body from PipeWriter .

Hi,
Could you please help me i am writing middleware for request and response .
i was using  stream but need to convert  PipeWriter and PipeReader.
Could you please help me how read body from PipeWriter .
i have written code for PipeReader.
private  async Task GetStringFromPipeReader(PipeReader reader)
{
StringBuilder stringBuilder = new StringBuilder();
while (true)
{
// await some data being available
ReadResult read = await reader.ReadAsync();
ReadOnlySequence buffer = read.Buffer;
// check whether we've reached the end
// and processed everything
if (buffer.IsEmpty && read.IsCompleted)
break; // exit loop
            // process what we received
            foreach (var segment in buffer)
            {
                string asciString = Encoding.ASCII.GetString(
                    segment.Span);
                stringBuilder.Append(asciString);
            }
            // tell the pipe that we used everything
           // reader.AdvanceTo(buffer.End);

            reader.AdvanceTo(buffer.Start, buffer.End);

            if (read.IsCompleted)
            {
                break;
            }

        }
        return Convert.ToString(stringBuilder);
    }

   private  async Task  WriteSomeDataAsync(PipeWriter writer, string jsonValue)
    {
        // use an oversized size guess
        Memory<byte> workspace = writer.GetMemory();
        // write the data to the workspace
        int bytes = Encoding.ASCII.GetBytes(
           jsonValue, workspace.Span);
        // tell the pipe how much of the workspace
        // we actually want to commit
        writer.Advance(bytes);
        // this is **not** the same as Stream.Flush!
        await writer.FlushAsync();
    }

Thanks,
Konanki

Why do you need to switch to pipes? That's optional. You can continue to use Streams and only put a pipe adapter over them when needed. For an example look at how the response compression middleware works. Here are the changes we made in 3.0 to consolidate streams and pipes:
https://github.com/aspnet/AspNetCore/commit/080660967b6043f731d4b7163af9e9e6047ef0c4#diff-8e5e94fea052bcafa7a5167a9011e90d
https://github.com/aspnet/AspNetCore/commit/080660967b6043f731d4b7163af9e9e6047ef0c4#diff-5d4ce933ddf778f17e053750af25e703

This is not the place for a tutorial on Pipes. @davidfowl can you suggest any similar Pipe samples, doc, etc.?

We have some docs here: https://docs.microsoft.com/en-us/aspnet/core/fundamentals/middleware/request-response?view=aspnetcore-3.0. I can't find the .NET ones.

@mkris2003 There's no point using the PipeReader if you're going to turn it all into a string. You won't save too much (though you can save on intermediate allocations). You're basically re-implementing StreamReader at that point.


LivenesProbe Task + Fixup ReadinessProbe Task

Published at
http://pwittrock.github.io/docs/tasks/automatically-restarting-unhealthy-containers/

@johndmulhausen I am going to self merge this.  Feel free to leave comments if there is anything you see that should be changed.


docs(ci): fix travis syntax error and disable docs deployment for pul…

Obviously bash scripts need a seperate space in the if condition, otherwise it throws an syntax exception. This problem prevented the docs from getting deployed. Additionally I have add a condition for pull request, because the travis branch env also seems to be pointing to master, if the target branch of a pr is master.

I suggest take this commit for branch checker: https://github.com/ReactiveX/rxjs/commit/8dd39b54f9bd4cf7932bb1537b27fd94f38649c6

Seems reasonable. How would you integrate that, copy paste could lead to minor merge conflicts?

you could cherry pick commit, resolve merge conflict, force push PR. or either this PR just leaves branch detection, merge and let #3771 resolves branch check.

Cherry picking sounds good. Thanks for the hint.

Yeah I removed the branch detection ...


merge wash otp branches and remove REPL-related code

[ ] Update topics to reflect new control interface changes with jetstream
[ ] Remove REPL related code


Spacer widget to grow into available space.

There needs to be a "blank spacer" / filler widget to grow into available space.

In a flexbox this can be done by adding an empty box with a positive flex value. This can be done multiple times within the same container, in which case the spacers split the available space between them. Whether the spacer is a row or column doesn't matter, because there's nothing inside it to lay out.


Fixed #28076 -- Made date parsing handle Postgres' interval format

https://code.djangoproject.com/ticket/28076

Ticket

Do you plan to continue this soon, Matthew?

I did see this PR yesterday when looking through for something else.
I can't remember why I stopped: I'll try to squeeze some time in this weekend.

Ah, it seems there was a little more to this than I had originally thought.


Add .nuspec file to source control?

Is the nuspec that builds https://www.nuget.org/packages/DokanNet available?

https://github.com/dokan-dev/dokan-dotnet/blob/master/DokanNet/DokanNet.nuspec

I swear it wasn't there! Sorry!


Spike statistics in the store

The user provides a function mystuff(spike_start, spike_stop) to compute all stats for the spikes between spike_start (included) and spike_stop (excluded). This is for performance/RAM reasons: it will be computed on a chunk-by-chunk basis (e.g. the first 10,000 spikes, the next 10,000 ones, etc). The function must return a NumPy array with spike_end-spike_start elements in the first axis. Data is accessed from the view model.
The function is called during the store creation, and the results are saved in a single big file with the stats of all spikes.
The new extra feature can then be used in the feature view.

done in the latest version


refactor generic_feature_button spec

before it was also a unit test, because it was mocking the only method used in the class.
plus it created objects for every feature.
@romanblanco @PanSpagetka as this is your code, are you ok with this?

@miq-bot add_labels test, refactoring, darga/no

@durandom LGTM :+1:

@durandom I guess we should do the same with generic_feature_button_with_disable_spec.rb, right?


show version number on ui

Why not to show the version number in ui?
I can't find the version number of current running instance

Duplicate of https://github.com/drone/drone/issues/2849


intel: Add support for Cyclone V internal oscillator

When using the default clock "cyclonev_oscillator" on Cyclone V devices, the internal oscillator will be used.

Thanks!

Thanks for the quick feedback, happy to contribute!


Set up SWR Storage

The SoilWise Repository is expected to fulfill the following functions:
Storage of artifacts
Storage of metadata
Storage of data
Storage of knowledge
Backup and versioning
Spec can be found here

Need on more specifications/requirements about storage
There is some (e.g. PyCSW-postgresql, also intermediary data in some processes, ...)
Need more clarification where we need to provide storage


3.x - Sensors are not updated when other user is logged in

My ID.4 got updated to 3.0 (First OTA wave). One of the functions we were really happy to have are profiles.
Our mirrors, seats, colors and radio stations are now in sync with the person that's driving.
Awesome.
One big issue i now have with implementing the new 3.0 sensors into Home Asssistant is that the sensors are not updating when the other user is driving the car. Also when she parks the car, the car still holds her account so no sensors are updated.
Is know this a privacy thing, do you think there is a way around this? State of charge is not that much of a secret.
I do understand that parking position is private.
The app is also greyed out when she uses it :)

This is a known problem and you will experience the same with the official app. The problem is that the second user is a "guest user" and not a real "secondary user" hopefully this will be fixed soon by VW.


Add dockerfile and sample docker compose

Sorry, I'll fix this PR. I completely forgot about it.

@niteshbalusu11 No worries, thanks for doing it in the first place! Also, if you could squash the commits into one that would be great.


[Feature Request] Add support for Console Logs with DEBUG level in scripts

As part of #190 (Console Logs in scripts should be written into developer console) there was added possibility to log messages from scripts, but DEBUG level (console.debug()) was not added. I'm not sure it was intentionally or not, but it would fine to have this level also supported.
Currently request with console.debug() in script fails:

If you agree with adding it I can prepare PR.

It was implemented in #527