Gh 1365 federated schemas

Codecov Report

Merging #1437 into develop will decrease coverage by 0.03%.
The diff coverage is 79.82%.

@@              Coverage Diff              @@
##             develop    #1437      +/-   ##
=============================================
- Coverage      65.88%   65.85%   -0.04%
  Complexity      1646     1646
=============================================
  Files            707      713       +6
  Lines          23152    23189      +37
  Branches        2938     2937       -1
=============================================
+ Hits           15254    15270      +16
- Misses          6713     6728      +15
- Partials        1185     1191       +6

Impacted Files
Coverage Δ
Complexity Δ

...k/gov/gchq/gaffer/store/schema/TypeDefinition.java
37.38% <0%> (-2.43%)
0 <0> (ø)

...gchq/gaffer/federatedstore/operation/AddGraph.java
93.54% <100%> (+0.21%)
0 <0> (ø)
:arrow_down:

...main/java/uk/gov/gchq/gaffer/store/StoreTrait.java
100% <100%> (ø)
0 <0> (ø)
:arrow_down:

...affer/federatedstore/operation/GetAllGraphIds.java
91.66% <100%> (+1.66%)
0 <0> (ø)
:arrow_down:

...e/operation/handler/function/TransformHandler.java
43.75% <100%> (+6.25%)
0 <0> (ø)
:arrow_down:

...affer/store/operation/OperationChainValidator.java
77.77% <100%> (+0.41%)
0 <0> (ø)
:arrow_down:

...tore/operation/handler/function/FilterHandler.java
100% <100%> (ø)
0 <0> (ø)
:arrow_down:

...affer/store/operation/handler/ValidateHandler.java
100% <100%> (ø)
0 <0> (ø)
:arrow_down:

.../handler/FederatedOperationAddElementsHandler.java
84.61% <100%> (+0.61%)
0 <0> (ø)
:arrow_down:

...q/gaffer/federatedstore/operation/RemoveGraph.java
100% <100%> (ø)
0 <0> (ø)
:arrow_down:

... and 18 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 28d460d...bf736f1. Read the comment docs.


CI yielding warning lines

We have CI now in the schemas repo... yay!
We should make it stricter; there are a bunch of warning lines getting spewed out in the current CI:
https://travis-ci.org/ga4gh/schemas
$ nosetests -v tests
testMaven (test_maven.TestMaven) ... ok
[WARNING] Avro: Invalid default for field recordCreateTime: null not a "string"
[WARNING] Avro: Invalid default for field recordUpdateTime: null not a "string"
...

Fixed in #307


add hadoop-2.7 to available hadoop version

What is this PR for?
we can use hadoop 2.7 for spark-dependency, but building document doesn't contain that.
hadoop 2.7 should be contained to available hadoop version at document.
What type of PR is it?
[Documentation]
Todos
What is the Jira issue?
ZEPPELIN-1783

@hayashidac Thanks for your contribution.
CI failure looks irrelevant with this change. LGTM 👍

LGTM

Merge into master if there are no more comments :)


Text matchers implementation

We need to implement several main matchers, according to description in README.md file:
.equal-to-ignoring-case - test string equality ignoring case
.equal-to-ignoring-white-space - test string equality ignoring differences in runs of whitespace
.contains-string, .ends-with, .starts-with - test string matching

I can see two ways of implementing .equal-to-ignoring-case:

Make comparison by regex. E.g.: ^somestring$/i. But I need to add to EO regex object [s] > from-string to make it possible to concatenate ^,$,/i with the given string.
to do it in Java way. Like in String.equalsIgnoreCase(): compare all chars as bytes using LATIN1 and UTF16 encodings

@yegor256 How do you think, what is the best way to do it?

@Graur I think we should create eo-strings package for EO and move reg exps there and all string manipulations. Then, you will be to use it in this package.

@Graur sure, it's a good idea. we can implement all necessary "matchers" using Java, while we can't do this in EO. Later, when eo-strings is release, we'll delete Java code.


7DTD Server - Monitor/Shutdown with telnet on network ip address

Hello,
the 7dtd server is with telnet accessible over <IP_ADDRESS> but the linuxgsm is always looking with telnet on the network address (in my case <IP_ADDRESS>) because he reach nothing he do a gracefully shutdown.
It is possible to add that he access with telnet the address <IP_ADDRESS>
Monitoring is because of that also failing. :(
Greetings
Roger

As system is Ubuntu 15.10 Server used.

the script should already to this. it will attempt to use localhost first. Failing that try the network address.
https://github.com/dgibbs64/linuxgsm/blob/master/functions/fn_stop#L67

Test with telnet localhost
~/ telnet localhost 8081
Trying ::1...
Trying <IP_ADDRESS>...
Connected to localhost.
Escape character is '^]'.
*** Connected with 7DTD server.
*** Server version: Alpha 13.3 (b5) Compatibility Version: Alpha 13.3
*** Dedicated server only build

Server IP:   Any
Server port: 26900
Max players: 8
Game mode:   GameModeSurvivalMP
World:       Random Gen
Game name:   World1
Difficulty:  2

Press 'help' to get a list of all commands. Press 'exit' to end session.

2015-12-17T06:48:56 694,349 INF Started thread TelnetClientReceive_<IP_ADDRESS>:43388
2015-12-17T06:48:56 694,349 INF Started thread TelnetClientSend_<IP_ADDRESS>:43388
exit
Connection closed by foreign host.

So and now with sdtdserver stop
./sdtdserver stop
[ WARN ] Stopping sdtd-server: Attempting graceful shutdown via telnet: localhost failed
[ FAIL ] Stopping sdtd-server: Attempting graceful shutdown via telnet

 Telnet output:
 spawn telnet <IP_ADDRESS> 8081
 Trying <IP_ADDRESS>...
 telnet: Unable to connect to remote host: Connection refused
 Timeout or EOF

 [  OK  ] Stopping sdtd-server: 7DTD Server

It works now. I had to set the telnet password to "true" and now is everything fine.
It is possible to set a different password?

Did you figure it out ? Closing for now, feel free to give the answer anyway, or re-open if needed.
Have a good admin time !


Git submodules in docker

pipenv, version 11.10.0
I have a submodule ./dep1 in my git repo and am adding it to pipenv via pipenv install -e dep1, which works just fine and adds the line
"abc123" = {path = "./dep1", editable = true}

to my Pipfile. Then I use a Dockerfile as follows:
FROM kennethreitz/pipenv
COPY ./app /app
COPY ./dep1 /app/dep1
CMD python3 start.py

where I added the third line, so the submodule is available in the WORKDIR. However, upon docker build I am getting the following error
+ pipenv install --deploy --system
Installing -e ./dep1…

Error:  An error occurred while installing -e ./dep1!
./dep1 should either be a path to a local project or a VCS url beginning with svn+, git+, hg+, or bzr+

This is unexpected, since ./dep1 is a path to a local project, relative to the WORKDIR in the docker image with the Pipfile, which is /app. Am I missing something or is this a bug?

Hi @peter-ki!  Thanks for using pipenv!  I need to update the docker instance to use the most current version of pipenv.  Can you try rewriting your dockerfile to pull from python:3.6 or whichever version you are using and then pip install --upgrade pipenv?  I'm wondering if our latest release fixes this issue.  Additionally could you post your pipfile and Dockerfile?  Also would it be possible to launch an interactive docker session and run the commands requested by the issue template so I can see the output?  I know that's a lot, docker issues can be problematic to troubleshoot.

The dockerfile would be closer to ours in the repo:
FROM ubuntu:18.04

# -- Install Pipenv:
RUN apt update && apt install python3-pip git -y && pip3 install pipenv

ENV LC_ALL C.UTF-8
ENV LANG C.UTF-8

# -- Install Application into container:
RUN set -ex && mkdir /app

WORKDIR /app

# -- Adding Pipfiles
ONBUILD COPY Pipfile Pipfile
ONBUILD COPY Pipfile.lock Pipfile.lock

# -- Install dependencies:
ONBUILD RUN set -ex && pipenv install --deploy --system

@erinxocon thank you very much for the fast response!
Interesting. I tried to work with the Dockerfile you provided, which seems to take the process a step further. I get a different error, though:
+ pipenv install --deploy --system
Installing -e file:///app/data-cache...
Obtaining file:///app/data-cache
Installing collected packages: DataCache
  Running setup.py develop for DataCache
Successfully installed DataCache

Adding -e file:///app/data-cache to Pipfile's [packages]...
Your Pipfile.lock (34a2ab) is out of date. Expected: (6bd758).
Aborting deploy.

The Pipfile is
[[source]]
url = "https://pypi.python.org/simple"
verify_ssl = true
name = "pypi"

[packages]
kafka = "*"
pandas = "*"
numpy = "*"
"1bc1e69" = {path = "./data-cache", editable = true}

[dev-packages]

[requires]
python_version = "3.6"

and the Dockerfile now is
FROM ubuntu:18.04

# -- Install Pipenv:
RUN apt update && apt install python3-pip git -y && pip3 install pipenv

ENV LC_ALL C.UTF-8
ENV LANG C.UTF-8

# -- Install Application into container:
RUN set -ex && mkdir /app

COPY ./services /app
COPY ./data-cache /app/data-cache

WORKDIR /app

# -- Adding Pipfiles
COPY Pipfile Pipfile
COPY Pipfile.lock Pipfile.lock

# -- Install dependencies:
RUN set -ex && pipenv install --deploy --system

CMD python3 start.py

Hm...
I also could run in the container interactively. But what does commands requested by the issue template refer to?

@peter-ki Thanks for the info.  So when you create a bug report we ask you to run the command python -m pipenv.help and paste the output, it contains diagnostic info for use in troubleshooting the problem.  And since yours is with a local package it would be helpful to get a capture of that.  So if you could run python -m pipenv.help in the interactive session and paste the output that would be appreciated!

@peter-ki Also what vesion of pipenv are you using to generate the lockfile?  Can you try updating to our latest release using pip/pip3 install pipenv --upgrade and regenerating the lockfile and then building the docker container?

Ah sorry, got it. Here you go:
root@36f1e613ddbd:/app# python3 -m pipenv.help
$ python -m pipenv.help output
Pipenv version: '2018.6.25'
Pipenv location: '/usr/local/lib/python3.6/dist-packages/pipenv'
Python location: '/usr/bin/python3'
Other Python installations in PATH:

3.6: /usr/bin/python3.6m

3.6: /usr/bin/python3.6

3.6.5: /usr/bin/python3

PEP 508 Information:
{'implementation_name': 'cpython',
 'implementation_version': '3.6.5',
 'os_name': 'posix',
 'platform_machine': 'x86_64',
 'platform_python_implementation': 'CPython',
 'platform_release': '4.9.87-linuxkit-aufs',
 'platform_system': 'Linux',
 'platform_version': '#1 SMP Wed Mar 14 15:12:16 UTC 2018',
 'python_full_version': '3.6.5',
 'python_version': '3.6',
 'sys_platform': 'linux'}

System environment variables:

LC_ALL
LS_COLORS
LESSCLOSE
LANG
KAFKA_SERVER_ENDPOINTS
HOSTNAME
PWD
HOME
TERM
SHLVL
PATH
LESSOPEN
_
PYTHONDONTWRITEBYTECODE
PIP_PYTHON_PATH

Pipenv–specific environment variables:
Debug–specific environment variables:

PATH: /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
LANG: C.UTF-8
PWD: /app

Contents of Pipfile ('/app/Pipfile'):
[[source]]
url = "https://pypi.python.org/simple"
verify_ssl = true
name = "pypi"

[packages]
kafka = "*"
pandas = "*"
numpy = "*"
"1bc1e69" = {path = "./data-cache", editable = true}
datacache = {editable = true, file = "file:///app/data-cache"}

[dev-packages]

[requires]
python_version = "3.6"

Contents of Pipfile.lock ('/app/Pipfile.lock'):
{
    "_meta": {
        "hash": {
            "sha256": "599ae093fa031e777034f7217b53754baeca64542ef99125d2603a6b2834a2ab"
        },
        "pipfile-spec": 6,
        "requires": {
            "python_version": "3.6"
        },
        "sources": [
            {
                "name": "pypi",
                "url": "https://pypi.python.org/simple",
                "verify_ssl": true
            }
        ]
    },
    "default": {
        "1bc1e69": {
            "editable": true,
            "path": "./data-cache"
        },
        "kafka": {
            "hashes": [
                "sha256:35a49e9a432f6792aad48b2ab09d03867357aaa06eacba2678b7fd0808156e5c",
                "sha256:ffb3348cd918c31344b1a2eb61f692cbc423c83b1b06466a86de3db8a3f6a018"
            ],
            "index": "pypi",
            "version": "==1.3.5"
        },
        "numpy": {
            "hashes": [
                "sha256:07379fe0b450f6fd6e5934a9bc015025bb4ce1c8fbed3ca8bef29328b1bc9570",
                "sha256:085afac75bbc97a096744fcfc97a4b321c5a87220286811e85089ae04885acdd",
                "sha256:2d6481c6bdab1c75affc0fc71eb1bd4b3ecef620d06f2f60c3f00521d54be04f",
                "sha256:2df854df882d322d5c23087a4959e145b953dfff2abe1774fec4f639ac2f3160",
                "sha256:381ad13c30cd1d0b2f3da8a0c1a4aa697487e8bb0e9e0cbeb7439776bcb645f8",
                "sha256:385f1ce46e08676505b692bfde918c1e0b350963a15ef52d77691c2cf0f5dbf6",
                "sha256:4d278c2261be6423c5e63d8f0ceb1b0c6db3ff83f2906f4b860db6ae99ca1bb5",
                "sha256:51c5dcb51cf88b34b7d04c15f600b07c6ccbb73a089a38af2ab83c02862318da",
                "sha256:589336ba5199c8061239cf446ee2f2f1fcc0c68e8531ee1382b6fc0c66b2d388",
                "sha256:5edf1acc827ed139086af95ce4449b7b664f57a8c29eb755411a634be280d9f2",
                "sha256:6b82b81c6b3b70ed40bc6d0b71222ebfcd6b6c04a6e7945a936e514b9113d5a3",
                "sha256:6c57f973218b776195d0356e556ec932698f3a563e2f640cfca7020086383f50",
                "sha256:758d1091a501fd2d75034e55e7e98bfd1370dc089160845c242db1c760d944d9",
                "sha256:8622db292b766719810e0cb0f62ef6141e15fe32b04e4eb2959888319e59336b",
                "sha256:8b8dcfcd630f1981f0f1e3846fae883376762a0c1b472baa35b145b911683b7b",
                "sha256:97fa8f1dceffab782069b291e38c4c2227f255cdac5f1e3346666931df87373e",
                "sha256:9d69967673ab7b028c2df09cae05ba56bf4e39e3cb04ebe452b6035c3b49848e",
                "sha256:9e1f53afae865cc32459ad211493cf9e2a3651a7295b7a38654ef3d123808996",
                "sha256:a4a433b3a264dbc9aa9c7c241e87c0358a503ea6394f8737df1683c7c9a102ac",
                "sha256:baadc5f770917ada556afb7651a68176559f4dca5f4b2d0947cd15b9fb84fb51",
                "sha256:c725d11990a9243e6ceffe0ab25a07c46c1cc2c5dc55e305717b5afe856c9608",
                "sha256:d696a8c87315a83983fc59dd27efe034292b9e8ad667aeae51a68b4be14690d9",
                "sha256:e1864a4e9f93ddb2dc6b62ccc2ec1f8250ff4ac0d3d7a15c8985dd4e1fbd6418"
            ],
            "index": "pypi",
            "version": "==1.14.5"
        },
        "pandas": {
            "hashes": [
                "sha256:211cfdb9f72f26d2ede21c751d27e08fed4434d47fb9bb82ebc8ff753888b8b6",
                "sha256:28fd087514616549a0e3259cd68ac88d7eaed6bd3062017a7f312e27941266bd",
                "sha256:2fb7c63138bd5ead296b18b2cb6abd3a394f7581e5ae052b02b27df8244b03ca",
                "sha256:372435456c349a8d39ff001967b161f6bd29d4c3de145a4cf9b366648defbb1f",
                "sha256:3790a3348ab0f416e58061d21693cb662fbb2f638001b94bf2b2199fedc1b1c2",
                "sha256:437a6e906a6717a9ed2627cf6e7895b63dfaa0172567cbd75a553f55cf78cc17",
                "sha256:50b52af2af2e15f4aeb2fe196da073a8c131fa02e433e105d95ce40016df5690",
                "sha256:720daad75b5d35dd1b446842210c4f3fd447464c9c0884972f3f12b213a9edd1",
                "sha256:b4fb71acbc2709b8f5993cb4b5445d8182864f11c39787e317aae39f21206270",
                "sha256:b704fd73022342cce612996de495a16954311e0c0cf077c1b83d5cf0b9656a60",
                "sha256:cbbecca0c7af6a2160b2d6ba30becc286824a98c61dcc6a41fada664f226424c",
                "sha256:d2a071de755cc8ee7784e1b4c7b9b643d951d35c8adea7d64fe7c57cff9c47a7",
                "sha256:d8154c5c68713a82461aba735832f0b4692be8a45a0a340a303bf90d6f80f36f",
                "sha256:e1b86f7c55467ce1f6c12715f2fd1817f4a909b5c8c39bd4b5d2415ef2b04bd8",
                "sha256:fcc63e8134516e93e16eb4ceac9afaa51f4adc5bf58efddae7cbc562f5b77dd0"
            ],
            "index": "pypi",
            "version": "==0.23.1"
        },
        "python-dateutil": {
            "hashes": [
                "sha256:1adb80e7a782c12e52ef9a8182bebeb73f1d7e24e374397af06fb4956c8dc5c0",
                "sha256:e27001de32f627c22380a688bcc43ce83504a7bc5da472209b4c70f02829f0b8"
            ],
            "version": "==2.7.3"
        },
        "pytz": {
            "hashes": [
                "sha256:65ae0c8101309c45772196b21b74c46b2e5d11b6275c45d251b150d5da334555",
                "sha256:c06425302f2cf668f1bba7a0a03f3c1d34d4ebeef2c72003da308b3947c7f749"
            ],
            "version": "==2018.4"
        },
        "six": {
            "hashes": [
                "sha256:70e8a77beed4562e7f14fe23a786b54f6296e34344c23bc42f07b15018ff98e9",
                "sha256:832dc0e10feb1aa2c68dcc57dbb658f1c7e65b9b61af69048abc87a2db00a0eb"
            ],
            "version": "==1.11.0"
        }
    },
    "develop": {}
}

The pipenv is the latest. To be sure I did run
pip3 install pipenv --upgrade
pipenv clean
pipenv update

But the same issue remains.
Reviewing the diagnostic info I realize the Pipfiles differ. There is the extra line
datacache = {editable = true, file = "file:///app/data-cache"}

in the Pipfile in the docker, which is missing in the Pipfile on the host.

when the pipfile and lockfile are in sync let me know if you can rebuild the docker container!

also try removing the following line:
"1bc1e69" = {path = "./data-cache", editable = true}
From:
[[source]]
url = "https://pypi.python.org/simple"
verify_ssl = true
name = "pypi"

[packages]
kafka = "*"
pandas = "*"
numpy = "*"
"1bc1e69" = {path = "./data-cache", editable = true}
datacache = {editable = true, file = "file:///app/data-cache"}

[dev-packages]

[requires]
python_version = "3.6"

I don't think you need them both, the one I'm asking to be removed is an older syntax and we've since changed how we resolve local packages.

Well, the line
"1bc1e69" = {path = "./data-cache", editable = true}

got created on the host and the line
datacache = {editable = true, file = "file:///app/data-cache"}

got added upon
RUN set -ex && pipenv install --deploy --system

in the docker. So the Pipfiles are in sync before pipenv install is called in docker. To test, I omitted pipenv install line from the Dockerfile and the image got built. I attached to the container and ran
pipenv install --deploy --system --verbose

interactively, while looking at the Pipfile before and after.
Deleting the first line and keeping the second does not work, because on the host "file:///app/data-cache" does not resolve, so pipenv update fails with the following error:
Running $ pipenv lock then $ pipenv sync.
Locking [dev-packages] dependencies…
Locking [packages] dependencies…
ne_round
    for dep in self._iter_dependencies(best_match):
  File "/usr/local/Cellar/pipenv/11.10.0/libexec/lib/python3.6/site-packages/pipenv/patched/piptools/resolver.py", line 275, in _iter_dependencies
    for dependency in self.repository.get_dependencies(ireq):
  File "/usr/local/Cellar/pipenv/11.10.0/libexec/lib/python3.6/site-packages/pipenv/patched/piptools/repositories/pypi.py", line 215, in get_dependencies
    legacy_results = self.get_legacy_dependencies(ireq)
  File "/usr/local/Cellar/pipenv/11.10.0/libexec/lib/python3.6/site-packages/pipenv/patched/piptools/repositories/pypi.py", line 234, in get_legacy_dependencies
    dist = ireq.get_dist()
  File "/usr/local/Cellar/pipenv/11.10.0/libexec/lib/python3.6/site-packages/pipenv/vendor/pip9/req/req_install.py", line 1069, in get_dist
    egg_info = self.egg_info_path('').rstrip('/')
  File "/usr/local/Cellar/pipenv/11.10.0/libexec/lib/python3.6/site-packages/pipenv/vendor/pip9/req/req_install.py", line 483, in egg_info_path
    filenames = os.listdir(base)
FileNotFoundError: [Errno 2] No such file or directory: '/app/data-cache'

Sorry don't know what line of thought I was on.  I have thought of something else.
FROM ubuntu:18.04

# -- Install Pipenv:
RUN apt update && apt install python3-pip git -y && pip3 install pipenv

ENV LC_ALL C.UTF-8
ENV LANG C.UTF-8

# -- Install Application into container:
RUN set -ex && mkdir /app

COPY ./services /app
COPY ./data-cache /app/data-cache

WORKDIR /app

# -- Adding Pipfiles
COPY Pipfile Pipfile
COPY Pipfile.lock Pipfile.lock

# -- Install dependencies:
RUN set -ex && pipenv install && pipenv --deploy --system

CMD python3 start.py

Can you try that dockerfile with your original pipfile before i asked you to remove that line?  It should relock the pipfile after the install which will allow deploy to work.  I won't be able to create a small test for another hour or so, apologies for asking you to test so many things.

Cool, that works (after fixing the line which should read
RUN set -ex && pipenv install && pipenv install --deploy --system

, I guess) while

RUN set -ex && pipenv install --deploy --system
fails.

Anyway, thank you very much for resolving the issue!

I don't think my solution is the proper way, I'm working on another, but essentially, when the pipfile references the local package, the lockfile becomes different for each platform, your host machine and the docker instance since they are in difference places.  pipenv install creates a virtualenv, and relocks the pipfile and then pipenv install --deploy --system uses that new updated lockfile for the install.  So we are essentially creating a virtualenv when it's not needed...I'm looking into a better Dockerfile solution now.

(For the record it was much simpler than that, thankfully)


Updates for Momentum Telecom

Added new NNI locations for Momentum at Atlanta, Chicago2, Miami, Silicon Valley. Updated formatting on Warsaw to align to standards - replace commas with  Removed Momentum from Connectivity Providers section for locations with new NNIs (Atlanta, Dallas, Miami, Silicon Valley. Removed Slough location, which is London for ExpressRoute. Carrier HSO already in London location list.
Added Momentum to Exchange Providers list at NNI locations.

@duongau
Can you review the proposed changes?
When the changes are ready for publication, add a #sign-off comment to signal that the PR is ready for the review team to merge.
#label:"aq-pr-triaged"
@MicrosoftDocs/public-repo-pr-review-team

Hello @isanels, I apologize but we can't accept these changes. I checked with our PG resource and Momentum Telecom isn't associated with the Atlanta regions. Can you please let me know where you're getting this information from that I can share with PG? Thank you.

I had Momentum share the LOA with me. See attached. These are in-flight for L1 testing, wanted to get the list updated as that will be completed this week.
75106-MICROSOFT-180 PEACHTREE ST NW (EQUINIX ATL1)-LOA.pdf

@duongau,
Can you review this old PR and determine whether it needs to be closed or merged?

@Court72, I spoke with @ianels and the PG team regarding this PR. We're putting this on hold until the provider is officially partnered with MS. Once that is confirmed, I will merge this PR. Thanks!

@ianels Is this issue still on hold? Can you review this old PR and determine whether it needs to be closed or merged?
@duongau

@ianels @duongau - this PR has accumulated enough merge conflicts that they can't be addressed in the web interface. Since @duongau never approved this, it seems that best option is to close the PR and (if this issue is still relevant, reopen a new one that is up to date with the current documents and request approval based on that.)
Thanks
#please-close


Problem: Tendermint freezes due to docker-compose bug.

Solution: Do not rely on depends_on when running containers in the foreground. Solves #2322.

I steadily reproduce it on Mac and Ubuntu.
We could have been not noticing it due to either using make start or running local processes, or not stressing the system enough, or not paying attention to the bug.

I don't understand, how this is being solved here? depends_on is just used to express dependency.

depends_on is just used to express dependency.

Apparently, it also determines how docker collects container logs.

What about the order in which they are launched? Does mongodb tendermint bigchaindb imply that mongodb will be started first and then tendermint and then bigchaindb or all of them will be started simultaneously.

Hm, the docs do not say anything about it.. I added the --no-deps option to be sure all the containers are started individually, not through depends_on. Regarding the startup order, it works for me either way, no matter which service goes up first.

I am still a bit unsure about the depends_on explanation, can we run these services with -d flag instead and keep depends on as is?
I see that it resolved the issue so I think I can approve after my question.

@muawiakh when containers are run detached, we still use depends_on as in make start. The fix is only for make run which does not work properly with depends_on.

Makes sense, so run is basically to run the processes in foreground and start is with -d.


"NA" value from Excel read by Pandas as nan

When doing a:
df = pd.read_excel('cb2.xlsx') in the column 'Zone', in which there are strings like "APAC", "EUR", "NA"
Surprisingly, the value "NA" is interpreted by pandas as nan
cb2.xlsx

see the docs here and in the doc-string. NA is by default treated as missing.


NimBLE - Wifi gateway coexistence example

It would be fantastic to add a working example in this repo showing how to use NimBLE and Wifi in an application running both simultaneously.

There isn't much to show. The esp32 controller does all the magic where we can't see it. Is there anything specific that you would like to see?
I suppose I could do a demo using their functions in separate tasks. For the most part though you can just use WiFi and BLE however you see fit.

I would like to see a transfer of a message over to  NIMBLE CLIENT for a server and back. Also using using a coexistence call would pull it all together.
Thanks for the great library you have put so much effort into!
Thanks
Wes

My understanding is, WiFi share the same antenna, which means scheduled switching between the two.

I would like to see a transfer of a message over to NIMBLE CLIENT for a server and back. Also using using a coexistence call would pull it all together.

There aren't any "coexistence calls", you could have a simple webserver/client getting data and just send that data over BLE or from BLE back to the webserver or MQTT or telnet etc..
Here is a modified version of the scan continuous example that uses telnet (and uart) for the serial output and accepts commands to start/stop scanning. It uses this telnet library: https://github.com/yasheena/telnetspy
wifi-ble-coex.txt

Thanks so much for link and the reply.  Sorry maybe "call" was not correct  but rather a config for coexistance preference(WiFi vs BLE priority) I guess what I was thinking about coexistence was  FAQ
"Does ESP32 support coexistence between Bluetooth® and Wi-Fi?
Yes, but time-sharing control is required for ESP32’s coexistence between Wi-Fi and Bluetooth. Please go to menuconfig to enable the Wi-Fi/Bluetooth coexistence, shown as follows:
menuconfig -> Component config -> Wi-Fi -> Software controls WiFi/Bluetooth coexistence (Enable)"
and...
esp32 q/a

Hardware control:
If you disable CONFIG_SW_COEXIST_ENABLE, it will use hardware control. In this mode, Bluetooth has higher priority then WiFi. It will keep the bluetooth performance, but WiFi may be effected depend on bluetooth traffic. It means while WIFI is RX a packet, if bluetooth want to TX or RX a packet, it will stop WiFi. For example, BLE is scanning and WiFi is just in connection to hear beacon.

The coexistence config is all done in the arduino-esp32 core. There are no settings here that change it.

Thanks so much for feedback and taking time to provide the example!


Whitespace corrections, URL updates & typo fix

Description:
Based on the experience from my reviews of the Pull Requests #6003, #6008, and #6665, I found it necessary to suggest my corrections separately in an unrelated PR without any impact on the file contents.
Changes proposed:

Typo correction: Truslets -> Trustlets ("trus" -> "trust")
Update link text to match page title "Structured Exception Handling"
Replaced "that" with "which" as grammar improvement for pool paging
Remove redundant EOL (end-of-line) whitespace (blank space)
Normalize spacing between bullets/cardinals and the text to 1 space
Replace permanent redirect MSDN URLs with docs.microsoft.com URLs
Replace curly quotes (“ ”) with standard ASCII double quotes (" ")
Replace closing single quote ( ’ ) with standard apostrophe ( ' )
Add MarkDown indent marker compatibility spacing (MD codestyle)
Add missing colon character after "Applies to"

Additional notes:
Regarding the change from curly quotes (opening/closing double quote) and the closing single quote ("curly apostrophe") to standard ASCII quotes & apostrophe, the target HTML page handles viewing translation back to curly quotes based on the source content & context.
Ticket closure or reference:
Ref. #6003, #6008, #6665

@e0i - for your information: Please note that there are 2 additional commits to the first (main) commit (first commit described in the main PR comment). Please inform me if the commit message text from the second and third commits are needed in the main comment description.

#sign-off


Training Data

A bit doubtful on coding of training part. How to train the model using my own dataset ?

you can look into the README.md under each model directory. You may need to write preprocessing code for your dataset. Currently we are working on providing a unified training code for each model.


Add PHP CS Fixer

@okom3pom need test and review to merge quickly and benefit from PHP CS Fixer for future contributions.


Enable sorting candidates by first/last name

Is your feature request related to a problem? Please describe.
I'm always frustrated when I have to sort the candidates by first/last name in an election using drag and drop.
Describe the solution you'd like
I want a button to chose if i want to sort the candidates by first or last name.

Thanks for your suggestion.
While this sounds like a nice-to-have feature we currently have other priorities, so this will stay in our internal backlog for now. It may get picked up again at a later point.


Autoscaling for our hubs

Description
We should set up autoscaling for our hub infrastructure, so that when a hub's resource limits are reached, a new node is requested and the hub can grow to accommodate the extra demand.
Value / benefit
This is important in order to take advantage of the benefits of Kubernetes in general - without autoscaling we effectively are just running a single VM at a fixed cost. It is applicable to almost every hub because they all autoscale no matter how big or small.
Implementation details
This will be cloud provider-specific for each type of hub/cluster, so we should track each one separately.
Tasks to complete

[x] Google Cloud
[x] AWS
[ ] Azure

Updates
No response

This has generally been done.


permission to Add external users to your organization

This doc says :
"You must be a member of the Project Collection Administrators group for the organization that you want to invite external users to"
I tested it , and you just need to be "Project Administrator" to invite External users" from the Team project "overview" page
is it the doc that is wrong OR the application that has a bug ?

Détails du document
⚠ Ne pas modifier cette section. Elle est requise pour docs.microsoft.com ➟ problème de liaison GitHub.

ID: b6db4fba-7322-16bc-3431-6b8f933a84bf
Version Independent ID: a20bd1b0-06d7-8f49-30d2-25c5e188b674
Content: Add, invite external users, guest users to your organization - Azure DevOps Services
Content Source: docs/organizations/accounts/add-external-user.md
Product: devops
Technology: devops-accounts
GitHub Login: @chcomley
Microsoft Alias: chcomley

Hi @nikoNguyen, I'm confirming with the product team and will be in touch soon. Thanks for reaching out!

Hi @nikoNguyen, The doc has been updated and should be live sometime today, as Project Admins can also add external users. The difference between Project Admin and PCA is that Project Admins can't change user licenses. Because of you, I learned something new today! Thanks very much for reaching out!


Project config sent in project invite

We'll be temporarily sharing project config files as part of the project invites.

Closed in #88


Classmates, your module of the document written too bad!

Classmates, your module of the document written too bad! I would like to know, if my authority stored in the database how to integrate this component? How even a database of examples are not? This document is too rubbish ~ ~ ~ delay time ~ Can you write documents carefully?

Closing as invalid, as the text is incomprehensible.
If you were referring to DB Integration, this component has none: it only provides the abstraction to perform RBAC access checks.

@Dreamseekai Please refer to our code of conduct before posting anything further.
Calling the work others have performed and that you get to use for free "rubbish", "bad", etc. is disrespectful.
If you have suggestions for improvement, please create respectful issues indicating what changes you would like to see: improvements, fixes, additional examples, etc. Further, all documentation is itself part of the repository and written in markdown to facilitate contributions; see the doc/book tree for the existing documentation.

I think the rudeness comes from an automated translator, and wasn't
intentional (see cross-linked issues)
On 1 May 2017 22:40, "weierophinney"<EMAIL_ADDRESS>wrote:

@Dreamseekai https://github.com/Dreamseekai Please refer to our code of
conduct
https://github.com/zendframework/zend-permissions-rbac/blob/master/CONDUCT.md
before posting anything further.
Calling the work others have performed and that you get to use for free
"rubbish", "bad", etc. is disrespectful.
If you have suggestions for improvement, please create respectful
issues indicating what changes you would like to see: improvements, fixes,
additional examples, etc. Further, all documentation is itself part of the
repository and written in markdown to facilitate contributions; see the doc/book
tree
https://github.com/zendframework/zend-permissions-rbac/blob/master/doc/book/
for the existing documentation.
—
You are receiving this because you were assigned.
Reply to this email directly, view it on GitHub
https://github.com/zendframework/zend-permissions-rbac/issues/28#issuecomment-298426560,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAJakORY0icn7ABsEMd0h8FpybNG15aUks5r1kMwgaJpZM4NMMC1
.


Support ability to use a helm values files from a URL

Helm support the ability to use URL as path to values file, e.g.: helm template . -f https://example.com/values.yaml.
It doesn't work with gradle helm plugin as it assume values file is a local file.
It also breaks compatibility with some plugins, for example helm-secrets plugin as it uses "secrets://" prefix before path to values file to decrypt it:
helm upgrade name . -f secrets://secrets.yaml

@AndreiPustovalov - thank you for opening the issue. We welcome any ideas with how to address this or even a PR to kick things off.

There seems to be some support for values from files, albeit in context.of lint rather than rendering: https://unbroken-dome.github.io/projects/gradle-helm-plugin/latest/userguide/index.html#_passing_values_to_the_linter
Do files work with rendering?
Is a URL accepted?


Helidon MP 4.0.0 weird behaviour

Environment Details

Helidon Version: 4.0.0
Helidon MP
JDK version: openjdk version "21" 2023-09-19, OpenJDK Runtime Environment (build 21+35-2513), OpenJDK 64-Bit Server VM (build 21+35-2513, mixed mode, sharing)
OS: Windows 10 Enterprise, version 22H2, OS build 19045.3448

Problem Description
Server hangs, doesn't respond.
Steps to reproduce

Generate Helidon MP Quickstart application.
Modify method GreetResource::getMessage, add j.u.l.Logging and http headers injection:

    public Message getMessage(@Context jakarta.ws.rs.core.HttpHeaders headers, @PathParam("name") String name) {
        Logger.getLogger(GreetResource.class.getName()).info("greet");
        return createResponse(name);
    }

Exercise the application with a moderate load, e.g with Vegeta:
echo GET http://localhost:8080/greet/foo | vegeta attack -rate=50 -duration=10s | vegeta report

Reproduced!

Dockerized reproducer:
docker build -t helidon/7922-reprod https://gist.githubusercontent.com/danielkec/2998c2c3e3908325c2f1d9ea0d483cb2/raw/b0a58106f0c29d169802987aa7a8e6be04c1ac49/Dockerfile.sout-dl

docker run --rm --name helidon-7922-reprod helidon/7922-reprod:latest

docker stop helidon-7922-reprod

Issue is confirmed by java team, immediate workaround is using -Djdk.io.useMonitors=true flag


Review Design Template Changes

@sboeckelmann As per your request, I have verified all the examples featured on our documentation website to ensure their compliance with the GS1 implementation guidelines. I have made some adjustments to the Design Templates to align them with the guidelines examples which have been placed here in our test-data-generator repo.
Kindly request you review the changes again and approve the PR.


Recursive clone fails on v0.8.1

$ git clone --recursive -b v0.8.1 --depth=1 --single-branch https://github.com/caffe2/caffe2.git

...

Submodule path 'third_party/cnmem': checked out '28a182d49529da49f4ac4e3941cec3edf16b3540'
error: no such remote ref b1370adb972a8345de92e2d69e61daf7f9bce43e
Fetched in submodule path 'third_party/cub', but it did not contain b1370adb972a8345de92e2d69e61daf7f9bce43e. Direct fetching of that commit failed.

I'm guessing that they deleted some commits or something. Given that 0.8.1 is the most recent release it might make sense to update the submodule to use a hash that exists and is compatible.

Fails on 0.8.0 too though it's a different commit that's referenced: 89de7ab20167909bc2c4f8acd397671c47cf3c0d
Suggestion: using git subtree instead of submodule would eliminate these (and other) issues.

Duplicate of https://github.com/caffe2/caffe2/issues/1081, https://github.com/caffe2/caffe2/issues/1107, https://github.com/caffe2/caffe2/issues/1148.

This is because cub did a hard push at some point. Try deleting the cub submodule and redo git submodule update --init.
To delete the cub submodule, follow instructions here: https://stackoverflow.com/questions/1260748/how-do-i-remove-a-submodule

Besides the commit-hash, is there any way to know if v0.8.x was pointing to any specific tag of cub?
If we have this information, at least we could still manually checkout the right version of cub, right?
Or was caffe2 poiting to a non-tagged commit of cub?
Thanks!


xmake build minimal fail  stddef.h:11:2: error: expected identifier false   = 0,

I try build minimal  by xmake.
I git clone the last source code
THen I delete other target except minimal in xmake.lua and run
xmake f --require-bpftool=y
xmake

My system is Linux lin 5.19.0-45-generic #46~22.04.1-Ubuntu SMP PREEMPT_DYNAMIC Wed Jun 7 15:06:04 UTC 20 x86_64 x86_64 x86_64 GNU/Linux
The error message is
[ 88%]: cache compiling.release minimal.c
error: /usr/src/linux-headers-5.19.0-45-generic/include/linux/stddef.h:11:2: error: expected identifier
        false   = 0,
        ^
/usr/lib/llvm-14/lib/clang/14.0.0/include/stdbool.h:17:15: note: expanded from macro 'false'
#define false 0
              ^
In file included from minimal.c:6:
In file included from build/bpf/libbpf.h:18:
In file included from ../../libbpf/include/uapi/linux/bpf.h:11:
In file included from /usr/src/linux-headers-5.19.0-45-generic/include/linux/types.h:6:
In file included from /usr/src/linux-headers-5.19.0-45-generic/include/uapi/linux/types.h:14:
In file included from /usr/include/linux/posix_types.h:5:
/usr/src/linux-headers-5.19.0-45-generic/include/linux/stddef.h:12:2: error: expected identifier
        true    = 1
        ^
/usr/lib/llvm-14/lib/clang/14.0.0/include/stdbool.h:16:14: note: expanded from macro 'true'
#define true 1
  > in minimal.c

there were recent changes to xmake setup, can you please try again on the latest version of libbpf-bootstrap?


how to style the cross

I think we should be able to pass in our own cross component. The only property I can style from the cross is it's hover color.

Thanks for the suggestion. Will be added in the next release v5.0.4.


Fix social media icon sizes on top nav, closes #146

This addresses just the top nav. Will submit another to address the bottom nav which is a bit more involved. I'll address #168 in that PR.

@jlengstorf please review

@csantanapr Jason may not have the bandwidth to review at this time.

@krook Are you able to download, run locally and preview your changes?
Can you add a screenshot on how it looks on desktop and mobile with your Ganges?
You can use chrome tools to preview at different device resolution and user agent.
@jlengstorf what problems are you having when you download and try to run locally with Jekyll?
Maybe open a new issue with the details and error output

I reverted the logo resize change to keep this focused on the top nav change.
Here's how the responsiveness looks at three sizes. The icon bar is the same height as the nav bar at full resolution.

Looks good, @krook.

@mrutkows Can you please merge?


Why we can't see remediation in affect after executing the code

Hi,
Inspite of successful run of the policy, I am not getting the remediation task.

Hi @ashuranjan1008
What is the compliance state of this assignment? Remediations will only be created for non compliant resources

Hi @gettek,
Even though I am having non compliant recourses, but still task is not showing.

@ashuranjan1008 can you please try and create a remediation task outside of the module using the native resource and see what happens?

@gettek I can see remediation task getting created while running single policy but, when I try to do the same while taking initiative it doesn't work in the same way.


Remove Log4j API 3.x

This PR is based on #2410.
Since the Log4j API 3.x modules are no longer used, they are simply deleted.

My Github stats will never recover from the -50k lines hit.


The hosted runner encountered an error while running your job. (Error Type: Disconnect).

Description

I am using 'ubuntu-latest' as github runner for my pipeline.

My GitHub Actions pipeline defines a workflow for building and publishing an Android project to Firebase App Distribution.

My pipeline sometimes failing with error - "The hosted runner encountered an error while running your job. (Error Type: Disconnect)."

I am getting one more error as below and pipeline fails:-
"Received request to deprovision: The request was cancelled by the remote provider."

I am getting one more error as below and pipeline fails:-
"The runner has received a shutdown signal. This can happen when the runner service is stopped, or a manually started runner is canceled"

I am getting one more error as below and pipeline fails:-
"The hosted runner: GitHub Actions 339 lost communication with the server. Anything in your workflow that terminates the
runner process, starves it for CPU/Memory, or blocks its network access can cause this error."

I have already added the clean up steps as below and now I am not getting the error of limited disk space but I am getting above errors and pipeline is failing.
sudo rm -rf /usr/share/dotnet
sudo rm -rf /opt/ghc
sudo rm -rf "/usr/local/share/boost"
sudo rm -rf "$AGENT_TOOLSDIRECTORY"
What can I do for this issue ?
Platforms affected

[ ] Azure DevOps
[X] GitHub Actions - Standard Runners
[ ] GitHub Actions - Larger Runners

Runner images affected

[ ] Ubuntu 20.04
[ ] Ubuntu 22.04
[ ] Ubuntu 24.04
[ ] macOS 12
[ ] macOS 13
[ ] macOS 13 Arm64
[ ] macOS 14
[ ] macOS 14 Arm64
[ ] Windows Server 2019
[ ] Windows Server 2022

Image version and build link
Runner version: '2.317.0'
Is it regression?
It is occuring randomly.
Expected behavior
It should not give this warning and build should be completed successfully and build should not fail due to disk space issue.
Actual behavior

My pipeline sometimes failing with error - "The hosted runner encountered an error while running your job. (Error Type: Disconnect)."

I am sometimes getting one more error as below and pipeline fails:-
"Received request to deprovision: The request was cancelled by the remote provider."

I am sometimes getting one more error as below and pipeline fails:-
"The runner has received a shutdown signal. This can happen when the runner service is stopped, or a manually started runner is canceled"

I am sometimes getting  one more error as below and pipeline fails:-
"The hosted runner: GitHub Actions 339 lost communication with the server. Anything in your workflow that terminates the
runner process, starves it for CPU/Memory, or blocks its network access can cause this error."

Repro steps
Using github runner 'ubuntu-latest' for building android applications and pushing build to firebase app distribution.

Hi @sagarkalankar1 - As I can see, the errors you're encountering, such as "Disconnect," "Deprovision," and "Shutdown signal," indicate that the GitHub-hosted runners are facing issues that go beyond disk space. These errors are often related to resource constraints, runner decommissioning, or network issues.
Here's how you can address these problems:
A. Review Resource Usage
High Resource Consumption: Ensure that your build process isn't consuming excessive CPU, memory, or disk resources, which could lead to the runner being unresponsive or terminated.
Optimize Build Process: Consider optimizing your build process by breaking it down into smaller steps or jobs, reducing the complexity of each job, and minimizing resource-intensive operations.
B. Increase Timeout and Retry Logic
Increase Timeout: Add a timeout setting to your workflow steps to prevent premature job termination.
Retry Logic: Implement retry logic to re-run specific steps if they fail due to transient errors.
For you, I am providing an example as well which is as follows:-
jobs:
  build:
    runs-on: ubuntu-latest

    steps:
    - name: Checkout repository
      uses: actions/checkout@v2

    - name: Build Android project
      run: ./gradlew build
      timeout-minutes: 60  # Adjust the timeout as needed
      continue-on-error: true

    - name: Retry if build fails
      run: ./gradlew build
      if: failure() && steps.checkout.outcome == 'success'  # Retry only if the build fails

C. Split the Workflow into Multiple Jobs
Split Complex Workflows: Break your workflow into multiple smaller jobs that can run independently. This approach can help reduce the load on the runner and prevent it from being overwhelmed.
Example as follows:-
jobs:
  prepare:
    runs-on: ubuntu-latest
    steps:
    - name: Checkout repository
      uses: actions/checkout@v2

  build:
    runs-on: ubuntu-latest
    needs: prepare
    steps:
    - name: Build Android project
      run: ./gradlew build

  deploy:
    runs-on: ubuntu-latest
    needs: build
    steps:
    - name: Publish to Firebase App Distribution
      run: ./gradlew publish

D. Monitor and Troubleshoot Network Issues
Network Stability: Ensure that there are no network issues affecting the hosted runners. Since the errors mention losing communication with the server, monitoring network stability could be crucial.
Run Diagnostics: Add diagnostic steps to check network availability and connectivity during the workflow.
Example as follows:-
jobs:
  build:
    runs-on: ubuntu-latest

    steps:
    - name: Check network connectivity
      run: ping -c 4 google.com

    - name: Checkout repository
      uses: actions/checkout@v2

    - name: Build Android project
      run: ./gradlew build

By using above steps, it should help in mitigating the random failures and improve the stability of your pipeline.
I hope, this will resolve your issues.

@Prabhatkumar59
looking at C:
if you checkout in the prepare job, do you have access to the checked out repository in the following jobs?

Hi @MichaelPesce - When you split the workflow into multiple jobs, the files and artifacts created in one job are not automatically available in the subsequent jobs. To solve this, you can use GitHub Actions' artifact storage to pass the checked-out code or any other files from one job to another.
Here's an updated version of the workflow which I am providing below:-
jobs:
  prepare:
    runs-on: ubuntu-latest
    steps:
      - name: Checkout repository
        uses: actions/checkout@v2

      - name: Archive the repository
        run: tar -czf repo.tar.gz .

      - name: Upload repository as artifact
        uses: actions/upload-artifact@v3
        with:
          name: repo
          path: repo.tar.gz

  build:
    runs-on: ubuntu-latest
    needs: prepare
    steps:
      - name: Download repository artifact
        uses: actions/download-artifact@v3
        with:
          name: repo

      - name: Extract repository
        run: tar -xzf repo.tar.gz

      - name: Build Android project
        run: ./gradlew build

      - name: Archive build artifacts
        run: tar -czf build.tar.gz app/build/outputs

      - name: Upload build artifacts
        uses: actions/upload-artifact@v3
        with:
          name: build
          path: build.tar.gz

  deploy:
    runs-on: ubuntu-latest
    needs: build
    steps:
      - name: Download build artifacts
        uses: actions/download-artifact@v3
        with:
          name: build

      - name: Extract build artifacts
        run: tar -xzf build.tar.gz

      - name: Publish to Firebase App Distribution
        run: ./gradlew publish

Explanation:
Prepare Job:
Checks out the repository.
Archives the repository into a repo.tar.gz file.
Uploads this archive as an artifact.
Build Job:
Downloads the repo.tar.gz artifact from the prepare job.
Extracts the repository.
Builds the Android project.
Archives the build artifacts (like APKs) and uploads them as an artifact.
Deploy Job:
Downloads the build artifacts from the build job.
Extracts the build artifacts.
Publishes the project to Firebase App Distribution.
By this way, each job has access to the files it needs from the previous jobs.

Hi @sagarkalankar1, i hope your query must have been resolved. so, we are closing this issue thanks.


[FLINK-24302] Extend offheap memory for JDK11 test coverage

Purpose of the change
For example: Add dynamic sink topic support for Pulsar connector.
Brief change log

Change the internal design of ProducerRegister.
Expose topic metadata query in PulsarSinkContext.
Change the internal metadata cache in MetadataListener.

Verifying this change
This change is already covered by existing tests, such as (please describe tests).
Significant changes
(Please check any boxes [x] if the answer is "yes". You can first publish the PR and check them afterwards, for
convenience.)

[ ] Dependencies have been added or upgraded
[ ] Public API has been changed (Public API is any class annotated with @Public(Evolving))
[ ] Serializers have been changed
[ ] New feature has been introduced

If yes, how is this documented? (not applicable / docs / JavaDocs / not documented)

Too sad to see that the memory leak issue on Java 11 still exists on Pulsar 3.0.0 client.

Pending to merge...
@syhily do we have a ticket for supporting table connector already? Or I should open a new one? It should be my next step to track.

Cool, I'm so happy to see that we finally have the JDK 11 test support. The extensive off heap memory usage in Pulsar client could be the main cause of the OOM in JDK 11. Should we mention it in our document if the user want to use this connector in JDK 11 or above? @reswqa @tisonkun

Apply suggestions.
Pending to merge when CI reports green.

Merging...


roomba-password does not resolve hostnames

When trying to use roombapy, with hostnames (e.g. Roomba-BLID.domain or iRobot-BLID.domain) instead of IP address the commands have different results:

roomba-password returns Exception: cannot find roomba
roomba-discovery returns None
roomba-connect returns Exception: cannot find roomba

The same commands and same roomba device are working when using an IP address, tested on two different devices.
Name resolution works and can ping via hostname (I've tested everything on the same machine, which is a Win10 with Python 3.9).
I assume this is intended or a limitation in the code, would it be possible to:

Implement queries by hostname (preferred), or
Ensure with a regex to accept only IP formats

roombapy discover 192.168.88.NNN works, roombapy discover iRobot-NNNNNNN.lan doesn't.


Missing fields on specific site

Doesn't appear to work on http://dataprobe.com/support-iboot-g2-welcome/ in Firefox.

It is a browser restriction. The form on that page is loaded from a different domain in an iframe and is not accessible to the extension.


[BUG] Roblox not launching or can't play a game

Acknowledgement of preliminary instructions

[X] I have read the preliminary instructions, and I am certain that my problem has not already been addressed.
[ ] My answer given in the checkbox above is a lie.

What problem did you encounter?
Everytime I open or try to play a game on roblox it goes to the avatar decoration where you customize your avatar and I don't know what's going on with this issue.
My user is Crafty_MemeNade on roblox and the file video that I was going to send is too big

I don't know if i installed the new version of this

Disable Old Avatar Menu (I think) in the Mods tab of the Bloxstrap Menu.

Should be resolved now, sorry about that


Analyzer 5 fixes

Address feedback in https://github.com/Workiva/w_dio/pull/20, uncomment tests and get them passing

Security Insights
No security relevant content was detected by automated scans.
Action Items

Review PR for security impact; comment "security review required" if needed or unsure
Verify aviary.yaml coverage of security relevant code

Questions or Comments? Reach out on Slack: #support-infosec.

QA+1 CI passes


Have a public base class for custom plugins to use

I maintain a gradle plugin which sets the default configuration used by a large number of projects. In prior versions I had used the AbstractKoverReportTask to hook up some tasks that depended on the reports. Now that they are internal classes, I can no longer reference them. In addition, task names are generated by the variant type, so I would need to go through the same logic the plugin does to generate the correct task names. Is there any possibility of adding a class that could still be reference for usage by custom plugins?

Duplicates of https://github.com/Kotlin/kotlinx-kover/issues/338


Corrupting the stack at startup in OpenSSL's provider_conf_init

I'm porting Zed to Linux - https://github.com/zed-industries/zed/pull/7343
It's currently crashing on startup even before main is entered.
Call stacks are corrupted until I build with "safestack" sanitizer, in which case it produces the following stack:
openssl-crash2-stack.txt
Strace shows the configuration file read as the last thing:
openat(AT_FDCWD, "/nix/store/l0rxwrg41k3lsdiybf8q0rf3nk430zr8-openssl-3.0.12/etc/ssl/openssl.cnf", O_RDONLY) = 3
newfstatat(3, "", {st_mode=S_IFREG|0444, st_size=12324, ...}, AT_EMPTY_PATH) = 0
read(3, "#\n# OpenSSL example configuratio"..., 4096) = 4096
read(3, "d attributes must be the same, a"..., 4096) = 4096
read(3, "coding of an extension: beware e"..., 4096) = 4096
read(3, " = $insta::certout # insta.cert."..., 4096) = 36
read(3, "", 4096)                       = 0
close(3)                                = 0
futex(0x7f14c78795d8, FUTEX_WAKE_PRIVATE,<PHONE_NUMBER>) = 0
futex(0x7f14c787961c, FUTEX_WAKE_PRIVATE,<PHONE_NUMBER>) = 0
futex(0x7f14c7879d7c, FUTEX_WAKE_PRIVATE,<PHONE_NUMBER>) = 0
futex(0x7f14c7879d74, FUTEX_WAKE_PRIVATE,<PHONE_NUMBER>) = 0
futex(0x7f14c78795b8, FUTEX_WAKE_PRIVATE,<PHONE_NUMBER>) = 0
--- SIGSEGV {si_signo=SIGSEGV, si_code=SI_KERNEL, si_addr=NULL} ---

I believe the callstack is coming from curl, which is coming to Zed through this dependency:
isahc = { version = "1.7.2", default-features = false, features = ["static-curl", "text-decoding"] }

Note: was first submitted to https://github.com/sfackler/rust-openssl/issues/2160

Tried removing both features here - makes no difference, still crashes in the same place.

Based on feedback from "gabydd" in Zed Discord, this issue is likely caused by our erroneous build.rs instructions:
        println!("cargo:rustc-env=MACOSX_DEPLOYMENT_TARGET=10.15.7");

        println!("cargo:rerun-if-env-changed=ZED_BUNDLE");
        if std::env::var("ZED_BUNDLE").ok().as_deref() == Some("true") {
            // Find WebRTC.framework in the Frameworks folder when running as part of an application bundle.
            println!("cargo:rustc-link-arg=-Wl,-rpath,@executable_path/../Frameworks");
        } else {
            // Find WebRTC.framework as a sibling of the executable when running outside of an application bundle.
            println!("cargo:rustc-link-arg=-Wl,-rpath,@executable_path");
        }

        // Weakly link ReplayKit to ensure Zed can be used on macOS 10.15+.
        println!("cargo:rustc-link-arg=-Wl,-weak_framework,ReplayKit");

        // Seems to be required to enable Swift concurrency
        println!("cargo:rustc-link-arg=-Wl,-rpath,/usr/lib/swift");

        // Register exported Objective-C selectors, protocols, etc
        println!("cargo:rustc-link-arg=-Wl,-ObjC");

These aren't supposed to be on with Linux. Closing.


npm still showing 0.2.3 as latest release

https://www.npmjs.com/package/ng-lodash
(0.3.0 is tagged here in github.)
Thanks.

I'm assuming it was published on npm by rockabox, though not sure if that's the case.

@robations thanks no we haven't actually published this on npm this seems to have been published by someone else I am afraid

if this is something that people would like to see however, we could look at doing this

I'm increasingly using npm + browserify for packaging up all my ngs, so I'd definitely +1 that.
By the way, the "Thanks." above was intended for for work on and providing this project.

@robations your welcome I'll try and look at perhaps getting this on to npm some time soon.

Hi @nwhite89. Any update on getting that latest version to npm reqistry?

We will need to do a separate one as the current one isn't ran by us @piotrd as we don't currently support this like said previously if enough people want it we can look at doing it.

+1

@nwhite89 I think people would use it, even if they don't comment here. I'm not sure how much reliable www.modulecounts.com is, but you can get this chart from their site:

I realize the npm curve 'consists' of not only browser JS libraries, but primarily node modules, but still, more and more JS libraries use npm as a primary package manager.
In the end the decision is up to you, but, it would not make sense for some of the interested users to clone your repo just to add a package.json...

Well, there is already a package.json, I don't think that's the issue. Perhaps this page is relevant:
https://docs.npmjs.com/misc/disputes

Don't squat on package names. Publish code or move out of the way.

In other words, try to claim back ng-lodash from aqingsao. He/she looks like a friendly person.

Add this to your package.json under dependencies for now
    "ng-lodash": "git@github.com:rockabox/ng-lodash.git#0.5.0",

I have tried to get in contact with @aqingsao see if we can get this done properly thanks.

+1 would like to see this on npm.

@garyyau have you gotten a chance to use the entry i mentioned above ?

Hey @angelxmoreno ,
Yeah, I'm currently using what you recommended as the workaround for now. (:

Currently still waiting to hear back from @aqingsao / npm should hopefully be sorted soon

@nwhite89 thanks for the update

:+1:

+1

+1 please publish it !

Can we publish this package under a different name in npm? For example as nglodash. Seems @aqingsao has leave his account on github.

This is really necessary.

Has there been any movement on this? I'll +1 nglodash as a name, and would be happy to do the work to publish with your permission.


World of Warcraft does not load

I'm trying to use this with WoW but when I launch it the window is invisible. Only the WoW cursor is visible. I'm using release v1.2.3 with Reshade v5.8.0 (the version with add-ons enabled).
ReShade.log

The problem was DX12. I switch to DX11 in the settings and it worked.


Return Val_unit instead of void from api functions

An api function returning unit in ocaml needs to return Val_unit in C/C++, since the return value may end up being seen by the GC, and return void leads to an arbitrary value (whatever was left in the register) to be returned.
It's possible to trigger a segfault if void is returned.
This PR is based on #5, so only commits after that should be reviewed.
Closes #4

Hi @smuenzel,
You are right, the manual has been updated in that sense (https://v2.ocaml.org/manual/intfc.html#sec502).
Thank you for this PR.


doMock doesn't fake modules required from NodeJS Worker Thread

🐛 Bug Report

Module faked with jest.doMock would not be faked for code executed in NodeJS Worker Thread
To Reproduce
Steps to reproduce the behavior:
Main file index.js
const {Worker} = require('worker_threads')

// mocked module outside of Worker Thread. Mocked as expected
const foo = require('./foo')

module.exports = async () => {
  return new Promise(resolve => {
    const worker = new Worker('./worker.js')
    const outOfWorkerFoo = foo()
    worker.on('message', workerFoo =>
      resolve({outOfWorkerFoo, workerFoo})
    )
  })
}

Worker code worker.js
const {parentPort} = require('worker_threads')

// mocked module inside of Worker Thread. Failed to be mocked
const foo = require('./foo')

parentPort.postMessage(foo())

The faked module. It's faked version would be executed for non-worker code and its real version would be executed for worker code
module.exports = () => 'real foo'

The test file index.test.js
const foo = jest.fn()

jest.doMock('./foo', () => foo)

const main = require('./index')

test('test', async () => {
  foo.mockImplementation(() => 'mock foo')

  const mockResult = await main()

  expect(mockResult).toEqual({ // this check would failed
    outOfWorkerFoo: 'mock foo', // value would be as expected: 'mock foo'
    workerFoo: 'mock foo'   // value would NOT be as expected: 'real foo'
  })
})

Expected behavior
Faked scripts should be faked no matter whether they had been required inside of Worker Thread or not. And there should definitely never exist faked and real version of the same script at the same time
Link to repl or repo (highly encouraged)
https://github.com/Alexsey/jest-worker-threads-bug
envinfo

npx: installed 1 in 13.891s

  System:
    OS: Windows 10 10.0.18362
    CPU: (4) x64 Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz
  Binaries:
    Node: 13.7.0 - C:\Program Files\nodejs\node.EXE
    npm: 6.13.6 - C:\Program Files\nodejs\npm.CMD
  npmPackages:
    jest: ^24.9.0 => 24.9.0

Thank you

@SimenB I have the same problem with moduleNameWrapper - it does not apply to worker_threads. This issue needs to be reclassified, is not a bug report and it doesn't need repro - it is a feature request.
Isn't there some simple way to call jest from the worker thread to make it install its handlers? All that is needed is its require interceptor. This would be a very good temporary solution.

Still relevant

I came up with this workaround - i'm able to get away with it because i'm doing more of an integration test where i'm using a test helper and loading it with worker_threads to reproduce a race condition, but hey, it might help someone:
in my test helper thread worker, at the top:
const mockedModules = new Map(
  ['dependency-1', 'dependency-2'].map((id) => [require.resolve(id), id]),
);
const originalJsHandler = require.extensions['.js'];
const hijackedExtensionHandler = (mod, filename) => {
  const mockedModule = mockedModules.get(filename);
  if (mockedModule) {
    const mockId = `../__mocks__/${mockedModule}`;
    filename = require.resolve(mockId);
  }
  return originalJsHandler(mod, filename);
};
require.extensions['.js'] = hijackedExtensionHandler;

I don't think it has been resolved


[3.5] Fix NavigationObstacle nodes not registering to default navigation map

Fix NavigationObstacle nodes not registering to default navigation map.
Godot 3.5 has still the old navigation node and if this node was not available there was no fallback to the default navigation map.
Fixes #64185.

Thanks!

Cherry-picked for 3.5.1.


Shouldn't a Samsung S21 Ultra "supportParallelProcessing"❓

Question
I'm developing an app that needs to record video while sends frames to another devices through WebRTC (or something similar), so I was checking the supportsParallelProcessing attribute in the cameras of a few android phones.
Considering what the guide say:

On newer Android devices this value is always true.

I though it would work for both cameras on a Samsung S21 Ultra (2021 phone), but it only worked for the back camera.

Is this a normal thing?
What is considered a "newer" android phone?
Is there an easy was to check the INFO_SUPPORTED_HARDWARE_LEVEL of the cameras in a phone?

Here the results from trying in other phones:

Phone (year)
Front camera
Back camera

Samsung S21 Ultra (2021)
false
true

Huawei Mate 20 Pro (2018)
false
true

Motorola moto g7 power 64/4(2019)
true
true

Xiaomi Redmi 9 (2019)
true
true

Huawei P30 lite  (2020)
false
false

Samsung Galaxy A21 (2020)
false
false

Samsung A50 (2019)
false
false

As you can see, both Xiaomi Redmi 9 and Motorola moto g7, suppport parallel processing, which kinda surprised me since the Samsung S21 is much newer and high-end.
What I tried
No response
VisionCamera Version
2.13.5
Additional information

[ ] I am using Expo
[X] I have read the Troubleshooting Guide
[X] I agree to follow this project's Code of Conduct
[X] I searched for similar questions in the issues page as well as in the discussions page and found none.

Oh that's very interesting. It really sucks that Android doesn't allow parallel video processing for every phone, while every iPhone since the iPhone 5 (I think) has that.
Here's where I check the supported hardware level: https://github.com/mrousavy/react-native-vision-camera/blob/f289f91773f89b520710d4632aabe8c50a4f57b0/android/src/main/java/com/mrousavy/camera/CameraViewModule.kt#L188

Yes, also I would have thought the hardware level would have linked to the phone, instead of one for each camera device, but apparently that's not the case.
Also about Android, yeah, that's really frustrating. I think it could be because those cameras need some extra customization with the Camera2 API instead of CameraX, since those phone should be able to process and record at the same time, because it's done by Instagram with filter, but I don't know I'm  just guessing.
Anyway, could you tell me which Android phone was used to test the library? since I would like to have some ideas on which phone I could use for the app. Thanks for your help!

I used a Huawai P10 to build VisionCamera.

Had the same problem with Pixel 6 on Android 12. Removing the Preview of the image allowed to record video and analyze at the same time. For preview, video and analyzing at the same time the level "LEVEL_3 (or better) camera device." is needed, as stated in the documentation.
https://developer.android.com/training/camerax/architecture

@mrousavy Thanks!
@erayoezmue Unfortunately I need to do the 3 at the same time for the app I'm working at, but that's still nice to know. Thanks!

@Lucianofc138, well me too... Just tried it on a Redmi Note 9 - also didn't work on that one. Downloaded Camera2 API Checker at indeed my Pixel 6 and Redmi Note 9 are only Level "Full" not "LEVEL_3". So you can forget it for many of new android devices also...
Maybe we should look for workarounds for Android? Like grabbing the video screencast of the view? Doing whole screencast also won't work for most Android devices, as on newer versions the user would get asked every time you start the recording,...

@Lucianofc138: here a list of some Camera2API Reports https://www.airbeat.com/camera2/report_list

@erayoezmue ooohh yeah, some of those i put in the list above could be just "Full", since I just check the attibute supportsParallelProcessing for each device. However, I think is not just about being new or not, since the Motorola moto g7 power (2019) has "LEVEL_3" (I checked it with Camera2 Probe). I think it could be about how much customization each company put over the basic android, because Motorola runs the most basic Stock Android, which is the most basic version without any customization. I'm not sure tho, just an idea.
I think the same about searching a workaround. I was thinking about making a long running frame processor, that could receive the ImageProxies one by one, and make them into a video, but I'm not sure if that's possible yet... Also you would be obligated to process any other frame processor at the same frame-rate that you want to record.
Thanks for the list of reports!

Same Back camera issue on following devices,
OnePlus6T (A6013)
Samsung Galaxy A22 5G

Hey  this has been fixed in V3 as we no longer have that prop thanks to a full rewrite! 🥳


removed docker-node file and unused configs

Pre-Flight checklist

[x] Testing

[x] Code is tested
[x] Changes have been manually tested

What are the relevant tickets?
Closes #315
What's this PR do?
Removes unused node configuration
How should this be manually tested?
JS test should pass and everything should work normally.

Codecov Report

Merging #316 (7999dab) into main (a372c2e) will increase coverage by 5.38%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##             main     #316      +/-   ##
==========================================
+ Coverage   91.59%   96.97%   +5.38%
==========================================
  Files         220      127      -93
  Lines        6519     2975    -3544
  Branches      534        0     -534
==========================================
- Hits         5971     2885    -3086
+ Misses        463       90     -373
+ Partials       85        0      -85

Impacted Files
Coverage Δ

users/admin.py

authentication/utils.py

cms/factories.py

openedx/exceptions.py

cms/blocks.py

main/apps.py

main/serializers.py

main/views.py

authentication/views.py

openedx/apps.py

... and 83 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update a372c2e...7999dab. Read the comment docs.


Cannot download file

Where are the files located?
I'm using a generic url:
https://hostlocal.api/file/bot<token>/path/file_id.ext
and
https://hostlocal.api/file/bot<token>/<file_path>?file_id=<file_id>
But the return always:
{
"ok": false,
"error_code": 404,
"description": "Not Found"
}

The files are downloaded to bot's folder inside server's working directory. You need to set up your HTTPS server serve static files from subfolders of these folders. "/file/bot<token>/path/file_id.ext" should be translated to a path "<server's working directory>/<token>/path/file_id.ext".

That means we have to set up an http/https server to serve these folders/files?

Yes. You already have a HTTPS server to serve https://hostlocal.api. You need to set up it to serve files also.

can we run telegram-bot-api in https mode?

No. You must have an SSL-terminating web server,

I'm busy implementing this functionality to the @php-telegram-bot
@levlam So basically tdlib does not offer any way to access the files via its internal HTTP server?
i.e. We need to set up a separate webserver that proxies the files?

@noplanman Yes. Bot API server downloads files and saves them locally. In --local mode it returns full path to the file, otherwise it returns a relative path to the file, which can be then served using any HTTPS server.

@levlam Ok, thanks for the confirmation 👌

How we can set it up to serve static files? I am using docker in heroku.
`FROM alpine
RUN export BUILD_ONLY_PKGS="alpine-sdk cmake git gperf linux-headers openssl-dev zlib-dev"
&& apk add --no-cache $BUILD_ONLY_PKGS
&& git clone --recursive https://github.com/tdlib/telegram-bot-api.git /tmp/telegram-bot-api
&& mkdir /tmp/telegram-bot-api/build
&& cd /tmp/telegram-bot-api/build
&& cmake -DCMAKE_BUILD_TYPE=Release -DCMAKE_INSTALL_PREFIX:PATH=/usr/local ..
&& cmake --build . --target install
&& rm -rf /tmp/*
&& apk del $BUILD_ONLY_PKGS
RUN apk add --no-cache libstdc++ openssl zlib
CMD telegram-bot-api --local -p $PORT`

If you, like me, are not willing to create a server just to serve files, you can change the url to the default Telegram url (api.telegram.org), here it worked perfectly

@marcoslp010 You must not use api.telegram.org and a local server at the same time.

@marcoslp010 You must not use api.telegram.org and a local server at the same time.

use and only for downloading attachments

@marcoslp010 You must never use them both for any purpose. Even for downloading. Otherwise you will ran into too many issue with your bot.


Updating glog path

We need to use our fork of the glog as it contains code for deleting rotated log files.

good catch =)

good catch =)


Add "--test=test-unit" option for gem command

What was the end-user problem that led to this PR?
The problem was that the bundle gem --test option supported only "minitest" and "rspec", not "test-unit".
What was your diagnosis of the problem?
My diagnosis was that the lack of "test-unit" was very unfortunate.  It is only one test framework gem that is bundled to the ruby distribution.
What is your fix for the problem, implemented in this PR?
My fix is to add "--test=test-unit" option for bundle gem command.  I implemented it based on the implementation of "--test=minitest".  It creates "test/test_newgem.rb" (test-unit style) instead of "test/newgem_test.rb" (mnitest style).  It also tweaks Rakefile and gemspec files appropriately.
Why did you choose this fix out of the possible options?
I chose this fix because I couldn't come up with other options.

@mame Can you update with @kou 's feedbacks?

Is this request accepted?
Then I'll complete this pull request. ( https://github.com/bundler/bundler/pull/7420#discussion_r341933216 )

@hsbt As the comment, I thought I passed the ball to @kou.  This PR should be closed.  Closing.
@kou I think the feature has been already accepted.  Please go ahead!


Unable to include embedded content.

Issue Summary
Unable to include embedded content (such as bookmarks).
To Reproduce

In a post, attempt to include embedded content such as a bookmark.
Observer that an error is returned with the error message "There was an error when parsing the URL."
View the request and/or logs and the error message returned is something similar to the following in the error JSON: "message":"Validation error, cannot read oembed.","context":"No provider found for supplied URL. https://skillcrush.com/blog/remote-work-tools/","type":"ValidationError"

This has happened ever since I updated to version 3.11.0 of Ghost. This did not happen with previous versions (v3.6.0).
View the logs, I found the following stacktrace:
"stack": "ValidationError: No provider found for supplied URL.\n    at new ValidationError (/var/www/ghost/versions/3.11.0/node_modules/ghost-ignition/lib/errors/index.js:134:23)\n    at unknownProvider (/var/www/ghost/versions/3.11.0/core/server/api/canary/oembed.js:79:27)\n    at fetchBookmarkData.catch (/var/www/ghost/versions/3.11.0/core/server/api/canary/oembed.js:219:34)\n    at \n    at runMicrotasksCallback (internal/process/next_tick.js:122:5)\n    at _combinedTickCallback (internal/process/next_tick.js:132:7)\n    at process._tickDomainCallback (internal/process/next_tick.js:219:9)"
Technical details:

Ghost Version: 3.11.0
Node Version: 12.16.1
Browser/OS: Brave 1.4.96
Database: MySQL

I've tried to revert to an older version (change the sym link /var/www/ghost/current to an older version), and I still get the same error. I wonder if this might have to do with a change to Node.JS?

@SeanWrightSec unfortunately I'm not able to reproduce this.
I tested with the URL https://skillcrush.com/blog/remote-work-tools/ - embed worked for me but doesn't display very well due to the html that wordpress' oembed endpoint returns, bookmark worked fine though. Is that the exact url that you are using? Is it all urls or only some of them?

Yep, that's correct. It's in fact for any URL I try embed. It's even happening for YouTube videos. I tested it with ghost run and it works fine then. I don't know if there's any additional logging I can look at? I did try change the log level, but as far as I understand, ghost run is the way to debug?

I wonder if this might have to do with a change to Node.JS?

@SeanWrightSec sorry I missed this. It could well be, which version of node.js are you on? You can find out which version ghost is using if you run ghost doctor inside your ghost site's directory on your server.

The versions which I have are:

Ghost-CLI version: 1.13.1
Ghost Version: 3.11.0
Node Version: 12.16.1
Database: MySQL
OS: Ubuntu 18.04.4 LTS

I've tested it on 3 instances and both have the same issue. I'll in the meantime try to do a bit more digging.

Ok getting somewhere! If I run /usr/bin/node /usr/bin/ghost run it results in the error. But if I run ghost run, it works fine.

If you run /usr/bin/node --version what is the output?

Found the issue, so on Ubuntu apt installs node to /usr/bin but when you install the updated version (using npm to install) it installs it to /usr/local/bin. The versions are as follows:

/usr/bin/node - v8.17.0
/usr/local/bin/node - v12.16.1

I edited the .service file (in the directory /var/www/ghost/system/files) for my instance and changed the ExecStart command to have the /usr/local/bin/node instead. I reloaded the daemon (sudo systemctl daemon-reload) and restart ghost and it's now working.
Apologies for creating the unnecessary work trying to investigate this, but might find others who might run into the same issue so this might be helpful for them at least.

Thanks for the investigation @SeanWrightSec. The issue is certainly coming from node.js v8.x. In our server-side embed code we use new URL() without an explicit import, that fails in v8.x because it wasn't made a global until node.js v10.x.
I'm closing this issue because node.js 8.x is no longer supported. If anyone else finds this issue, please upgrade to the latest supported node version and double-check that your Ghost instance is using the version of node that you expect 🙂

I edited the .service file (in the directory /var/www/ghost/system/files) for my instance and changed the ExecStart command to have the /usr/local/bin/node instead. I reloaded the daemon (sudo systemctl daemon-reload) and restart ghost and it's now working.

@SeanWrightSec thank you so much! This solution solved my embed issues as well. The funny thing was that I had Node v14.x set globally, and v12.x used by Ghost. According to @kevinansfield, this should not have been an issue after v10.x.
Anyway, I am glad that it worked. Hopefully, this helps others too.


Implement SafeAreaView for Modals

Using an iPhone X, modals are currently presented in the Safe Area. This change makes the whole modal smaller to respect the Safe Area.

SafeAreaView is still buggy. Closing this for now.

Ok, nice to know, thanks anyway @kpink224

Just for reference: We are seeing issues with the SafeAreaView bottom padding. It doesn't work sometimes, other times it is double. I'll open another PR once this symptom disappears.


K8SPXC-417: update certmanager version

FIxup certmanager api version, since v1alpha3 require k8s v1.15, but our main target is v1.14

Test name
Status

haproxy
passed

big-data
passed

storage
passed

scaling
passed

recreate
passed

init-deploy
passed

self-healing
passed

scaling-proxysql
passed

upgrade
passed

restore-to-encrypted-cluster
passed

limits
passed

self-healing-advanced
passed

monitoring
passed

demand-backup
passed

upgrade-consistency
passed

security-context
passed

monitoring-2-0
passed

operator-self-healing
passed

affinity
passed

one-pod
passed

auto-tuning
passed

scheduled-backup
failed

proxysql-sidecar-res-limits
passed

users
passed

tls-issue-self
passed

tls-issue-cert-manager
passed

tls-issue-cert-manager-ref
passed

Why are you targeting kube 1.14? It's very old and completely unsupported upstream.


update documentation workflow to only publish one version per major

Goal
We want to have only one version of the docs per major release. That means that there will be a 2.x docs and a 3.x docs. The 2.x docs will come from the current 2.8 docs, as @m-vdb has already worked on getting the various other 2.x docs merged into this latest branch of the documentation
Updates to older branches

The 2.8.x branch is the source of truth for the version 2 docs -- any changes that go into that branch can have documentation changes. The workflow should build the documentation whenever there is a new patch release on 2.8.x (not for every push to the .x branch, @m-vdb could clarify this to make sure I understood correctly).
Older 2.x branches, like 2.7.x etc, should have the build documentation workflow disabled.
Whenever we're ready, we can build the existing docs from that 2.8.x branch -- we don't need to wait for 3.0 to come out to get this in play.

Updates for 3.0 docs

For 3.x docs, we are planning to have only one set of documentation, marking changes over time in the docs directly with callouts (e.g. "added in 3.1" in the docs pages themselves, as well as the regular changelog). That means that we only want to build the docs from releases on the latest minor.

I.e. when we are on 3.0.x, we build the docs off of the 3.0.x branch every time we release a new micro. Upon release of 3.1.0, the workflow should build the docs only from the 3.1.x branch, and shouldn't build docs on any micros added to 3.0.x (ideally people are not merging to this, but if they are, it is due to specific backported fixes that those using them are aware of -- docs for backported fixes create confusion as to which later versions of the code the fix is in, so we'll avoid that as much as possible)

the original scoping document I wrote is here. Under the "Release branches" section, you'll find different considerations, with the only viable solution highlighted in green

(not for every push to the .x branch, @m-vdb could clarify this to make sure I understood correctly)

this is correct

Whenever we're ready, we can build the existing docs from that 2.8.x branch -- we don't need to wait for 3.0 to come out to get this in play.

we'll also need to manually update the documentation branch with the latest changes from 2.8.x before we activate the workflow. I did that for all minors from 2.0 to 2.7 included, and deliberately waited for the workflow to be ready to do that for 2.8 (otherwise new micros released on 2.8 would have made it complicated to keep the source of truth intact).
To summarise the final state we're aiming at:

docs are built on every minor tag for the latest major (when 3.0 is out, the latest major is 3.0)
docs are built on every micro tag for the latest minor of

the latest major (when 3.0 is out, the latest major is 3.0)
the previous major (when 3.0 is out, the previous major is 2.0, the latest minor on this version being 2.8)

Cool, my plan is to take care of it next week


chore: spring-boot-http-gradle to 0.0.4

chore: Promote spring-boot-http-gradle to version 0.0.4

[APPROVALNOTIFIER] This PR is NOT APPROVED
This pull-request has been approved by:
To fully approve this pull request, please assign additional approvers.
We suggest the following additional approvers:
If they are not already assigned, you can assign the PR to them by writing /assign  in a comment when ready.
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment


Broken link in content/en/docs/reference/access-authn-authz/authentication.md

This is a Bug Report

Problem:
Broken link to UAA setup instructions http://apigee.com/about/blog/engineering/kubernetes-authentication-enterprise
according to wayback machine this was removed circa 2017
Proposed Solution:
remove link or change link to UAA github site https://github.com/cloudfoundry/uaa
Also propose updating Dex setup instructions to 2018 New Stack article by Joel Speed https://thenewstack.io/single-sign-kubernetes-command-line-experience/
Page to Update:
https://kubernetes.io/docs/reference/access-authn-authz/authentication

Thanks @rarean for reporting this issue!
/priority important-soon
/assign


QUESTION: Could not build wheels for llama-cpp-python, which is required to install pyproject.toml-based projects

Describe the bug
ERROR: Failed building wheel for llama-cpp-python
Failed to build llama-cpp-python
ERROR: Could not build wheels for llama-cpp-python, which is required to install pyproject.toml-based projects
To Reproduce
My os is Ubuntu20.04lts, and i use miniconda to create a totally new environment.
When running 'pip install 'xinference[all]', I got this error.

Do you have GPU cards on your machine?

Hello, this issue is typically caused by incompatible GCC versions. Could you please provide the full installation log?

@shanton23 Hi, were you able to solve this problem? Is there anything I can help?

Do you have GPU cards on your machine?

I hava a 4090.

@shanton23 Hi, were you able to solve this problem? Is there anything I can help?

Hello, this issue is typically caused by incompatible GCC versions. Could you please provide the full installation log?

My gcc version is 9.4.0 (Ubuntu 9.4.0-1ubuntu1~20.04.1).

I also have the same problem, how can I solve it? It appeared when I installed llama-spp-python.

After I upgraded gcc through the following command “sudo apt install gcc-11 g++-11”, this problem has not been improved. I hope to get your help. Thank you very much.

Perhaps, can you directly share a requirements.txt or environment.yaml used to create a conda environment?

You can follow this "https://zhuanlan.zhihu.com/p/592894910?utm_id=0"  up the gcc version to 11.2.1 20220127 (Red Hat 11.2.1-9) (GCC) (i am centos7)

升级到11了，还是不行

我也有同样的问题，gcc 13，python 3.11，cuda 12.1

我也有同样的问题，gcc 13，python 3.11，cuda 12.1

估计是在编译过程中有权限问题，我conda  base安装会报这个错误，但是conda新建一个xinference环境，然后在新建的环境安装就OK了

我也有同样的问题，gcc 13，python 3.11，cuda 12.1

0.2.82太新了，编译不了，手动装一下老一点的版本 pip install llama-cpp-python==0.2.80

我也有同样的问题，gcc 13，python 3.11，cuda 12.1

0.2.82太新了，编译不了，手动装一下老一点的版本 pip install llama-cpp-python==0.2.80

大哥chatglm-cpp多少版本的合适呢

我也有同样的问题，gcc 13，python 3.11，cuda 12.1

0.2.82太新了，编译不了，手动装一下老一点的版本 pip install llama-cpp-python==0.2.80

大哥chatglm-cpp多少版本的合适呢

我用 0.4.0没问题，你的chatglm-cpp应该不是版本问题，可以新建一个conda环境试一下

llama-cpp-python==0.2.80

为啥我用0.2.80还是不行呢

llama-cpp-python==0.2.80

为啥我用0.2.80还是不行呢

新建的conda环境吗？


Update documentation

Hi
What exactly is the difference between GeoFlutterFire2 to the other (original) libraries? Like:
https://github.com/DarshanGowda0/GeoFlutterFire
https://github.com/xmany/GeoFlutterFire
https://github.com/mrdishant/flutter_geofire
The readme file is the very same and there are no obvious differences. Why should one prefer your version over another?
Second:
Does this package also work for Firebase Realitime Database (I do NOT mean Firestore with realtime capabilities)? If not, which library works for firebase realtime database?
Regards

see prev issue
https://github.com/beerstorm-net/GeoFlutterFire2/issues/7#issuecomment-1000109807


Demo URL fails - https://demo.vuestorefront.io

Demo URL fails in my local with status code 500

curl 'https://demo.vuestorefront.io/api/catalog/vue_storefront_catalog/attribute/_search?_source_include=activity%2Cattribute_code%2Cattribute_id%2Cdefault_frontend_label%2Cdefault_value%2Centity_type_id%2Cfrontend_input%2Cfrontend_label%2Cid%2Cis_user_defined%2Cis_visible_on_front%2Cis_visible%2Cis_comparable%2Coptions%2Ctier_prices&from=0&request=%7B%22query%22%3A%7B%22bool%22%3A%7B%22filter%22%3A%7B%22terms%22%3A%7B%22attribute_code%22%3A%5B%22color%22%2C%22erin_recommends%22%2C%22price%22%2C%22size%22%2C%22activity%22%2C%22final_price%22%2C%22id%22%2C%22image%22%2C%22name%22%2C%22new%22%2C%22original_price%22%2C%22original_price_incl_tax%22%2C%22price_incl_tax%22%2C%22product_links%22%2C%22sale%22%2C%22sku%22%2C%22special_price%22%2C%22special_price_incl_tax%22%2C%22special_from_date%22%2C%22special_to_date%22%2C%22status%22%2C%22tax_class_id%22%2C%22tier_prices%22%2C%22type_id%22%2C%22url_path%22%2C%22url_key%22%5D%7D%7D%7D%7D%7D&size=150&sort=' \   -H 'authority: demo.vuestorefront.io' \   -H 'accept: application/json' \   -H 'user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36' \   -H 'content-type: application/json' \   -H 'origin: http://localhost:3001' \   -H 'sec-fetch-site: cross-site' \   -H 'sec-fetch-mode: cors' \   -H 'sec-fetch-dest: empty' \   -H 'referer: http://localhost:3001/error' \   -H 'accept-language: en-GB,en-US;q=0.9,en;q=0.8' \   --compressed

Hey, we've made changes with magento/ES instance. Index for demo has been changed to vue_storefront_magento_1 So it should be https://demo.storefrontcloud.io/api/catalog/vue_storefront_magento_1/attribute/_search, not https://demo.vuestorefront.io/api/catalog/vue_storefront_catalog/attribute/_search

I will change config in default.json with 1.11.4 release

It should work fine. I've added vue_storefront_catalog index to config in https://demo.storefrontcloud.io/api


Roadmap adding documentation

From @xavitator on July 8, 2018 20:51
We need to add to the roadmap file that we need to write a use documentation of Nut.
Moreover, i heard that could be a great idea to make the documentation before coding, what do you think about it ?
Copied from original issue: Heijix/Warehouse#9

From @elusyo on July 9, 2018 7:7
It depends. I think you need to write a documentation before. However, we give ourself the right to add, update and correct it when the project progresses.
Another point is that the documentation should follow a norm like common languages (OCaml, Java, Haskell) with generic css style :)

From @xavitator on July 9, 2018 20:1
hum, good idea, good idea, what do you think master @FauconFan ?

I don't that we have to start with the documentation... We should start by examples, and a good continuous integration. Because, the language will change again and again BUT we have to change our point of view. We have to go deep in the code, and we will see some issues, down there....
Writing a tutorial could be good too... We can manage that easily...
For a good documentation, we can use Sphinx. This is the official documentation tool of a lot of languages... Lien Sphinx

From @elusyo on July 9, 2018 20:32
I think we should start with a basic doc... Not something hard or complex : just the basics.
Continuous Integration is useful, but we define a new language (or an update as you wish). It doesn't seem a good idea to use it before starting writing some documentation. This can help us create tests for CI.

From @xavitator on July 9, 2018 20:58
Determine some exemple is a good idea because our vision of the project will be more precise and we will have practically the same.
Moreover, it is obvious that we can't write the entire documentation because we need to code to have an entire view of the project. Nevertheless, like said @elusyo, a basic documentation could lead us in the right path.

From @xavitator on July 10, 2018 13:47
Good for me ;)

Hello world,
I create some cool stuff about documentation in a sub folder in nut/.
cd IdeaBox/Nut/official_doc/
make deploy_local

Then go to your browser, and go to localhost:8080. Let the magic appears. Now we just have to rewrite what i've done in markdown format in sphinx rst, and it will be fine ^^.
Tell me what you think about this

From @elusyo on July 10, 2018 15:20
Good to :package:

can we close this ?


Support for non relational splunk store

For now, the data is stored in Postgres, what about adding Splunk as a data store.

Unfortunately, this would require a non-trivial refactoring of the code base.

Let me know if you are open to pull request.


My bluetooth logitech mouse(MX Anywhere2) is not working.

My bluetooth logitech mouse(MX Anywhere2) is not working.
Setting problems?

Seeing the same but with the MX Master (very similar) where as soon as I open KE the mouse stops responding until I quit the app 👎

Logitech's support voor Sierra is pretty bad at the moment. This does not seem to be a problem with Karabiner Elements, though it seemed so at first. It keeps crashing or making my mouse act weird wether Elements is running or not, though starting Elements definitely didn't help. In one instance the Elements window became "glued" to my mouse cursor. However, I also had a non-responding mouse without running Elements. It's all a bit unclear.
First I uninstalled the Unifying software, which keeps crashing (at least it did for me): http://support.logitech.com/en_us/article/26976?product=a0qi00000069ufTAAQ. That helped a lot and I could use my mouse without problems. The Logitech Options software keeps working and recognising my MX Master, which is connected through a unifying dongle. As far as I understand it, you only need that software if you want to bind a new unifying dongle to your mouse.
However I cannot use my mouse over bluetooth anymore. I do not know if this is because I uninstalled the LLC package or because Logitech isn't yet ready for Sierra. Fact is that the latest download only mentions support up to MacOS 10.11 (Sierra is 12).

Update, after replying I noticed quite a few Karabiner processes running which I didn't realise were running. After quitting those, my mouse started working again. It's all a bit weird though, seeing as it did work when using the unifying connector but not over bluetooth. So there's probably some weird interplay between Logitech and Karabiner / Karabiner-Elements.

I should note that my MX Master is connected via Bluetooth and I only have the Options software installed.

Similar here. Mouse stops working as soon as karabiner is started.
Quitting karabiner makes the mouse work again.
Connection via BT or unifying dongle makes no difference, I tried both.
Removing Logitech Unifying something and Logitech Options helped, although a reboot was required.
Reinstalling Logitech Options afterwards, and everything is working smoothly.

I bet these mice also identify as a keyboard, not just as a mouse.

I have the same issue with Microsoft Sculpt Comfort Mouse, which also claims it’s a keyboard (just so it can press the Windows key). Whenever I launch Karabiner-Elements, the mouse is disabled; closing Karabiner fixes it.
[2016-09-23 17:53:03.441] [grabber] [info] matching device: manufacturer:, product:Microsoft Sculpt Comfort Mouse, vendor_id:0x45e, product_id:0x7a2, location_id:0x5e01f3df, serial_number:c0-33-5e-01-f3-df registry_entry_id:4294968532 @ void device_grabber::device_matching_callback(IOHIDDeviceRef _Nonnull)

I have the same issue with a Logitech m535 bluetooth mouse: As soon as I launch Karabiner-Elements, the mouse is disabled, closing Karabiner-Elements makes the mouse work again.

Same issue here. Also, it appears that on the MX Master, the espose button seems to work, but it turns into the magnify command, which is sorta weird.

Having the same problems. Any solution?

Yeah, I ran into all sorts of problems when installing Karabiner Elements. My MX Master wouldn't work and I couldn't do basic keyboard shortcuts like Comm+Opt+Esc. I wasn't able to kill the processes until I uninstalled the apps and removed the Application Support files. It was only after all that that I could get normal functionality back. Looking forward to an update. I basically only use this tool for remapping the Caps Lock key, but it feels awful not having that!
~Paik

It looks like this has been fixed in version 0.90.41, with commit 2a769ddda075b50cd742ca9593cafd6f3fcbf18d. I also had this problem before (MX Master), and it works now :).

My mouse works good in version 0.90.41+ !!

I've changed the approach in v0.90.45.
Please confirm this issue also fixed in v0.90.45.

Related: #161

Updated to v0.90.45. Scroll wheel on Logitech m535 is no longer working. Was working in .90.44

The same here. Wheel doesn't work, but pointer works.
Logitech MX Anywhere2 via Bluetooth.

Updated to v0.90.46 and my mouse (bluetotooth, mx2) stopped working. In v0.90.45 it was kind of working… If I quit KE the mouse goes backs to normal.

With v0.0.47 bluetooth mouse is working again

Updated to v0.90.47 & Logitech m535 (bluetooth) is no longer working. Pointer doesn't move when Karabiner Elements is running. It works with version 0.90.44.

I can confirm v0.90.47 is not working with the Logitech MX Master (bluetooth or unifying) and MacOS Sierra. Pointer is frozen, but MacBook Pro Retina trackPad works.

Minutes after posting my previous comment, I got a notification that Logitech Option 6.30.48 was available, and now Elements v0.90.47 seems to be working.

Elements 0.90.55 , Logitech 6.30.48, Mouse M535 doesn't work

Thank you for feedbacks!
I added Devices tab in Karabiner-Elements Preferences which allows you to ignore specific devices and ignore the keyboard-and-mouse combined device in default.
Please upgrade to the latest version and check the Devices tab in Preferences.

With Karabiner-Elements 0.90.58 Logitech M535 Bluetooth mouse is working:
When it installed, it automatically ignored the bluetooth mouse. If I check the Bluetooth mouse button, it stops working. If I uncheck and ignore the mouse, all is good!

Same as @lacyjpr, 0.90.58 now works with MX Master. Thanks!

Could there be a way to make mouse+keyboard devices work? I want to remap my mouse’s Windows (left_command) key to something more useful. Enabling the mouse in Karabiner disables the mouse part.
[2016-10-31 10:47:51.208] [info] [grabber] version 0.90.61
[2016-10-31 10:47:52.186] [info] [grabber] matching device:
[2016-10-31 10:47:52.204] [info] [grabber]   manufacturer:
[2016-10-31 10:47:52.205] [info] [grabber]   product: Microsoft Sculpt Comfort Mouse
[2016-10-31 10:47:52.205] [info] [grabber]   vendor_id: 0x45e
[2016-10-31 10:47:52.205] [info] [grabber]   product_id: 0x7a2
[2016-10-31 10:47:52.205] [info] [grabber]   location_id: 0x5e01f3df
[2016-10-31 10:47:52.206] [info] [grabber]   serial_number: c0-33-5e-01-f3-df
[2016-10-31 10:47:52.210] [info] [grabber]   registry_entry_id:<PHONE_NUMBER>
[2016-10-31 10:47:52.222] [info] [grabber] IOServiceOpen is succeeded @ void virtual_hid_manager_client::matched_callback(io_iterator_t)

If you just want to reconfigure the mouse button, couldn't you use something like BetterTouchTool? https://www.boastr.net/

Can BetterTouchTool remap a left_command event from the mouse device (but not the keyboard!) to something like ⌘Space?