Building on Fedora 24

Current git version and release 0.6 have trouble building on Fedora 24, though release 0.5 seems to build without trouble (http://koji.fedoraproject.org/koji/taskinfo?taskID=15415187). Would be helpful to also get this into Fedora repositories. Let me know if have any suggestions for the error I get below when trying to make an rpm build version 0.6 is:
[ 40%] Building passes/cmds/qwp.o
passes/cmds/qwp.cc:287:21: error: use of undeclared identifier 'fabs'
double absval = fabs(M[i + row*N1]);
^
passes/cmds/qwp.cc:344:13: error: no member named 'isfinite' in namespace 'std';
did you mean 'isdigit'?
if (std::isfinite(v)) {
~^~~~
isdigit
/usr/bin/../lib/gcc/x86_64-redhat-linux/6.1.1/../../../../include/c++/6.1.1/cctype:67:11: note:
'isdigit' declared here
using ::isdigit;
^
passes/cmds/qwp.cc:526:14: error: no member named 'isfinite' in namespace 'std';
did you mean 'isdigit'?
if (std::isfinite(node.pos)) {
~^~~~
isdigit
/usr/bin/../lib/gcc/x86_64-redhat-linux/6.1.1/../../../../include/c++/6.1.1/cctype:67:11: note:
'isdigit' declared here
using ::isdigit;
^
passes/cmds/qwp.cc:533:14: error: no member named 'isfinite' in namespace 'std';
did you mean 'isdigit'?
if (std::isfinite(node.pos)) {
~^~~~
isdigit
/usr/bin/../lib/gcc/x86_64-redhat-linux/6.1.1/../../../../include/c++/6.1.1/cctype:67:11: note:
'isdigit' declared here
using ::isdigit;
^
passes/cmds/qwp.cc:673:7: error: use of undeclared identifier 'fabs'
if (fabs(max_value - min_value) < 0.001) {
^
passes/cmds/qwp.cc:730:27: error: use of undeclared identifier 'pow'
double distance = sqrt(pow(node1.pos - node2.pos...
^
passes/cmds/qwp.cc:730:59: error: use of undeclared identifier 'pow'
...double distance = sqrt(pow(node1.pos - node2.pos, 2) + pow(node1.alt_po...
^
7 errors generated.
Makefile:339: recipe for target 'passes/cmds/qwp.o' failed
make: *** [passes/cmds/qwp.o] Error 1
error: Bad exit status from /var/tmp/rpm-tmp.B2jIFX (%build)
RPM build errors:
Bad exit status from /var/tmp/rpm-tmp.B2jIFX (%build)

Installing Fedora 24 in a VM now. Some questions:

What packages do I need to dnf install to get to a similar setup to what you have?

Are you using a GCC or CLANG build? I.e. which build config (Makefile.conf, etc) are you using to build Yosys?

Example spec file is below. At the moment uses CLANG - will try GCC.  Can later add rpm packages in copr (https://copr.fedorainfracloud.org/)
Name: yosys
Version: 66582964bc11aadf3d0783a346706d801451a13f
Release: 1%{?dist}
Summary: Open Synthesis Suite
License: Yosys is free software licensed under the ISC license (a GPL compatible license that is similar in terms to the MIT license or the 2-clause BSD license).
URL: http://www.clifford.at/yosys/
Source0: https://github.com/cliffordwolf/yosys/archive/master.zip
ExclusiveArch: x86_64
BuildRequires: abc-devel
BuildRequires: abc
BuildRequires: abc-libs
BuildRequires: readline-devel
BuildRequires: bison
BuildRequires: bison-devel
BuildRequires: flex
BuildRequires: flex-devel
BuildRequires: libffi-devel
BuildRequires: mercurial
BuildRequires: git
BuildRequires: clang
BuildRequires: gcc
BuildRequires: python3
BuildRequires: tcl-devel
BuildRequires: graphviz-devel
BuildRequires: graphviz-tcl
BuildRequires: gawk
BuildRequires: python-xdot
BuildRequires: iverilog
Requires: abc
Requires: abc-libs
Requires: iverilog
%description
This is a framework for RTL synthesis tools. It currently has
extensive Verilog-2005 support and provides a basic set of
synthesis algorithms for various application domains.
Yosys can be adapted to perform any synthesis job by combining
the existing passes (algorithms) using synthesis scripts and
adding additional passes as needed by extending the yosys C++
code base.
Yosys is free software licensed under the ISC license (a GPL
compatible license that is similar in terms to the MIT license
or the 2-clause BSD license).
%prep
rm -rf yosys-master
unzip %{SOURCE0}
cd yosys-master
mkdir abc
mkdir abc/bin
mkdir abc/lib64
ln -s /usr/lib64/libabc.so  $PWD/abc/lib64/libabc.so
ln -s /usr/lib64/libabc.so.0 $PWD/abc/lib64/libabc.so.0
ln -s /usr/lib64/libabc.so.0.0.0 $PWD/abc/lib64/libabc.so.0.0.0
ln -s /usr/bin/abc $PWD/abc/bin
sed -i.bak 's_PREFIX ?= /usr/local_PREFIX ?= /usr/' Makefile
sed -i.bak 's_ABCREV = ae7d65e71adc_ABCREV = default' Makefile
sed -i.bak 's_ABCEXTERNAL =ABCEXTERNAL = /usr/bin/abc' Makefile
sed -i.bak 's_ABCPULL = 1_ABCPULL = 0_' Makefile
sed -i.bak 's/ENABLE_ABC := 1/ENABLE_ABC := 0/' Makefile
cd ..
%build
cd yosys-master
make
cd ..
%install
cd yosys-master
make install DESTDIR=%{buildroot}
cd ..
%check
%clean
rm -rf %{buildroot}
%files
/bin/yosys
/bin/yosys-config
/bin/yosys-filterlib
/share/yosys/adff2dff.v
/share/yosys/blackbox.v
/share/yosys/cells.lib
/share/yosys/include/backends/ilang/ilang_backend.h
/share/yosys/include/kernel/celltypes.h
/share/yosys/include/kernel/consteval.h
/share/yosys/include/kernel/hashlib.h
/share/yosys/include/kernel/log.h
/share/yosys/include/kernel/macc.h
/share/yosys/include/kernel/modtools.h
/share/yosys/include/kernel/register.h
/share/yosys/include/kernel/rtlil.h
/share/yosys/include/kernel/satgen.h
/share/yosys/include/kernel/sigtools.h
/share/yosys/include/kernel/utils.h
/share/yosys/include/kernel/yosys.h
/share/yosys/include/libs/ezsat/ezminisat.h
/share/yosys/include/libs/ezsat/ezsat.h
/share/yosys/include/libs/sha1/sha1.h
/share/yosys/include/passes/fsm/fsmdata.h
/share/yosys/pmux2mux.v
/share/yosys/simcells.v
/share/yosys/simlib.v
/share/yosys/techmap.v
/share/yosys/xilinx/arith_map.v
/share/yosys/xilinx/brams.txt
/share/yosys/xilinx/brams_map.v
/share/yosys/xilinx/cells_map.v
/share/yosys/xilinx/cells_sim.v
%changelog

Sun Aug 28 2016 Benson Muite<EMAIL_ADDRESS>

Initial version of package, make test fails at present, needs iverilog from git

I've installed Fedora 24 in a VM and I can build passes/cmds/qwp.o with GCC and CLANG without getting the error you quoted. Unfortunately I've created a too small virtual disk and I run out of disk space when trying to build all of Yosys. But I can do enough to tell you that I can't reproduce the issue.
Instructions to reproduce what I am seeing:
I've installed Fedora 24 using this iso image: http://mirror.karneval.cz/pub/linux/fedora/linux/releases/24/Workstation/x86_64/iso/Fedora-Workstation-Live-x86_64-24-1.2.iso
I have installed all of the build requirements in the spec file you have posted, with the exception of the abc* packages. In addition I installed gcc-c++ and @development-tools:
sudo dnf install @development-tools
sudo dnf install readline-devel bison bison-devel flex flex-devel \
                 libffi-devel mercurial git clang gcc gcc-c++ \
                 python3 tcl-devel graphviz-devel graphviz-tcl \
                 gawk python-xdot iverilog

Then I cloned current git head and built qwp.o:
git clone http://github.com/cliffordwolf/yosys
cd yosys

rm -f passes/cmds/qwp.o
make PRETTY=0 CONFIG=gcc passes/cmds/qwp.o

rm -f passes/cmds/qwp.o
make PRETTY=0 CONFIG=clang passes/cmds/qwp.o

Here is a screenshot:

I'd say there is something messed up with your installation, maybe with the libstdc++ headers your clang is using.
You can try making a fresh Fedora 24 install in a VM and see if it works there. If it does, see whats different in the VM and your host system.
I'm closing this issue for now. Feel free to post any new information and I'll reopen the issue if there's something new I should look into.

Sorry, was not clear. Error occurs with release 0.6 - updated build options as suggested, build is done in virtual machine with clean environment. With current version head, build seems ok, but installation step fails with:
Compiling /home/benson/rpmbuild/BUILDROOT/yosys-66582964bc11aadf3d0783a346706d801451a13f-1.fc24.x86_64/usr/share/yosys/python3/smtio.py ...
File "/usr/share/yosys/python3/smtio.py", line 97
print(stmt, file=self.debug_file)
^
SyntaxError: invalid syntax
error: Bad exit status from /var/tmp/rpm-tmp.UJ9Bpr (%install)
RPM build errors:
Bad exit status from /var/tmp/rpm-tmp.UJ9Bpr (%install)

Compiling /home/benson/rpmbuild/BUILDROOT/yosys-66582964bc11aadf3d0783a346706d801451a13f-1.fc24.x86_64/usr/share/yosys/python3/smtio.py ...
  File "/usr/share/yosys/python3/smtio.py", line 97
    print(stmt, file=self.debug_file)
                    ^
SyntaxError: invalid syntax

I can only assume this comes from some generic RPM builder code. (It's not from the yosys Makefile.) Looks like it's trying to compile my python3 scripts with python2.

Thanks, it built after making it use python 3. A repository for x86_64 is here:
https://copr.fedorainfracloud.org/coprs/fed500/Yosys/
Spec file below, still needs more cleanup. Would it be worth adding to repository, then copr can do automatic builds for Fedora and RHEL? Can fork and then make a pull request, but if have a specific place you would like to have the spec file let me know or make it beforehand.
Name: yosys
Version: 66582964bc11aadf3d0783a346706d801451a13f
Release: 1%{?dist}
Summary: Open Synthesis Suite
License: Yosys is free software licensed under the ISC license (a GPL compatible license that is similar in terms to the MIT license or the 2-clause BSD license).
URL: http://www.clifford.at/yosys/
Source0: https://github.com/cliffordwolf/yosys/archive/master.zip
ExclusiveArch: x86_64
%global __python %{__python3}
BuildRequires: gettext
BuildRequires: cvs
BuildRequires: diffstat
BuildRequires: doxygen
BuildRequires: patch
BuildRequires: patchutils
BuildRequires: rcs
BuildRequires: systemtap
BuildRequires: gcc-c++
BuildRequires: readline-devel
BuildRequires: bison
BuildRequires: bison-devel
BuildRequires: flex
BuildRequires: flex-devel
BuildRequires: libffi-devel
BuildRequires: gcc
BuildRequires: python3
BuildRequires: python3-devel
BuildRequires: tcl-devel
BuildRequires: graphviz-devel
BuildRequires: graphviz-tcl
BuildRequires: gawk
BuildRequires: iverilog
Requires: iverilog
Requires: python3
%description
This is a framework for RTL synthesis tools. It currently has
extensive Verilog-2005 support and provides a basic set of
synthesis algorithms for various application domains.
Yosys can be adapted to perform any synthesis job by combining
the existing passes (algorithms) using synthesis scripts and
adding additional passes as needed by extending the yosys C++
code base.
Yosys is free software licensed under the ISC license (a GPL
compatible license that is similar in terms to the MIT license
or the 2-clause BSD license).
%prep
rm -rf yosys-master
unzip %{SOURCE0}
cd yosys-master
make config-gcc
sed -i.bak 's_PREFIX ?= /usr/local_PREFIX ?= /usr/' Makefile
sed -i.bak 's_ABCREV = ae7d65e71adc_ABCREV = default' Makefile
sed -i.bak 's_ABCEXTERNAL =ABCEXTERNAL = /usr/bin/abc' Makefile
sed -i.bak 's_ABCPULL = 1_ABCPULL = 0_' Makefile
cd ..
%build
cd yosys-master
make CONFIG=gcc
cd ..
%check
%install
cd yosys-master
mkdir -p %{buildroot}/bin
install yosys %{buildroot}/bin
install yosys-config %{buildroot}/bin
install yosys-filterlib %{buildroot}/bin
install yosys-smtbmc %{buildroot}/bin
mkdir -p %{buildroot}/share/yosys
cp -r share/. %{buildroot}/share/yosys
cd ..
%clean
rm -rf %{buildroot}
%files
/bin/yosys
/bin/yosys-config
/bin/yosys-filterlib
/bin/yosys-smtbmc
/share/yosys/adff2dff.v
/share/yosys/cells.lib
/share/yosys/include/backends/ilang/ilang_backend.h
/share/yosys/include/kernel/celltypes.h
/share/yosys/include/kernel/consteval.h
/share/yosys/include/kernel/hashlib.h
/share/yosys/include/kernel/log.h
/share/yosys/include/kernel/macc.h
/share/yosys/include/kernel/modtools.h
/share/yosys/include/kernel/register.h
/share/yosys/include/kernel/rtlil.h
/share/yosys/include/kernel/satgen.h
/share/yosys/include/kernel/sigtools.h
/share/yosys/include/kernel/utils.h
/share/yosys/include/kernel/yosys.h
/share/yosys/include/libs/ezsat/ezminisat.h
/share/yosys/include/libs/ezsat/ezsat.h
/share/yosys/include/libs/sha1/sha1.h
/share/yosys/include/passes/fsm/fsmdata.h
/share/yosys/pmux2mux.v
/share/yosys/simcells.v
/share/yosys/simlib.v
/share/yosys/techmap.v
/share/yosys/xilinx/arith_map.v
/share/yosys/xilinx/brams.txt
/share/yosys/xilinx/brams_map.v
/share/yosys/xilinx/cells_map.v
/share/yosys/xilinx/cells_sim.v
/share/yosys/greenpak4/cells_map.v
/share/yosys/greenpak4/cells_sim.v
/share/yosys/greenpak4/gp_dff.lib
/share/yosys/ice40/arith_map.v
/share/yosys/ice40/brams.txt
/share/yosys/ice40/brams_init1.vh
/share/yosys/ice40/brams_init2.vh
/share/yosys/ice40/brams_init3.vh
/share/yosys/ice40/brams_map.v
/share/yosys/ice40/cells_map.v
/share/yosys/ice40/cells_sim.v
/share/yosys/ice40/latches_map.v
/share/yosys/include/frontends/ast/ast.h
/share/yosys/python3/pycache/smtio.cpython-35.opt-1.pyc
/share/yosys/python3/pycache/smtio.cpython-35.pyc
/share/yosys/python3/smtio.py
/share/yosys/xilinx/brams_bb.v
/share/yosys/xilinx/brams_init_16.vh
/share/yosys/xilinx/brams_init_18.vh
/share/yosys/xilinx/brams_init_32.vh
/share/yosys/xilinx/brams_init_36.vh
/share/yosys/xilinx/cells_xtra.v
/share/yosys/xilinx/drams.txt
/share/yosys/xilinx/drams_bb.v
/share/yosys/xilinx/drams_map.v
%changelog

Mon Aug 29 2016 Benson Muite<EMAIL_ADDRESS>

Initial version of package, make test fails at present with error needs iverilog from git


Get an info message for not filling Eth amount when submitting a profile

Is your feature request related to a problem?
Tried to submit a profile without filling the initial contribution field:
I got no warning that this field is required which implies wondering why submitting doesn't work.
Describe the solution you'd like.
Just display a warning message that this field is required (like it has been done for other fields).
Describe alternatives you've considered.

It's not a required field.
I fixed the issue that was not letting you submit.


Automatically like tweets

Is it possible to automatically like/favourite another user's tweets? If so, how do I do it?
Thanks!

Hello you can use Tweet.Favorite()


bug(al2): sandbox container image failed to pull

What happened:
One node in one of our clusters has an error related to the sandbox container and is unable to be pulled.
AMI: amazon-eks-node-1.30-v20241109
Warning  FailedCreatePodSandBox  3m31s (x210 over 48m)  kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to get sandbox image "602401143452.dkr.ecr.eu-central-1.amazonaws.com/e
ks/pause:3.5": failed to pull image "602401143452.dkr.ecr.eu-central-1.amazonaws.com/eks/pause:3.5": failed to pull and unpack image "602401143452.dkr.ecr.eu-central-1.amazonaws.com/eks/pause:3.5": failed to resolve reference "602401143452.dkr.ecr.eu-central-1.amazonaws.com/eks/pause:3.5": pull access denied, repository does not exist or may require authorization: authorization failed: no basic auth credentials
The disk usage was around 10%.
We have no access anymore to the node as it was deleted.
This is our config on the containerd side:
[plugins."io.containerd.grpc.v1.cri"]
sandbox_image = "602401143452.dkr.ecr.eu-central-1.amazonaws.com/eks/pause:3.5"

And this is our kubelet flag:
--pod-infra-container-image=602401143452.dkr.ecr.eu-central-1.amazonaws.com/eks/pause:3.5

Could be somehow a regression of this issue?
https://github.com/awslabs/amazon-eks-ami/issues/1597
What you expected to happen:
Kubelet shouldn't GC the image, or at least nodes should be able to pull it again if somehow was deleted.
How to reproduce it (as minimally and precisely as possible):
I have no idea how to reproduce it again, as it is the first time that we observed this happening in one of our clusters.
Environment:

AWS Region:
Instance Type(s):
Cluster Kubernetes version:
Node Kubernetes version:
AMI Version:

pull access denied, repository does not exist or may require authorization: authorization failed: no basic auth credentials

That means containerd is attempting to pull the sandbox image itself (without ECR credentials), which won’t work. Do you see ImageDelete events in the logs or was the sandbox image never present on this node?
There’s a systemd unit on AL2 that pulls the image (using ECR credentials) that may have failed, you can check:
journalctl-u sandbox-image

We face the same issue yesterday to fetch pause image:<PHONE_NUMBER>52.dkr.ecr.eu-central-1.amazonaws.com/eks/pause:3.5,
in pod events we got this error:
kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to get sandbox image "602401143452.dkr.ecr.eu-central-1.amazonaws.com/eks/pause:3.5": failed to pull image "602401143452.dkr.ecr.eu-central-1.amazonaws.com/eks/pause:3.5": failed to pull and unpack image "602401143452.dkr.ecr.eu-central-1.amazonaws.com/eks/pause:3.5": failed to resolve reference "602401143452.dkr.ecr.eu-central-1.amazonaws.com/eks/pause:3.5": pull access denied, repository does not exist or may require authorization: authorization failed: no basic auth credentials

We run on eks 1.29 controller and nodes. but it sound like something not related the ami itself happened.
Our workaround for now in the nodes that had this issue is to edit /etc/containerd/config.toml pause image to public.ecr.aws/eks-distro/kubernetes/pause:v1.29.0-eks-1-29-latest and then to restart containerd: sudo systemctl restart containerd
Do you know about global issue in eu-central-1?

pull access denied, repository does not exist or may require authorization: authorization failed: no basic auth credentials

That means containerd is attempting to pull the sandbox image itself (without ECR credentials), which won’t work. Do you see ImageDelete events in the logs or was the sandbox image never present on this node?
There’s a systemd unit on AL2 that pulls the image (using ECR credentials) that may have failed, you can check:
journalctl -u sandbox-image

That's a good point. Sadly, we have no more system logs for this specific node, but analyzing the usage of other metrics could fit, as we didn't comply with any GC condition.

@hany-mhajna-payu-gpo if you have the logs from this node, can you see if the sandbox image failed to pull? (with the journalctl command above)
I'm not ware of an incident in eu-central-1, but I can do some digging if you have a timeframe.

FWIW, we're in the process of removing this runtime dependency on ECR, we've done that on AL2023 so far, see #2000.

Going to close this, please add details or open an AWS Support case if this is still an issue.


operator/dns: Add managementState field to dns operator

managementState is a field used in several other operators for enabling/disabling the operator without removing it from the cluster. Adding it to the DNS operator will allow the CoreDNS daemonset to be modifiable when the operator is set to Unmanaged, making debugging DNS issues easier.
It is described in more detail in this enhancement proposal

If you don't plan to support setting an operator to unmanaged or removed across y-level upgrades (4.6 to 4.7 for instance), I suggest having your operator go Upgradeable=false when this is not managed.
/lgtm
/approve
/hold
holding because verify isn't green and we don't want infinite retesting. Get green and remove hold

/remove-lifecycle stale

/lgtm
/hold cancel


New build operator test when pushed to main

Description of the issue
We currently have EKS addon integration tests, but nothing to test new builds of the operator that runs on push to main. So we are creating a test for the operator when pushed to main.
Description of changes

Creating Cloudwatch Agent daemonset with checking if it is running or not.
Creating a pod with java annotation and checking if default environmental variables are injected or not.
Creating a resource of kind instrumentation and checking environment variables are injected in pod within same namespace if jave instumentation is enable.

License
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.
Tests
Integration Test: https://github.com/aws/amazon-cloudwatch-agent-operator/actions/runs/7042154562/job/19165862573
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Closed in favor of https://github.com/aws/amazon-cloudwatch-agent-operator/pull/50


fix: don't wrap content with BottomSheetView when enableDynamicSizing is true

Hey,
This PR is to get the discussion started on the following problem:
We're using react-navigation-bottom-sheet with enableDynamicSizing set to true but want to use BottomSheetScrollView (or other Gorhom components: BottomSheetFlatList, BottomSheetSectionList, etc)
within the screen to get proper sizing and all features that go with it (scroll down to dismiss, etc).
Currently with the latest version of react-navigation-bottom-sheet (0.3.2), this causes sizing issues and blank renders.
I tracked it down to having both BottomSheetView (in this lib) and BottomSheetScrollView (in our own screen) nested.
They somehow conflict.
As a workaround I've patched it to remove the BottomSheetView wrapping: https://github.com/valora-inc/wallet/blob/bbd0e39dcc1420a704fa866113994e9a20c3bfa4/patches/%40th3rdwave%2Breact-navigation-bottom-sheet%2B0.3.2.patch
This works pretty well for us, but we must ensure the screens use one of the Gorhom components.
I'm not sure about the "right" solution to avoid this patch. Here are possible options:

force the consumers of this lib to wrap their screens with the Gohrom component they need
iterate over the children to see if one of them is a Gohrom component

not sure it would work for all cases, especially if the screen nests another bottom sheet that doesn't need to be a screen

add a new property for devs to set when they don't want the default wrapping with BottomSheetView
other?

Looking forward to finding a solution that will work for all users of this lib.

same issue here, maybe we could add a sheetWrapper prop and where you pass in the Gohrom component?
<BottomSheet
  screenOptions={{
    sheetWrapper: BottomSheetView
  }}
/>

Also, would it make sense to add this?
enableDynamicSizing = true, // same default as lib

https://github.com/th3rdwave/react-navigation-bottom-sheet/blob/954bcf38fa4503f018585d6cca1d854cab07841f/src/BottomSheetView.tsx#L141


Type issue in XHRMultipart transport

class XHRMultipartTransport(XHRPollingTransport):
def init(self, handler):
super(JSONPolling, self).init(handler)
XHRMultipartTransport  in transports raising a type issue. JSONPolling in super(JSONPolling, self) is not an instance or sub type of type self.

Please provide stacktrace


Consider Flutter

This app looks perfect for Flutter! You should port it, it'd take you a fraction of the time it took you to write it natively 😅

(In case you don't want to build the pie chart on your own, check this out too!)
🍻

Way ahead of you, buddy: https://github.com/NicksPatties/timeclock2


Setup command-line tool and unit tests

Define the command-line tool skeleton (using Python and Click) and include unit testing (using pytest) and linting (using pylint and mypy). Also include packaging and minimal installation guide.

Not using click, but this is now done, I believe. If click is a requirement, can be re-opened...


fastlane run update_fastlane is failing starting from fastlane version 1.67.0

New Issue Checklist

[x] Updated fastlane to the latest version
[x] I have read the Contribution Guidelines

Issue Description
While updating from fastlane 1.66.0 it failed with same error as mentioned below.
I have reinstalled it from scratch (deleted ~/.rbenv) but still get the same problem when I run fastlane run update_fastlane
Complete output when running fastlane, including the stack trace and command used
> fastlane run update_fastlane

[15:12:26]: -----------------------------
[15:12:26]: --- Step: update_fastlane ---
[15:12:26]: -----------------------------
[15:12:26]: Looking for updates for cert, credentials_manager, deliver, fastlane, fastlane_core, frameit, gym, match, pem, pilot, produce, scan, screengrab, sigh, snapshot, spaceship, supply...
[15:12:27]: The update_fastlane action requires rubygems version 2.1.0 or greater.
[15:12:27]: Please update your version of ruby gems before proceeding.
[15:12:27]: $ gem install rubygems-update
[15:12:27]: $ update_rubygems
[15:12:27]: $ gem update --system

Configuration Files
Please copy the complete content of your Fastfile and any other configuration files you use below:
Fastfile:
nothing

Environment
fastlane version (fastlane -v): fastlane 1.67.0
Do you use bundler, rbenv or rvm? rbenv

@anton-matosov I was able to reproduce this locally. I'm going to loop in the team and see what we can do to help :+1: Thanks for reporting this!

Fixed in fastlane 1.68.0 :tada:

I have a very similar issue for version 1.70 of fastlane:
[14:22:35]: -----------------------------
[14:22:35]: --- Step: update_fastlane ---
[14:22:35]: -----------------------------
[14:22:35]: Looking for updates for cert, credentials_manager, deliver, fastlane, fastlane_core, frameit, gym, match, pem, pilot, produce, scan, screengrab, sigh, snapshot, spaceship, supply...
ERROR:  Loading command: update (Gem::LoadError)
can't activate addressable-2.4.0, already activated addressable-2.3.8
ERROR:  Loading command: cleanup (Gem::LoadError)
can't activate addressable-2.4.0, already activated addressable-2.3.8
[14:22:36]: The update_fastlane action requires rubygems version 2.1.0 or greater.
[14:22:36]: Please update your version of ruby gems before proceeding.
[14:22:36]: $ gem install rubygems-update
[14:22:36]: $ update_rubygems
[14:22:36]: $ gem update --system
I have tried all 3 options:
Mortens-Mac-mini:MyEvent mortenholmgaard$ gem install rubygems-update
Successfully installed rubygems-update-2.6.3
Parsing documentation for rubygems-update-2.6.3
Done installing documentation for rubygems-update after 0 seconds
1 gem installed
Mortens-Mac-mini:MyEvent mortenholmgaard$ update_rubygems
ERROR:  While executing gem ... (Errno::EACCES)
Permission denied - /Library/Ruby/Site/2.0.0/gauntlet_rubygems.rb
Mortens-Mac-mini:MyEvent mortenholmgaard$ gem update --system
Updating rubygems-update
Successfully installed rubygems-update-2.6.3
Parsing documentation for rubygems-update-2.6.3
Installing darkfish documentation for rubygems-update-2.6.3
Done installing documentation for rubygems-update after 5 seconds
Parsing documentation for rubygems-update-2.6.3
Done installing documentation for rubygems-update after 0 seconds
Installing RubyGems 2.6.3
ERROR:  While executing gem ... (Errno::EACCES)
Permission denied - /Library/Ruby/Site/2.0.0/gauntlet_rubygems.rb
Mortens-Mac-mini:MyEvent mortenholmgaard$
None of them makes it possible for me to update fastlane
But I have no idea if i am using bundler, rbenv or ram?
I have a .bash_profile file with this contents to make update_fastlane work:
export GEM_HOME=~/.gems
export PATH=$PATH:~/.gems/bin
It seems like I need some variant of one of the update ruby gems commands - but as you might have guessed I am not that familiar with Ruby and the gems setup.

Hi @mortenholmgaard! Great to hear from you. What happens if you add sudo to the beginning of your gem update commands?
Thanks!

Same results:

Mortens-Mac-mini:MyEvent mortenholmgaard$ sudo gem install rubygems-update
Password:
Fetching: rubygems-update-2.6.3.gem (100%)
ERROR:  While executing gem ... (Errno::EPERM)
Operation not permitted - /usr/bin/update_rubygems
Mortens-Mac-mini:MyEvent mortenholmgaard$ sudo update_rubygems
RubyGems 2.5.0 installed
Parsing documentation for rubygems-2.5.0
Installing ri documentation for rubygems-2.5.0

RubyGems installed the following executables:
/System/Library/Frameworks/Ruby.framework/Versions/2.0/usr/bin/gem
Ruby Interactive (ri) documentation was installed. ri is kind of like man
pages for ruby libraries. You may access it like this:
ri Classname
ri Classname.class_method
ri Classname#instance_method
If you do not wish to install this documentation in the future, use the
--no-document flag, or set it as the default in your ~/.gemrc file. See
'gem help env' for details.
Mortens-Mac-mini:MyEvent mortenholmgaard$ sudo gem update --system
Updating rubygems-update
ERROR:  While executing gem ... (Errno::EPERM)
Operation not permitted - /usr/bin/update_rubygems

Update command:

[22:09:05]: Looking for updates for cert, credentials_manager, deliver, fastlane, fastlane_core, frameit, gym, match, pem, pilot, produce, scan, screengrab, sigh, snapshot, spaceship, supply...
ERROR:  Loading command: update (Gem::LoadError)
can't activate addressable-2.4.0, already activated addressable-2.3.8
ERROR:  Loading command: cleanup (Gem::LoadError)
can't activate addressable-2.4.0, already activated addressable-2.3.8
[22:09:06]: The update_fastlane action requires rubygems version 2.1.0 or greater.
[22:09:06]: Please update your version of ruby gems before proceeding.
[22:09:06]: $ gem install rubygems-update
[22:09:06]: $ update_rubygems
[22:09:06]: $ gem update --system

Hi @mortenholmgaard! Thanks for following up. Can you ruby -v for me? Also, have you tried not using the system ruby? Thanks!

It results in:

ruby 2.0.0p648 (2015-12-16 revision 53162) [universal.x86_64-darwin15]

Regarding not using the system ruby, I havn't because I don't even know the difference (and if I am using system ruby). I have only done what it takes to get fastlane running, and my lanes is the only ruby I have written. My only priority with ruby is to get fastlane working.

Hi @mortenholmgaard Thanks for following up. Can you run sudo gem update --system ? Let me know the full output of that command. Thanks!

This is the output of sudo gem update --system:

Mortens-Mac-mini:MyEvent mortenholmgaard$ sudo gem update --system
Password:
Updating rubygems-update
Fetching: rubygems-update-2.6.4.gem (100%)
ERROR:  While executing gem ... (Errno::EPERM)
Operation not permitted - /usr/bin/update_rubygems
Mortens-Mac-mini:MyEvent mortenholmgaard$

Hi @mortenholmgaard Thanks for following up. This isn't a Fastlane issue at this point. Are you on El Capitan? The other reports I found on StackOver flow of similar issues with other gems suggests that this folder is no longer writable in El Capitan. You'll need to install Ruby via Homebrew or RVM.
Thanks!

Okay I got it working now - thanks!

@mortenholmgaard Awesome! Glad to hear that 👍 Hope you have a great day!


[Help wanted] @farmfe/js-plugin-dts how to map alias

Steps to reproduce
git clone https://github.com/niuiic/flow
pnpm i
cd packages/fx-flow
pnpm build

Twice build for esm and cjs. The last one will fail because of using unsupported plugin rollup-plugin-dts.
Check dist/esm/pipe/strict/consume.d.ts, path alias @ was not mapped to relative path.
What is expected?
import type { IterableReturnValue, UniversalIterable } from '@/types';
To
import type { IterableReturnValue, UniversalIterable } from '../../types';
What is actually happening?
No path alias was mapped in declare files.
System Info
System:
    OS: Linux 6.1 Gentoo Linux
    CPU: (16) x64 AMD Ryzen 7 5800H with Radeon Graphics
    Memory: 13.08 GB / 15.59 GB
    Container: Yes
    Shell: 5.9 - /bin/zsh
  Binaries:
    Node: 20.6.1 - /run/user/1000/fnm_multishells/72785_1698977614366/bin/node
    npm: 9.8.1 - /run/user/1000/fnm_multishells/72785_1698977614366/bin/npm
    pnpm: 8.10.2 - /run/user/1000/fnm_multishells/72785_1698977614366/bin/pnpm
  npmPackages:
    @farmfe/core: ^0.13.19 => 0.13.19

### Any additional comments?

_No response_

The dts plugin has not yet implemented the handling of alias. I will add this implementation on weekends

Thx

Thx

fixed in<EMAIL_ADDRESS>


add ZOOKEEPER_FORCE_SYNC env var to zookeeper

What changes were proposed in this pull request?
Add the possibility to control the value of this important ZK variable.
In the slow cloud storage, setting the value to false is a must.
Otherwise, the cluster is not stable ...
How was this patch tested?
(Please explain how this patch was tested. E.g. helm upgrade on minikube, helm install on gke)

@confluentinc It looks like @ljufa just signed our Contributor License Agreement. :+1:
Always at your service,
clabot


feat/invoicing

@coderabbitai: review

@coderabbitai: Review the overall architecture of the new invoicing component, written in Haskell. Consider all the different cases from the API calls. Please also conduct a security analysis of generating PDF from entries by users.

@coderabbitai: Review all the haskell files for functional correctness, syntax use, best coding practices


files.community links to website repo github not Files

Before you start...

[X] Have you refreshed the page? You might be using an old version of the site.
[X] Have you checked for an existing issue on this topic? If there is one, post a comment on it instead.

What browsers are you seeing the problem on?
Firefox
Description
I was looking for the github for files and clicked on the bottom of the page to check out the source code and issues, but landed in the wrong repository
Steps To Reproduce

go to https://files.community/
scroll down
click on github
make bug report
find out you're in the wrong github repo

Expected behavior
link should go to proper github repo
Relevant Assets
No response

That's intended behavior. The correct link is placed higher up, in the navbar.


Anything not in preview

What options do I have that aren't in preview?  This doesn't seem to work with the Microsoft.Identity.Client.
ConfidentialClientApplication cca = new ConfidentialClientApplication(ClientId, Authority, RedirectUri, new ClientCredential(ClientSecret), userTokenCache, null);
AuthenticationResult result = await cca.AcquireTokenByAuthorizationCodeAsync(code, Scopes);
Error Message is "Authority validation is not supported for this type of authority"

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: bac6db2d-bff9-cbcf-d522-966ed17ea27f
Version Independent ID: 91e3eeb7-8602-9e26-21c3-1fa70d03a354
Content: Set up sign-in Azure Active Directory accounts a built-in policy in Azure Active Directory B2C
Content Source: articles/active-directory-b2c/active-directory-b2c-setup-oidc-azure-active-directory.md
Service: active-directory
GitHub Login: @davidmu1
Microsoft Alias: davidmu

@grayjeremy Thanks for your feedback! We will investigate and update as appropriate.

@grayjeremy  It might seems a code issue to me as I see B2C working samples available using the ConfidentialClientApplication.  Please can you refer to this B2C Sample and validate your code if you are missing anything.

That's the same example I'm using.  I've used this sample lots of times with other identity providers.  Want me to invite you to the Azure DevOps project?

My bad this one is me, I don't know the issue, but its across all providers.  Lets close this.


simplify GetResolutionPaths

the resolutionPathsDictionary is only used for a key check. values are not used and there is only one key

Alright, let's see if CI is still passing.


Add new cog for extracting data from metabase

Metabase generates report from site and metricity data. Quite often we export these reports to csv, transform them and the pipe into an int e.
This cog aims to reduce the time taken for that, by giving admins the ability to export data from a report directly into a hastebin.
The auth flow is cached, as the login endpoint is ratelimitted. We want to ensure that we use a valid session token until it expires to reduce the number of calls to this endpoint."

make sure to re-delete the reddit constants before merging.


Bank object attributes don't match API JSON keys

I'm seeing several fields missing or keys not matching in name so several attribute values are null. All examples below performed in Sandbox mode.
An example JSON response when adding a bank account:
{
    : balance=>10000.0,
    : banks=>[
        {
            : account_class=>1,
            : account_number_string=>"***********4666",
            : account_type=>1,
            : address=>"",
            **: balance=>"",**
            : bank_name=>nil,
            : date=>"2015-05-20T17:22:57.095186",
            : email=>"",
            : id=>3186,
            : is_buyer_default=>true,
            : is_seller_default=>false,
            **: mfa_verifed=>false,**
            : name_on_account=>"Bobby Robson",
            : nickname=>"Example bank account",
            : phone_number=>"",
            : resource_uri=>nil,
            : routing_number_string=>"*******20"
        }
    ],
    : success=>true
}

And the object the library creates with missing attributes such as balance but also several null values for keys (is_active, is_verified) that don't match what's in the JSON above:
=> #<SynapsePay::Bank:0x3ffd6d3e94f0 id=3186> Attributes: {
  "account_class": 1,
  "account_number_string": "***********4666",
  "account_type": 1,
  "bank_name": null,
  "date": "2015-05-20T17:22:57.095186",
  "id": 3186,
  **"is_active": null,**
  "is_buyer_default": true,
  "is_seller_default": false,
  **"is_verified": null,**
  "name_on_account": "Bobby Robson",
  "nickname": "Example bank account",
  "resource_uri": null,
  "routing_number_string": "*******20"
}

An update to the bank resource (the attributes in it specifically) seems to be the culprit here.

This and all of the other issues you had should be resolved in the gem with a version of 0.0.3. Let me know if that doesn't work, but it should be good to go.


bug: "Failed to parse JSON from SSE message" error

Describe the bug
the error I get:
2024-01-25T14:13:51+0000 [ERROR] [api_server:2] Error generating completion: Exception caught during generation: Failed to parse JSON from SSE message: '{"prompt":"","finished":false,"outputs":[{"index":0,"text":"Thank","token_ids":[10449],"cumulative_logprob":0.0,"logprobs":null,"finish_reason":null}],"prompt_token_ids":[27,91,320,62,9688,91,29,10057,198,1639,389,257,7613,8796,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,7220,198,24446,502,257,9707,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,562,10167,198],"prompt_logprobs":null,"request_id":"chatcmpl-2da2f8fcc8ec46ad9ca46811092631d5"}{"prompt":"","finished":false,"outputs":[{"index":0,"text":"Thank you","token_ids":[10449,345],"cumulative_logprob":0.0,"logprobs":null,"finish_reason":null}],"prompt_token_ids":[27,91,320,62,9688,91,29,10057,198,1639,389,257,7613,8796,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,7220,198,24446,502,257,9707,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,562,10167,198],"prompt_logprobs":null,"request_id":"chatcmpl-2da2f8fcc8ec46ad9ca46811092631d5"}{"prompt":"","finished":false,"outputs":[{"index":0,"text":"Thank you for","token_ids":[10449,345,329],"cumulative_logprob":0.0,"logprobs":null,"finish_reason":null}],"prompt_token_ids":[27,91,320,62,9688,91,29,10057,198,1639,389,257,7613,8796,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,7220,198,24446,502,257,9707,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,562,10167,198],"prompt_logprobs":null,"request_id":"chatcmpl-2da2f8fcc8ec46ad9ca46811092631d5"}{"prompt":"","finished":false,"outputs":[{"index":0,"text":"Thank you for your","token_ids":[10449,345,329,534],"cumulative_logprob":0.0,"logprobs":null,"finish_reason":null}],"prompt_token_ids":[27,91,320,62,9688,91,29,10057,198,1639,389,257,7613,8796,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,7220,198,24446,502,257,9707,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,562,10167,198],"prompt_logprobs":null,"request_id":"chatcmpl-2da2f8fcc8ec46ad9ca46811092631d5"}{"prompt":"","finished":false,"outputs":[{"index":0,"text":"Thank you for your service","token_ids":[10449,345,329,534,2139],"cumulative_logprob":0.0,"logprobs":null,"finish_reason":null}],"prompt_token_ids":[27,91,320,62,9688,91,29,10057,198,1639,389,257,7613,8796,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,7220,198,24446,502,257,9707,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,562,10167,198],"prompt_logprobs":null,"request_id":"chatcmpl-2da2f8fcc8ec46ad9ca46811092631d5"}{"prompt":"","finished":false,"outputs":[{"index":0,"text":"Thank you for your service.<","token_ids":[10449,345,329,534,2139,29847],"cumulative_logprob":0.0,"logprobs":null,"finish_reason":null}],"prompt_token_ids":[27,91,320,62,9688,91,29,10057,198,1639,389,257,7613,8796,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,7220,198,24446,502,257,9707,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,562,10167,198],"prompt_logprobs":null,"request_id":"chatcmpl-2da2f8fcc8ec46ad9ca46811092631d5"}{"prompt":"","finished":false,"outputs":[{"index":0,"text":"Thank you for your service.<|","token_ids":[10449,345,329,534,2139,29847,91
To reproduce
Upgraded python to 3.9
machine with no GPU (don't seem to be related)
pip install bentoml scikit-learn pandas
pip install openllm
DTYPE=float32 TRUST_REMOTE_CODE=True openllm start microsoft/phi-1_5
check that you can call the model   using curl
curl -X 'POST'
'http://<IP_ADDRESS>:3000/v1/generate'
-H 'accept: application/json'
-H 'Content-Type: application/json'
-d '{"prompt": "What are Large Language Models?"}'
Works!
build a bento out of this model:
openllm build phi --model-id microsoft/phi-1_5 --backend pt --overwrite
run : (the generated file is from the bento the openllm command created)
TRUST_REMOTE_CODE=True DTYPE=float32 bentoml serve generated_phi_service.py
check it with the above curl  -works!!
containerize:
bentoml containerize microsoft--phi-1-5-service:latest -t phi:latest --opt progress=plain
run it:
docker run --rm -p 3000:3000 --env DTYPE=float32 --env TRUST_REMOTE_CODE=True phi:latest
try it with the same curl - get the above error
Logs
root@bentotest:~/bentoml/bentos/microsoft--phi-1-5-service/83b9c526374a136c8d808fd55bdb15ae351584fc/src# docker run --rm -p 3000:3000 --env DTYPE=float32 --env TRUST_REMOTE_CODE=True phi:latest

2024-01-25T14:11:57+0000 [INFO] [cli] Service loaded from Bento directory: bentoml.Service(tag="microsoft--phi-1-5-service:83b9c526374a136c8d808fd55bdb15ae351584fc", path="/home/bentoml/bento/")
2024-01-25T14:11:57+0000 [INFO] [cli] Prometheus metrics for HTTP BentoServer from "/home/bentoml/bento" can be accessed at http://localhost:3000/metrics.
2024-01-25T14:11:58+0000 [INFO] [cli] Starting production HTTP BentoServer from "/home/bentoml/bento" listening on http://<IP_ADDRESS>:3000 (Press CTRL+C to quit)
2024-01-25T14:12:05+0000 [INFO] [api_server:1] Service loaded from Bento directory: bentoml.Service(tag="microsoft--phi-1-5-service:83b9c526374a136c8d808fd55bdb15ae351584fc", path="/home/bentoml/bento/")
2024-01-25T14:12:05+0000 [INFO] [api_server:2] Service loaded from Bento directory: bentoml.Service(tag="microsoft--phi-1-5-service:83b9c526374a136c8d808fd55bdb15ae351584fc", path="/home/bentoml/bento/")
2024-01-25T14:12:05+0000 [INFO] [api_server:3] Service loaded from Bento directory: bentoml.Service(tag="microsoft--phi-1-5-service:83b9c526374a136c8d808fd55bdb15ae351584fc", path="/home/bentoml/bento/")
2024-01-25T14:12:05+0000 [INFO] [runner:llm-phi-runner:1] Service loaded from Bento directory: bentoml.Service(tag="microsoft--phi-1-5-service:83b9c526374a136c8d808fd55bdb15ae351584fc", path="/home/bentoml/bento/")
2024-01-25T14:12:05+0000 [INFO] [api_server:4] Service loaded from Bento directory: bentoml.Service(tag="microsoft--phi-1-5-service:83b9c526374a136c8d808fd55bdb15ae351584fc", path="/home/bentoml/bento/")
/usr/local/lib/python3.11/dist-packages/torch/_utils.py:831: UserWarning: TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly.  To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage()
  return self.fget.__get__(instance, owner)()

No chat template is defined for this tokenizer - using a default chat template that implements the ChatML format (without BOS/EOS tokens!). If the default is not appropriate for your model, please set `tokenizer.chat_template` to an appropriate template. See https://huggingface.co/docs/transformers/main/chat_templating for more information.

Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/openllm_core/_schemas.py", line 165, in from_runner
    structured = orjson.loads(data)
                 ^^^^^^^^^^^^^^^^^^
orjson.JSONDecodeError: unexpected content after document: line 1 column 458 (char 457)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/openllm/_llm.py", line 116, in generate_iterator
    generated = GenerationOutput.from_runner(out).with_options(prompt=prompt)
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/openllm_core/_schemas.py", line 167, in from_runner
    raise ValueError(f'Failed to parse JSON from SSE message: {data!r}') from e
ValueError: Failed to parse JSON from SSE message: '{"prompt":"","finished":false,"outputs":[{"index":0,"text":"Did","token_ids":[11633],"cumulative_logprob":0.0,"logprobs":null,"finish_reason":null}],"prompt_token_ids":[27,91,320,62,9688,91,29,10057,198,1639,389,257,7613,8796,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,7220,198,24446,502,257,9707,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,562,10167,198],"prompt_logprobs":null,"request_id":"chatcmpl-cbfb8f1b30a4499a93fa4f63da17c287"}{"prompt":"","finished":false,"outputs":[{"index":0,"text":"Did you","token_ids":[11633,345],"cumulative_logprob":0.0,"logprobs":null,"finish_reason":null}],"prompt_token_ids":[27,91,320,62,9688,91,29,10057,198,1639,389,257,7613,8796,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,7220,198,24446,502,257,9707,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,562,10167,198],"prompt_logprobs":null,"request_id":"chatcmpl-cbfb8f1b30a4499a93fa4f63da17c287"}{"prompt":"","finished":false,"outputs":[{"index":0,"text":"Did you hear","token_ids":[11633,345,3285],"cumulative_logprob":0.0,"logprobs":null,"finish_reason":null}],"prompt_token_ids":[27,91,320,62,9688,91,29,10057,198,1639,389,257,7613,8796,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,7220,198,24446,502,257,9707,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,562,10167,198],"prompt_logprobs":null,"request_id":"chatcmpl-cbfb8f1b30a4499a93fa4f63da17c287"}{"prompt":"","finished":false,"outputs":[{"index":0,"text":"Did you hear about","token_ids":[11633,345,3285,546],"cumulative_logprob":0.0,"logprobs":null,"finish_reason":null}],"prompt_token_ids":[27,91,320,62,9688,91,29,10057,198,1639,389,257,7613,8796,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,7220,198,24446,502,257,9707,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,562,10167,198],"prompt_logprobs":null,"request_id":"chatcmpl-cbfb8f1b30a4499a93fa4f63da17c287"}{"prompt":"","finished":false,"outputs":[{"index":0,"text":"Did you hear about the","token_ids":[11633,345,3285,546,262],"cumulative_logprob":0.0,"logprobs":null,"finish_reason":null}],"prompt_token_ids":[27,91,320,62,9688,91,29,10057,198,1639,389,257,7613,8796,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,7220,198,24446,502,257,9707,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,562,10167,198],"prompt_logprobs":null,"request_id":"chatcmpl-cbfb8f1b30a4499a93fa4f63da17c287"}{"prompt":"","finished":false,"outputs":[{"index":0,"text":"Did you hear about the little","token_ids":[11633,345,3285,546,262,1310],"cumulative_logprob":0.0,"logprobs":null,"finish_reason":null}],"prompt_token_ids":[27,91,320,62,9688,91,29,10057,198,1639,389,257,7613,8796,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,7220,198,24446,502,257,9707,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,562,10167,198],"prompt_logprobs":null,"request_id":"chatcmpl-cbfb8f1b30a4499a93fa4f63da17c287"}{"prompt":"","finished":false,"outputs":[{"index":0,"text":"Did you hear about the little girl","token_ids":[11633,345,3285,546,262,1310,2576],"cumulative_logprob":0.0,"logprobs":null,"finish_reason":null}],"prompt_token_ids":[27,91,320,62,9688,91,29,10057,198,1639,389,257,7613,8796,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,7220,198,24446,502,257,9707,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,562,10167,198],"prompt_logprobs":null,"request_id":"chatcmpl-cbfb8f1b30a4499a93fa4f63da17c287"}{"prompt":"","finished":false,"outputs":[{"index":0,"text":"Did you hear about the little girl who","token_ids":[11633,345,3285,546,262,1310,2576,508],"cumulative_logprob":0.0,"logprobs":null,"finish_reason":null}],"prompt_token_ids":[27,91,320,62,9688,91,29,10057,198,1639,389,257,7613,8796,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,7220,198,24446,502,257,9707,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,562,10167,198],"prompt_logprobs":null,"request_id":"chatcmpl-cbfb8f1b30a4499a93fa4f63da17c287"}{"prompt":"","finished":false,"outputs":[{"index":0,"text":"Did you hear about the little girl who cried","token_ids":[11633,345,3285,546,262,1310,2576,508,16896],"cumulative_logprob":0.0,"logprobs":null,"finish_reason":null}],"prompt_token_ids":[27,91,320,62,9688,91,29,10057,198,1639,389,257,7613,8796,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,7220,198,24446,502,257,9707,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,562,10167,198],"prompt_logprobs":null,"request_id":"chatcmpl-cbfb8f1b30a4499a93fa4f63da17c287"}{"pro
...
...
7,351,6041,286,40005,1326,11,18662,11,290,477,2676,341,13,17641,703,262,2456,287,262,886,286,262,3951,2128,2092,290,2128,588,366,18829,526,1867,1611,286,1245,857,262,3912,286,262,2456],"cumulative_logprob":0.0,"logprobs":null,"finish_reason":null}],"prompt_token_ids":[27,91,320,62,9688,91,29,10057,198,1639,389,257,7613,8796,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,7220,198,24446,502,257,9707,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,562,10167,198],"prompt_logprobs":null,"request_id":"chatcmpl-cbfb8f1b30a4499a93fa4f63da17c287"}'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/openllm/entrypoints/openai.py", line 224, in chat_completions
    async for res in result_generator:
  File "/usr/local/lib/python3.11/dist-packages/openllm/_llm.py", line 125, in generate_iterator
    raise RuntimeError(f'Exception caught during generation: {err}') from err
RuntimeError: Exception caught during generation: Failed to parse JSON from SSE message: '{"prompt":"","finished":false,"outputs":[{"index":0,"text":"Did","token_ids":[11633],"cumulative_logprob":0.0,"logprobs":null,"finish_reason":null}],"prompt_token_ids":[27,91,320,62,9688,91,29,10057,198,1639,389,257,7613,8796,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,7220,198,24446,502,257,9707,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,562,10167,198],"prompt_logprobs":null,"request_id":"chatcmpl-cbfb8f1b30a4499a93fa4f63da17c287"}{"prompt":"","finished":false,"outputs":[{"index":0,"text":"Did you","token_ids":[11633,345],"cumulative_logprob":0.0,"logprobs":null,"finish_reason":null}],"prompt_token_ids":[27,91,320,62,9688,91,29,10057,198,1639,389,257,7613,8796,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,7220,198,24446,502,257,9707,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,562,10167,198],"prompt_logprobs":null,"request_id":"chatcmpl-cbfb8f1b30a4499a93fa4f63da17c287"}{"prompt":"","finished":false,"outputs":[{"index":0,"text":"Did you hear","token_ids":[11633,345,3285],"cumulative_logprob":0.0,"logprobs":null,"finish_reason":null}],"prompt_token_ids":[27,91,320,62,9688,91,29,10057,198,1639,389,257,7613,8796,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,7220,198,24446,502,257,9707,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,562,10167,198],"prompt_logprobs":null,"request_id":"chatcmpl-cbfb8f1b30a4499a93fa4f63da17c287"}{"prompt":"","finished":false,"outputs":[{"index":0,"text":"Did you hear about","token_ids":[11633,345,3285,546],"cumulative_logprob":0.0,"logprobs":null,"finish_reason":null}],"prompt_token_ids":[27,91,320,62,9688,91,29,10057,198,1639,389,257,7613,8796,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,7220,198,24446,502,257,9707,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,562,10167,198],"prompt_logprobs":null,"request_id":"chatcmpl-cbfb8f1b30a4499a93fa4f63da17c287"}{"prompt":"","finished":false,"outputs":[{"index":0,"text":"Did you hear about the","token_ids":[11633,345,3285,546,262],"cumulative_logprob":0.0,"logprobs":null,"finish_reason":null}],"prompt_token_ids":[27,91,320,62,9688,91,29,10057,198,1639,389,257,7613,8796,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,7220,198,24446,502,257,9707,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,562,10167,198],"prompt_logprobs":null,"request_id":"chatcmpl-cbfb8f1b30a4499a93fa4f63da17c287"}{"prompt":"","finished":false,"outputs":[{"index":0,"text":"Did you hear about the little","token_ids":[11633,345,3285,546,262,1310],"cumulative_logprob":0.0,"logprobs":null,"finish_reason":null}],"prompt_token_ids":

...
...
null,"finish_reason":null}],"prompt_token_ids":[27,91,320,62,9688,91,29,10057,198,1639,389,257,7613,8796,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,7220,198,24446,502,257,9707,29847,91,320,62,437,91,29,198,27,91,320,62,9688,91,29,562,10167,198],"prompt_logprobs":null,"request_id":"chatcmpl-2da2f8fcc8ec46ad9ca46811092631d5"}'
2024-01-25T14:13:51+0000 [INFO] [api_server:2] <IP_ADDRESS>:52914 (scheme=http,method=POST,path=/v1/chat/completions,type=application/json,length=156) (status=500,type=application/json,length=68919) 55313.560ms (trace=972f6f489a69a7e82d051ab696c48fc6,span=4bf544ca19d78341,sampled=1,service.name=llm-phi-service)

Environment
root@bentotest:~/bentoml/bentos/microsoft--phi-1-5-service/83b9c526374a136c8d808fd55bdb15ae351584fc/src# bentoml env
Environment variable
BENTOML_DEBUG=''
BENTOML_QUIET=''
BENTOML_BUNDLE_LOCAL_BUILD=''
BENTOML_DO_NOT_TRACK=''
BENTOML_CONFIG=''
BENTOML_CONFIG_OPTIONS=''
BENTOML_PORT=''
BENTOML_HOST=''
BENTOML_API_WORKERS=''

System information
bentoml: 1.1.11
python: 3.8.10
platform: Linux-5.15.0-1048-gcp-x86_64-with-glibc2.29
uid_gid: 0:0
pip_packages

accelerate==0.26.1
aiohttp==3.9.1
aioprometheus==23.12.0
aiosignal==1.3.1
anyio==4.2.0
appdirs==1.4.4
asgiref==3.7.2
async-timeout==4.0.3
attrs==23.2.0
Automat==0.8.0
bentoml==1.1.11
bitsandbytes==0.41.3.post2
blinker==1.4
build==0.10.0
cattrs==23.1.2
certifi==2019.11.28
chardet==3.0.4
circus==0.18.0
click==8.1.7
click-option-group==0.5.6
cloud-init==23.3.3
cloudpickle==3.0.0
colorama==0.4.3
coloredlogs==15.0.1
command-not-found==0.3
configobj==5.0.6
constantly==15.1.0
contextlib2==21.6.0
cryptography==2.8
cuda-python==12.3.0
datasets==2.16.1
dbus-python==1.2.16
deepmerge==1.1.1
Deprecated==1.2.14
dill==0.3.7
distlib==0.3.8
distro==1.9.0
distro-info==0.23+ubuntu1.1
einops==0.7.0
entrypoints==0.3
exceptiongroup==1.2.0
fastapi==0.109.0
fastcore==1.5.29
filelock==3.13.1
frozenlist==1.4.1
fs==2.4.16
fsspec==2023.12.2
ghapi==1.0.4
grpcio==1.60.0
h11==0.14.0
httpcore==1.0.2
httplib2==0.14.0
httpx==0.26.0
huggingface-hub==0.20.2
humanfriendly==10.0
hyperlink==19.0.0
idna==2.8
importlib-metadata==6.11.0
incremental==16.10.1
inflection==0.5.1
Jinja2==3.1.3
joblib==1.3.2
jsonpatch==1.22
jsonpointer==2.0
jsonschema==3.2.0
keyring==18.0.1
language-selector==0.1
launchpadlib==1.10.13
lazr.restfulclient==0.14.2
lazr.uri==1.0.3
markdown-it-py==3.0.0
MarkupSafe==2.1.3
mdurl==0.1.2
more-itertools==4.2.0
mpmath==1.3.0
msgpack==1.0.7
multidict==6.0.4
multiprocess==0.70.15
mypy-extensions==1.0.0
netifaces==0.10.4
networkx==3.1
ninja==<IP_ADDRESS>
numpy==1.24.4
nvidia-cublas-cu12==<IP_ADDRESS>
nvidia-cuda-cupti-cu12==12.1.105
nvidia-cuda-nvrtc-cu12==12.1.105
nvidia-cuda-runtime-cu12==12.1.105
nvidia-cudnn-cu12==<IP_ADDRESS>
nvidia-cufft-cu12==<IP_ADDRESS>
nvidia-curand-cu12==<IP_ADDRESS>
nvidia-cusolver-cu12==<IP_ADDRESS>
nvidia-cusparse-cu12==<IP_ADDRESS>
nvidia-ml-py==11.525.150
nvidia-nccl-cu12==2.18.1
nvidia-nvjitlink-cu12==12.3.101
nvidia-nvtx-cu12==12.1.105
oauthlib==3.1.0
openai==1.9.0
openllm==0.4.41
openllm-client==0.4.41
openllm-core==0.4.41
opentelemetry-api==1.20.0
opentelemetry-instrumentation==0.41b0
opentelemetry-instrumentation-aiohttp-client==0.41b0
opentelemetry-instrumentation-asgi==0.41b0
opentelemetry-sdk==1.20.0
opentelemetry-semantic-conventions==0.41b0
opentelemetry-util-http==0.41b0
optimum==1.16.1
orjson==3.9.10
packaging==23.2
pandas==2.0.3
pathspec==0.12.1
pexpect==4.6.0
pip-requirements-parser==32.0.1
pip-tools==7.3.0
platformdirs==4.1.0
prometheus-client==0.19.0
protobuf==4.25.2
psutil==5.9.7
pyarrow==14.0.2
pyarrow-hotfix==0.6
pyasn1==0.4.2
pyasn1-modules==0.2.1
pydantic==1.10.13
Pygments==2.17.2
PyGObject==3.36.0
PyHamcrest==1.9.0
PyJWT==1.7.1
pymacaroons==0.13.0
PyNaCl==1.3.0
pyOpenSSL==19.0.0
pyparsing==3.1.1
pyproject_hooks==1.0.0
pyrsistent==0.15.5
pyserial==3.4
python-apt==2.0.1+ubuntu<IP_ADDRESS>
python-dateutil==2.8.2
python-debian==0.1.36+ubuntu1.1
python-json-logger==2.0.7
python-multipart==0.0.6
pytz==2023.3.post1
PyYAML==5.3.1
pyzmq==25.1.2
quantile-python==1.1
ray==2.6.0
regex==2023.12.25
requests==2.22.0
requests-unixsocket==0.2.0
rich==13.7.0
safetensors==0.4.1
schema==0.7.5
scikit-learn==1.3.2
scipy==1.10.1
SecretStorage==2.3.1
sentencepiece==0.1.99
service-identity==18.1.0
simple-di==0.1.5
simplejson==3.16.0
six==1.14.0
sniffio==1.3.0
sos==4.5.6
ssh-import-id==5.10
starlette==0.35.1
sympy==1.12
systemd-python==234
threadpoolctl==3.2.0
tokenizers==0.15.0
tomli==2.0.1
torch==2.1.2
tornado==6.4
tqdm==4.66.1
transformers==4.36.2
triton==2.1.0
Twisted==18.9.0
typing_extensions==4.9.0
tzdata==2023.4
ubuntu-advantage-tools==8001
ufw==0.36
unattended-upgrades==0.1
urllib3==1.25.8
uvicorn==0.25.0
virtualenv==20.25.0
vllm==0.2.6
wadllib==1.3.3
watchfiles==0.21.0
wrapt==1.16.0
xformers==0.0.23.post1
xxhash==3.4.1
yarl==1.9.4
zipp==1.0.0
zope.interface==4.7.1

root@bentotest:~/bentoml/bentos/microsoft--phi-1-5-service/83b9c526374a136c8d808fd55bdb15ae351584fc/src# transformers-cli env
Copy-and-paste the text below in your GitHub issue and FILL OUT the two last points.

transformers version: 4.36.2
Platform: Linux-5.15.0-1048-gcp-x86_64-with-glibc2.29
Python version: 3.8.10
Huggingface_hub version: 0.20.2
Safetensors version: 0.4.1
Accelerate version: 0.26.1
Accelerate config:    not found
PyTorch version (GPU?): 2.1.2+cu121 (False)
Tensorflow version (GPU?): not installed (NA)
Flax version (CPU?/GPU?/TPU?): not installed (NA)
Jax version: not installed
JaxLib version: not installed
Using GPU in script?: No
Using distributed or parallel set-up in script?: No

System information (Optional)
No response

I suspect that generate_iterator function consumed by :self.runner.generate_iterator.async_stream in _llm.py assumes the stream brings one message at a time while it can send a chunk of them.
maybe it is a timing issue that happens only when the bento is in a docker.
just a guess..

I had the same problem.

what did you do to resolve? (I moved out of openllm for now..)

I also had the same problem.


Update Setup.py

Uploading to PyPI seems to not include requirements.txt in distribution files.  I updated setup.py to have an array of all requirements instead of reading the requirements.txt file.
Updates version from 0.1.0 to 0.1.2.
Added CHANGELOG.md

Looks good, merging


[PE-D][Tester E] Hide command does not recognise invalid tags

The user guide states the following:

Tag names must only be from the following: ear, nose, throat (not case-sensitive).
e.g. t/sick will cause an error message.

However, this rule is not followed for the hide command. Upon using an invalid tag like t/brain, no error message is returned. This may mislead users into thinking that this tag is valid.

Labels: type.FunctionalityBug severity.Medium
original: zacchaeuschok/ped#3

A simple check for valid tag in the parser will resolve this


Upgrade to latest Java SDK

@nickzhums : Thanks for your contribution! The author(s) have been notified to review your proposed change.

@weidongxu-microsoft @haolingdong-msft

@nickzhums - thanks for the update.
#sign-off


Recognizer settings UI for dialogs(esp. for RegEx)

The property editor UI for dialog recognizers don't fit the design system, and it also has a few gaps to the design. I did a path on a new design here:
https://www.figma.com/file/04DymSq4xElhOBdAyutvvTbq/Composer-SH-06.19?node-id=4663%3A156

addressed via https://github.com/microsoft/BotFramework-Composer/pull/1991


etcd healthcheck failing on v2.2.0-rc3

What kind of request is this (question/bug/enhancement/feature request):
bug
Steps to reproduce (least amount of steps as possible):

Deploy Rancher Server on Node 1
Create a new cluster.
Add Node 2 which is both an etcd and control plane

Result:
Fails at:
[etcd] Failed to bring up Etcd Plane: [etcd] Etcd Cluster is not healthy
Other details that may be helpful:
Rancher Server Logs:
2019/03/06 19:42:12 [INFO] cluster [c-rgjs8] provisioning: Building Kubernetes cluster
2019/03/06 19:42:12 [INFO] cluster [c-rgjs8] provisioning: [dialer] Setup tunnel for host [<IP_ADDRESS>]
2019/03/06 19:42:12 [INFO] cluster [c-rgjs8] provisioning: [network] Deploying port listener containers
2019/03/06 19:42:12 [INFO] cluster [c-rgjs8] provisioning: [network] Pulling image [rancher/rke-tools:v0.1.25] on host [<IP_ADDRESS>]
2019/03/06 19:42:17 [INFO] cluster [c-rgjs8] provisioning: [network] Successfully pulled image [rancher/rke-tools:v0.1.25] on host [<IP_ADDRESS>]
2019/03/06 19:42:17 [INFO] cluster [c-rgjs8] provisioning: [network] Successfully started [rke-etcd-port-listener] container on host [<IP_ADDRESS>]
2019/03/06 19:42:18 [INFO] cluster [c-rgjs8] provisioning: [network] Successfully started [rke-cp-port-listener] container on host [<IP_ADDRESS>]
2019/03/06 19:42:18 [INFO] cluster [c-rgjs8] provisioning: [network] Port listener containers deployed successfully
2019/03/06 19:42:18 [INFO] cluster [c-rgjs8] provisioning: [network] Running control plane -> etcd port checks
2019/03/06 19:42:18 [INFO] cluster [c-rgjs8] provisioning: [network] Successfully started [rke-port-checker] container on host [<IP_ADDRESS>]
2019/03/06 19:42:18 [INFO] cluster [c-rgjs8] provisioning: [network] Running control plane -> worker port checks
2019/03/06 19:42:19 [INFO] cluster [c-rgjs8] provisioning: [network] Successfully started [rke-port-checker] container on host [<IP_ADDRESS>]
2019/03/06 19:42:19 [INFO] cluster [c-rgjs8] provisioning: [network] Running workers -> control plane port checks
2019/03/06 19:42:19 [INFO] cluster [c-rgjs8] provisioning: [network] Skipping kubeapi port check
2019/03/06 19:42:19 [INFO] cluster [c-rgjs8] provisioning: [network] Removing port listener containers
2019/03/06 19:42:19 [INFO] cluster [c-rgjs8] provisioning: [remove/rke-etcd-port-listener] Successfully removed container on host [<IP_ADDRESS>]
2019/03/06 19:42:19 [INFO] cluster [c-rgjs8] provisioning: [remove/rke-cp-port-listener] Successfully removed container on host [<IP_ADDRESS>]
2019/03/06 19:42:19 [INFO] cluster [c-rgjs8] provisioning: [network] Port listener containers removed successfully
2019/03/06 19:42:19 [INFO] cluster [c-rgjs8] provisioning: [certificates] Deploying kubernetes certificates to Cluster nodes
2019/03/06 19:42:25 [INFO] cluster [c-rgjs8] provisioning: [reconcile] Rebuilding and updating local kube config
I0306 19:42:25.391753       7 http.go:110] HTTP2 has been explicitly disabled
2019/03/06 19:42:25 [INFO] cluster [c-rgjs8] provisioning: Successfully Deployed local admin kubeconfig at [management-state/rke/rke-081151246/kube_config_cluster.yml]
2019/03/06 19:42:25 [INFO] cluster [c-rgjs8] provisioning: [certificates] Successfully deployed kubernetes certificates to Cluster nodes
2019/03/06 19:42:25 [INFO] cluster [c-rgjs8] provisioning: [file-deploy] Deploying file '/etc/kubernetes/kube-api-authn-webhook.yaml' to node [<IP_ADDRESS>]
2019/03/06 19:42:25 [INFO] cluster [c-rgjs8] provisioning: [file-deploy] Successfully started [file-deployer] container on host [<IP_ADDRESS>]
2019/03/06 19:42:26 [INFO] cluster [c-rgjs8] provisioning: [remove/file-deployer] Successfully removed container on host [<IP_ADDRESS>]
2019/03/06 19:42:26 [INFO] cluster [c-rgjs8] provisioning: [/etc/kubernetes/cloud-config] Successfully deployed authentication webhook config Cluster nodes
2019/03/06 19:42:26 [INFO] cluster [c-rgjs8] provisioning: [reconcile] Reconciling cluster state
2019/03/06 19:42:26 [INFO] cluster [c-rgjs8] provisioning: [reconcile] This is newly generated cluster
2019/03/06 19:42:26 [INFO] cluster [c-rgjs8] provisioning: Pre-pulling kubernetes images
2019/03/06 19:42:26 [INFO] cluster [c-rgjs8] provisioning: [pre-deploy] Pulling image [rancher/hyperkube:v1.13.4-rancher1] on host [<IP_ADDRESS>]
2019/03/06 19:42:49 [INFO] cluster [c-rgjs8] provisioning: [pre-deploy] Successfully pulled image [rancher/hyperkube:v1.13.4-rancher1] on host [<IP_ADDRESS>]
2019/03/06 19:42:49 [INFO] cluster [c-rgjs8] provisioning: Kubernetes images pulled successfully
2019/03/06 19:42:49 [INFO] cluster [c-rgjs8] provisioning: [etcd] Building up etcd plane..
2019/03/06 19:42:49 [INFO] cluster [c-rgjs8] provisioning: [etcd] Pulling image [rancher/coreos-etcd:v3.2.24] on host [<IP_ADDRESS>]
2019/03/06 19:42:51 [INFO] cluster [c-rgjs8] provisioning: [etcd] Successfully pulled image [rancher/coreos-etcd:v3.2.24] on host [<IP_ADDRESS>]
2019/03/06 19:42:52 [INFO] cluster [c-rgjs8] provisioning: [etcd] Successfully started [etcd] container on host [<IP_ADDRESS>]
2019/03/06 19:42:53 [INFO] cluster [c-rgjs8] provisioning: [etcd] Successfully started [rke-log-linker] container on host [<IP_ADDRESS>]
2019/03/06 19:42:53 [INFO] cluster [c-rgjs8] provisioning: [remove/rke-log-linker] Successfully removed container on host [<IP_ADDRESS>]
2019/03/06 19:42:53 [INFO] cluster [c-rgjs8] provisioning: [etcd] Successfully started etcd plane.. Checking etcd cluster health
2019/03/06 19:43:14 [ERROR] cluster [c-rgjs8] provisioning: [etcd] Failed to bring up Etcd Plane: [etcd] Etcd Cluster is not healthy
2019/03/06 19:43:14 [INFO] kontainerdriver rancherkubernetesengine stopped
2019/03/06 19:43:14 [ERROR] ClusterController c-rgjs8 [cluster-provisioner-controller] failed with : [etcd] Failed to bring up Etcd Plane: [etcd] Etcd Cluster is not healthy

etcd logs:
2019-03-06 19:42:52.645938 I | etcdmain: etcd Version: 3.2.24
2019-03-06 19:42:52.646017 I | etcdmain: Git SHA: 420a45226
2019-03-06 19:42:52.646022 I | etcdmain: Go Version: go1.8.7
2019-03-06 19:42:52.646026 I | etcdmain: Go OS/Arch: linux/amd64
2019-03-06 19:42:52.646033 I | etcdmain: setting maximum number of CPUs to 4, total number of available CPUs is 4
2019-03-06 19:42:52.646093 N | etcdmain: the server is already initialized as member before, starting as etcd member...
2019-03-06 19:42:52.646123 I | embed: peerTLS: cert = /etc/kubernetes/ssl/kube-etcd-45-33-59-140.pem, key = /etc/kubernetes/ssl/kube-etcd-45-33-59-140-key.pem, ca = , trusted-ca = /etc/kubernetes/ssl/kube-ca.pem, client-cert-auth = true
2019-03-06 19:42:52.646792 I | embed: listening for peers on https://<IP_ADDRESS>:2380
2019-03-06 19:42:52.646849 I | embed: listening for client requests on <IP_ADDRESS>:2379
2019-03-06 19:42:52.648989 I | etcdserver: name = etcd-test1
2019-03-06 19:42:52.649010 I | etcdserver: data dir = /var/lib/rancher/etcd/
2019-03-06 19:42:52.649022 I | etcdserver: member dir = /var/lib/rancher/etcd/member
2019-03-06 19:42:52.649026 I | etcdserver: heartbeat = 500ms
2019-03-06 19:42:52.649029 I | etcdserver: election = 5000ms
2019-03-06 19:42:52.649032 I | etcdserver: snapshot count = 100000
2019-03-06 19:42:52.649043 I | etcdserver: advertise client URLs = https://<IP_ADDRESS>:2379,https://<IP_ADDRESS>:4001
2019-03-06 19:42:52.649804 I | etcdserver: restarting member 246eda28f4ecd743 in cluster e5fd88345e2af2cb at commit index 8
2019-03-06 19:42:52.649841 I | raft: 246eda28f4ecd743 became follower at term 4
2019-03-06 19:42:52.649851 I | raft: newRaft 246eda28f4ecd743 [peers: [], term: 4, commit: 8, applied: 0, lastindex: 8, lastterm: 4]
2019-03-06 19:42:52.653980 W | auth: simple token is not cryptographically signed
2019-03-06 19:42:52.656261 I | etcdserver: starting server... [version: 3.2.24, cluster version: to_be_decided]
2019-03-06 19:42:52.657724 I | embed: ClientTLS: cert = /etc/kubernetes/ssl/kube-etcd-45-33-59-140.pem, key = /etc/kubernetes/ssl/kube-etcd-45-33-59-140-key.pem, ca = , trusted-ca = /etc/kubernetes/ssl/kube-ca.pem, client-cert-auth = true
2019-03-06 19:42:52.658354 I | etcdserver/membership: added member 246eda28f4ecd743 [https://<IP_ADDRESS>:2380] to cluster e5fd88345e2af2cb
2019-03-06 19:42:52.658478 N | etcdserver/membership: set the initial cluster version to 3.2
2019-03-06 19:42:52.658532 I | etcdserver/api: enabled capabilities for version 3.2
2019-03-06 19:42:59.150401 I | raft: 246eda28f4ecd743 is starting a new election at term 4
2019-03-06 19:42:59.150523 I | raft: 246eda28f4ecd743 became candidate at term 5
2019-03-06 19:42:59.150550 I | raft: 246eda28f4ecd743 received MsgVoteResp from 246eda28f4ecd743 at term 5
2019-03-06 19:42:59.150621 I | raft: 246eda28f4ecd743 became leader at term 5
2019-03-06 19:42:59.150644 I | raft: raft.node: 246eda28f4ecd743 elected leader 246eda28f4ecd743 at term 5
2019-03-06 19:42:59.152283 I | etcdserver: published {Name:etcd-test1 ClientURLs:[https://<IP_ADDRESS>:2379 https://<IP_ADDRESS>:4001]} to cluster e5fd88345e2af2cb
2019-03-06 19:42:59.152413 I | embed: ready to serve client requests
2019-03-06 19:42:59.152805 I | embed: serving client requests on [::]:2379
WARNING: 2019/03/06 19:42:59 Failed to dial <IP_ADDRESS>:2379: connection error: desc = "transport: authentication handshake failed: remote error: tls: bad certificate"; please retry.

Environment information
2x Linode servers, Ubuntu 18.04.1 LTS

Rancher version (rancher/rancher/rancher/server image tag or shown bottom left in the UI):
2.2.0-rc3

Installation option (single install/HA):
single install

Cluster information

Cluster type (Hosted/Infrastructure Provider/Custom/Imported): Custom
Machine type (cloud/VM/metal) and specifications (CPU/memory): 4 CPU/8GB
Kubernetes version (use kubectl version):

(paste the output here)

Docker version (use docker version):

Client:
 Version:           18.06.3-ce
 API version:       1.38
 Go version:        go1.10.3
 Git commit:        d7080c1
 Built:             Wed Feb 20 02:28:10 2019
 OS/Arch:           linux/amd64
 Experimental:      false

Same issue here, any version of the agent it seems, so I assume an issue with the master?

Hi,
Exactly same problem with 2.2.0rc6 version of Rancher/Rancher and Agent for ARM64
Rancher server deployed successfully on Rasperry Pi3 / openSUSE Leap OS
Try to adding a node --etcd --controlplane --worker
Doesn't work. Thanks for you help
2019/03/15 20:48:06 [INFO] Provisioning cluster [c-8ddsq]
2019/03/15 20:48:06 [INFO] Creating cluster [c-8ddsq]
2019/03/15 20:48:11 [INFO] kontainerdriver rancherkubernetesengine listening on address <IP_ADDRESS>:10983
2019/03/15 20:48:11 [ERROR] Cluster c-8ddsq previously failed to create
2019/03/15 20:48:12 [INFO] cluster [c-8ddsq] provisioning: Initiating Kubernetes cluster
2019/03/15 20:48:12 [INFO] cluster [c-8ddsq] provisioning: [certificates] Generating admin certificates and kubeconfig
2019/03/15 20:48:12 [INFO] cluster [c-8ddsq] provisioning: Successfully Deployed state file at [management-state/rke/rke-623413845/cluster.rkestate]
2019/03/15 20:48:12 [INFO] cluster [c-8ddsq] provisioning: Building Kubernetes cluster
2019/03/15 20:48:12 [INFO] cluster [c-8ddsq] provisioning: [dialer] Setup tunnel for host [<IP_ADDRESS>]
2019/03/15 20:48:12 [INFO] cluster [c-8ddsq] provisioning: [network] Deploying port listener containers
2019/03/15 20:48:18 [INFO] cluster [c-8ddsq] provisioning: [network] Successfully started [rke-cp-port-listener] container on host [<IP_ADDRESS>]
2019/03/15 20:48:21 [INFO] cluster [c-8ddsq] provisioning: [network] Successfully started [rke-worker-port-listener] container on host [<IP_ADDRESS>]
2019/03/15 20:48:21 [INFO] cluster [c-8ddsq] provisioning: [network] Port listener containers deployed successfully
2019/03/15 20:48:21 [INFO] cluster [c-8ddsq] provisioning: [network] Running control plane -> etcd port checks
2019/03/15 20:48:23 [INFO] cluster [c-8ddsq] provisioning: [network] Successfully started [rke-port-checker] container on host [<IP_ADDRESS>]
2019/03/15 20:48:24 [INFO] cluster [c-8ddsq] provisioning: [network] Running control plane -> worker port checks
2019/03/15 20:48:26 [INFO] cluster [c-8ddsq] provisioning: [network] Successfully started [rke-port-checker] container on host [<IP_ADDRESS>]
2019/03/15 20:48:27 [INFO] cluster [c-8ddsq] provisioning: [network] Running workers -> control plane port checks
2019/03/15 20:48:29 [INFO] cluster [c-8ddsq] provisioning: [network] Successfully started [rke-port-checker] container on host [<IP_ADDRESS>]
2019/03/15 20:48:29 [INFO] cluster [c-8ddsq] provisioning: [network] Skipping kubeapi port check
2019/03/15 20:48:29 [INFO] cluster [c-8ddsq] provisioning: [network] Removing port listener containers
2019/03/15 20:48:30 [INFO] cluster [c-8ddsq] provisioning: [remove/rke-etcd-port-listener] Successfully removed container on host [<IP_ADDRESS>]
2019/03/15 20:48:31 [INFO] cluster [c-8ddsq] provisioning: [remove/rke-cp-port-listener] Successfully removed container on host [<IP_ADDRESS>]
2019/03/15 20:48:32 [INFO] cluster [c-8ddsq] provisioning: [remove/rke-worker-port-listener] Successfully removed container on host [<IP_ADDRESS>]
2019/03/15 20:48:32 [INFO] cluster [c-8ddsq] provisioning: [network] Port listener containers removed successfully
2019/03/15 20:48:32 [INFO] cluster [c-8ddsq] provisioning: [certificates] Deploying kubernetes certificates to Cluster nodes
2019/03/15 20:48:40 [INFO] cluster [c-8ddsq] provisioning: [reconcile] Rebuilding and updating local kube config
I0315 20:48:40.823720       6 http.go:110] HTTP2 has been explicitly disabled
2019/03/15 20:48:40 [INFO] cluster [c-8ddsq] provisioning: Successfully Deployed local admin kubeconfig at [management-state/rke/rke-623413845/kube_config_cluster.yml]
2019/03/15 20:48:40 [INFO] cluster [c-8ddsq] provisioning: [certificates] Successfully deployed kubernetes certificates to Cluster nodes
2019/03/15 20:48:40 [INFO] cluster [c-8ddsq] provisioning: [file-deploy] Deploying file '/etc/kubernetes/kube-api-authn-webhook.yaml' to node [<IP_ADDRESS>]
2019/03/15 20:48:44 [INFO] cluster [c-8ddsq] provisioning: [file-deploy] Successfully started [file-deployer] container on host [<IP_ADDRESS>]
2019/03/15 20:48:44 [INFO] cluster [c-8ddsq] provisioning: [remove/file-deployer] Successfully removed container on host [<IP_ADDRESS>]
2019/03/15 20:48:44 [INFO] cluster [c-8ddsq] provisioning: [/etc/kubernetes/cloud-config] Successfully deployed authentication webhook config Cluster nodes
2019/03/15 20:48:45 [INFO] cluster [c-8ddsq] provisioning: [reconcile] Reconciling cluster state
2019/03/15 20:48:45 [INFO] cluster [c-8ddsq] provisioning: [reconcile] This is newly generated cluster
2019/03/15 20:48:45 [INFO] cluster [c-8ddsq] provisioning: Pre-pulling kubernetes images
2019/03/15 20:48:45 [INFO] cluster [c-8ddsq] provisioning: Kubernetes images pulled successfully
2019/03/15 20:48:45 [INFO] cluster [c-8ddsq] provisioning: [etcd] Building up etcd plane..
2019/03/15 20:48:48 [INFO] cluster [c-8ddsq] provisioning: [etcd] Successfully started [rke-log-linker] container on host [<IP_ADDRESS>]
2019/03/15 20:48:49 [INFO] cluster [c-8ddsq] provisioning: [remove/rke-log-linker] Successfully removed container on host [<IP_ADDRESS>]
2019/03/15 20:48:49 [INFO] cluster [c-8ddsq] provisioning: [etcd] Successfully started etcd plane.. Checking etcd cluster health
2019-03-15 20:49:30.037351 I | mvcc: store.index: compact 10279
2019-03-15 20:49:30.045837 I | mvcc: finished scheduled compaction at 10279 (took 6.309803ms)
2019/03/15 20:49:34 [ERROR] cluster [c-8ddsq] provisioning: [etcd] Failed to bring up Etcd Plane: [etcd] Etcd Cluster is not healthy
2019/03/15 20:49:34 [INFO] kontainerdriver rancherkubernetesengine stopped
2019/03/15 20:49:34 [ERROR] ClusterController c-8ddsq [cluster-provisioner-controller] failed with : [etcd] Failed to bring up Etcd Plane: [etcd] Etcd Cluster is not healthy

Will investigate

@somegituser123 I can't reproduce the issue with v2.2.0-rc6, can you make sure that you cleaned up the host before adding them to the cluster.

Yes I'll stop and remove all docker and also all images
Should i clean other things on the node to add ?
I've just tested with latest master ARM64 and still the same

Information could be usefull,
Docker log from coreos-etcd said :
rafthttp: health check for peer 77f524301c76ca22 could not connect: dial tcp <IP_ADDRESS>:2380: getsockopt: connection refused
But I don't have any firewall active in raspberry pi

Did a fresh setup with a new cluster using v2.2.0-rc6. Everything is working correctly now.

Thanks for the report


tests: deploy knative addon only when necessary

What this PR does / why we need it:
This PR makes it so that knative tests that require knative addon to be installed install it themselves, whenever needed. This makes all the other tests to run without knative addon, faster and it also makes the knative addon not install itself when running tests manually with -run Test.... flag.

This seems to be failing because we don't start controllers for which we don't have CRDs installed (feature) :)
time="2023-01-10T11:22:01+01:00" level=info msg="disabling the 'ingresses' controller due to missing CRD installation" logger=controllers.crdCondition

Closing. We can revisit this when we figure #3029 out


[Spiegel] Unable to download JSON metadata with [Nexx]

[x ] I've verified and I assure that I'm running youtube-dl 2018.02.11

[debug] youtube-dl version 2018.02.11

[x ] At least skimmed through the README, most notably the FAQ and BUGS sections

[x ] Searched the bugtracker for similar issues including closed ones

[x ] Checked that provided video/audio/playlist URLs (if any) are alive and playable in a browser

[x ] Bug report (encountered problems with youtube-dl)

Videos$ ./youtube-dl -f mp4 http://www.spiegel.de/video/webvideos-der-woche-sprung-aufs-eistrampolin-video-99013478.html
[Spiegel] 99013478: Downloading webpage
[Nexx] 1274744: Downloading session/init JSON
[Nexx] 1274744: Downloading videos/byid/1274744 JSON
ERROR: Unable to download JSON metadata: HTTP Error 404: Not Found (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Videos$ ./youtube-dl --verbose -f mp4 http://www.spiegel.de/video/webvideos-der-woche-sprung-aufs-eistrampolin-video-99013478.html
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'--verbose', u'-f', u'mp4', u'http://www.spiegel.de/video/webvideos-der-woche-sprung-aufs-eistrampolin-video-99013478.html']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2018.02.11
[debug] Python version 2.7.12 (CPython) - Linux-4.4.0-112-generic-x86_64-with-Ubuntu-16.04-xenial
[debug] exe versions: avconv 2.8.11-0ubuntu<IP_ADDRESS>, avprobe 2.8.11-0ubuntu<IP_ADDRESS>, ffmpeg 2.8.11-0ubuntu<IP_ADDRESS>, ffprobe 2.8.11-0ubuntu<IP_ADDRESS>, rtmpdump 2.4
[debug] Proxy map: {}
[Spiegel] 99013478: Downloading webpage
[Nexx] 1274744: Downloading session/init JSON
[Nexx] 1274744: Downloading videos/byid/1274744 JSON
ERROR: Unable to download JSON metadata: HTTP Error 404: Not Found (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
  File "./youtube-dl/youtube_dl/extractor/common.py", line 519, in _request_webpage
    return self._downloader.urlopen(url_or_request)
  File "./youtube-dl/youtube_dl/YoutubeDL.py", line 2199, in urlopen
    return self._opener.open(req, timeout=self._socket_timeout)
  File "/usr/lib/python2.7/urllib2.py", line 435, in open
    response = meth(req, response)
  File "/usr/lib/python2.7/urllib2.py", line 548, in http_response
    'http', request, response, code, msg, hdrs)
  File "/usr/lib/python2.7/urllib2.py", line 473, in error
    return self._call_chain(*args)
  File "/usr/lib/python2.7/urllib2.py", line 407, in _call_chain
    result = func(*args)
  File "/usr/lib/python2.7/urllib2.py", line 556, in http_error_default
    raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)

since a few days youtube-dl isn't able to download spiegel.de videos any more. it worked on the according system perfectly before. it's still possible to watch the videos in a browser on the same system. it has been checked with several videos.

verfified with version 2018.02.22: works perfectly
thanks a lot!!


[Feature Request] Getting Embeddings For Facial Images with Facial Recognition Models

Thank you for the project!
As I see, you are using pytorch's img2vec to generate embeddings. As an alternative, we may consider checking a face is available in the image, and if yes find its embeddings with a facial recognition model such as FaceNet.
# !pip instal deepface
from deepface import DeepFace

# check face is available in the given image. img can be a file on the filesystem, or numpy array as well.
face_objs = DeepFace.extract_faces(img_path = img, detector_backend="mtcnn")

if faces:
   for face_obj in face_objs
      detected_face = face_obj["face"]
      embedding = DeepFace.represent(img_path = detected_face, model_name="Facenet", detector_backend="skip")
else:
   # continue to do with pytorch's img2vec

I will be happy to contribute if this attracts your attention. Feel free to close this ticket if you think this will cause losing its way.

Sounds perfect! Should we implement this as an additional function like def extract_faces() or at the class level? If you have a better suggestion I'd love to hear it.
import importlib

class Tasnif:
    def __init__(self, num_classes, pca_dim=16, use_gpu=False, find_faces=False):
        ...
        ...

        # face detection
        try:
            self.face_module = (
            importlib.import_module("deepface") if self.find_faces else None
        )
        except ImportError:
            raise ValueError(
                "The deepface package is not installed. Please install it with `pip install pip install deepface`"
            )
        ...
        self.find_faces = find_faces
        self.faces = []

    ...

    def calculate(self):
        ...
        if self.find_faces:
            self.faces = deepface.DeepFace.extract_faces(
                img_path=self.images, detector_backend="mtcnn"
            )
            if self.faces:
                for face_obj in self.face_objs
                    detected_face = face_obj["face"]
                    embedding = DeepFace.represent(img_path = detected_face, model_name="Facenet", detector_backend="skip")
        ...

IMO, we can put it them all into a function like face2vec and call this from get_embeddings
Thinking something like this:
# https://github.com/cobanov/tasnif/blob/main/tasnif/calculations.py

def get_embeddings(use_gpu=False, images=None, find_faces=False):
    """
    This Python function initializes an Img2Vec object, runs it on either GPU or CPU, and retrieves
    image embeddings.
    """

    logging.info(f"Img2Vec is running on {'GPU' if use_gpu else 'CPU'}...")
    img2vec = Img2Vec(cuda=use_gpu)

    embeddings = (
        (find_faces and face2vec(images))
        or img2vec.get_vec(images, tensor=False)
        )
    return embeddings

def face2vec(images: List[np.ndarray]) -> List[List[float]]:
    embeddings = []

    try:
        from deepface import DeepFace
    except ImportError:
        raise ValueError(
            "The deepface package is not installed."
            "Please install it with `pip install deepface`"
        )

    for img in images:
        try:
           face_objs = DeepFace.extract_faces(
             img_path = img,
             detector_backend="mtcnn"
           )
           for face_obj in face_objs:
             embedding_obj = DeepFace.represent(
                 img_path = detected_face,
                 model_name="Facenet",
                 detector_backend="skip"
             )
             embedding = embedding_obj[0]["embedding"]

        except ValueError as err:
           # in case of no face detected in the given image, ValueError thrown
           # still, facenet can be used to find embeddings
           embedding_obj = DeepFace.represent(
                 img_path = img,
                 model_name="Facenet",
                 detector_backend="skip"
           )
           embedding = embedding_obj[0]["embedding"]

        embeddings.append(embedding)
    return embeddings

# https://github.com/cobanov/tasnif/blob/main/tasnif/tasnif.py
class Tasnif:
    def __init__(self, num_classes, pca_dim=16, use_gpu=False, find_faces=False):
        ...
        ...
        self.find_faces = find_faces
        ...

    def calculate(self):
        self.embeddings = get_embeddings(
            use_gpu=self.use_gpu,
            images=self.images,
            find_faces=find_faces
        )
        ...

Sefik, this change really excites me, but I will ask for your time until the weekend. I don't want to make a decision without looking carefully.

No problem, take your time please.
Please do not hesitate to contact me if I can give you a hand.

Is that request still active? I can try to open a pull request for it?

I was going to look into this issue, but due to a sudden holiday, I still haven't had the opportunity to talk to Sefik @serengil , I apologize for keeping you waiting.

Hey @serengil , I am very sorry for keeping you waiting for so long, I will review the PR you sent with pleasure at any time you are available.


Use sorted iterator instead of unsorted one

It fixes potential signature mismatch bug when table is supplied as message.

Fixed with 8bf7d000802a0aac94aa4c82ac50dfcfefdf3e4c
You are correct that the message table would have been arbitrarily ordered, but as the generate_signature function already expects that a table supplied as the message be an array, a simple table.sort should account for inconsistencies


Upgrade Climate Resilience Project to Onix compliant and Migrate Codebase from Tekdi to FIDE

Description
Based on information received from Bharath, it is understood that Tekdi implemented the existing version of the Climate Resilience project. Since the contract between FIDE and Tekdi has ended, FIDE is planning to:

Upgrade the protocol server to version 1.1 from the current 0.9.3.
Make it Beckn ONIX compliant.
Move the codebase from Tekdi's repository to FIDE's repository.

To proceed, a call with the Tekdi team is needed to clarify and understand the following:

The tech stack used for BAP and BPP.
The number of BAPs and BPPs involved, along with their URLs.
The GitHub repository that Tekdi used for the project.
The possibility of creating our app with new catalogs on Strapi.
Server/Infrastructure details: Number of EC2 instances, configuration, and sizes.
The process of merging the Tekdi code base with the FIDE code base to estimate the timeline.

The current app link is available here: https://climatedatahighways.becknprotocol.io/
Goals

[ ] Schedule and conduct a call with Tekdi to gather the necessary technical information.
[ ] Understand the tech stack used for BAP and BPP and the number of instances involved.
[ ] Retrieve details on the GitHub repository used by Tekdi for the Climate Resilience project.
[ ] Determine the feasibility of creating a new app with catalogs on Strapi.
[ ] Gather server/infra details, including the number of EC2 instances and their configuration.
[ ] Outline the process for merging Tekdi's codebase with FIDE's, including the anticipated timeline.

Expected Outcome

A detailed understanding of the current Climate Resilience project setup implemented by Tekdi.
Clear information regarding the technical infrastructure, tech stack, and repository details.
A documented plan for upgrading the protocol server to version 1.1, ensuring Beckn ONIX compliance, and migrating the codebase to FIDE.
A finalized timeline for merging Tekdi's code with FIDE's codebase.

Acceptance Criteria

[ ] A call with the Tekdi team is scheduled and conducted.
[ ] The tech stack and infrastructure details, including EC2 instances and configurations, are gathered.
[ ] GitHub repository details and BAP/BPP URLs are retrieved.
[ ] Feasibility of creating a new app with catalogs on Strapi is confirmed.
[ ] A plan and timeline for merging the Tekdi codebase with FIDE's is outlined.

Mockups / Wireframes
NA
Product Name
Climate Resilience Project
Domain
Climate Data Infrastructure
Tech Skills Needed

Beckn Protocol
BAP/BPP Knowledge
GitHub Repository Management
Server/Infrastructure Management (EC2)
Strapi Integration

Complexity
High
Category
Project Migration and Upgradation
Sub Category
Backend Development / Infrastructure Management
Project View
Climate Resilience Project
Project Name
FIDE Climate Resilience

Viraj will be connecting with Bharath today on the details.
@viraj89 @emmayank @faizmagic

On Sept 12, 2024, a meeting was held with Bharath, @viraj89, and @yesrag2309. Based on the information received from Bharath, it is understood that Tekdi implemented the existing version of the Climate Resilience project. Since the contract between FIDE and Tekdi has ended, FIDE is now planning to:

Upgrade the protocol server to version 1.1 from current 0.9.3
Make it Beckn ONIX compliant.
Move the codebase from Tekdi repo to FIDE.

To proceed, a call with the Tekdi team is needed to clarify:

The tech stack, and the number of BAPs and BPPs involved.
Whether creating our app with new catalogs on Strapi is a possibility?
The process of merging the Tekdi code base with the FIDE code base.

This will help us anticipate a rough timeline.
cc @faizmagic @yesrag2309 @bharath-ganapathy

Status: Email communicated was requested to the Tekdi team on Oct 7.
Next steps: Connect over the mutually available time for a call and understand the above said.

MOM - Climate Data Highways Project Discussion for Beckn ONIX Compliance
**Date - Oct 9, 2024
Attendees: EM team, Tekdi team
Overview:
EM and Tekdi teams met to discuss the details of the Climate Data Highways project and the steps required to make it Beckn ONIX compliant.
Tech Stack:
The Tekdi team has used React and Node.js for the project. However, since Beckn's UI building blocks were not used by Tekdi, we will need to build these applications from scratch to ensure full compliance.
Repository Details:
The Tekdi team will share the GitHub repository details used for the project to help us understand their code base.
Catalog Information:
The Tekdi team will provide the catalog's Excel sheet for better clarity on the data structure and content.
Database and Infrastructure:
Tekdi used Hasura with PostgreSQL for the BPP, where catalogs were uploaded to the database. The Tekdi team will share the database schema details.
Infrastructure details will also be shared to help us understand the setup.
Next Steps:

Tekdi team to share all required project details, including repository links, catalog data, and infrastructure information.
Once we receive these, we will proceed with merging Tekdi’s code base with the FIDE code base and estimate the timeline for completion.

Update
Status Update:
Several email exchanges between us and the Tekdi team have taken place over the last few days. We have received the following items from Tekdi:

Catalog Sheets: CSV files containing one catalog per BPP.
App Credentials for BAP:
Username: admin, Password: 12345.
Infrastructure Details:

Project
Public IP
RAM
CPU

Climatic Reservations
<IP_ADDRESS>
16 GB
4 vCPU

Forest Conservation
<IP_ADDRESS>
16 GB
4 vCPU

Beckn BAP and BPP List: Link here

Next Steps:

Awaiting repo links for the app after internal discussion/permission within Tekdi team. Currently repos are private.

The Flow has been moved to the iteration of Oct 28 - Nov 10 and is prioritized.

Update on BPP Strapi and Tekdi Catalogs - Oct 29
Discussed with Faiz about the next steps for BPP Strapi and the catalogs received from the Tekdi team.
We reviewed the approach for Climate Resilience and Forest Conservation migration. As first step we should start the analysis of the catalogs (zip file with multiple CSVs) shared by Tekdi team. Here are the next objectives:

Evaluate Import Feasibility: Check if the CSVs can be directly imported into Strapi BPP. Assess the effort needed for this.
Mapping Exercise: If direct import isn't possible, via a mapping exercise, map fields from Tekdi's CSVs to our existing Strapi BPP fields. Use Google Sheet preferably for this.
Category Fit: Identify which BPP Strapi category the Tekdi catalogs fit into (e.g., retail) to maximize field usage and save time/effort. Rather than creating new fields.

For Phase 1, we will focus on mapping the CSV catalog fields to the existing Strapi BPP fields. Any additional fields required will be considered for Phase 2.
Next steps:
Ticket for this work here is here - https://github.com/beckn/missions/issues/154
And estimate the effort.
cc @emmayank @em-abee @rahul-eminds

Current Status:

Mayank to work with the team and get started with the migration of the climate data highways application to EC
Mayank to come up with the project plan by the 5th Nov 2024

Next Steps

Team to get started with the implementation, as soon as the tickets are in place

CC: @emmayank

Current Status:

Project available is ready and available here - https://github.com/orgs/beckn/projects/28/views/83
all the task are created and assigned to team with due date of development as 15th November, 2024
Team has started with the implementation

Next Steps

Grooming the tickets - @emmayank
Demo with stakeholder, once development is completed

Mayank to schedule a project review call today

Current Status:

Ticket grooming done
Backend work is 40 % completed
Frontend work is 40% completed

Next Steps

Demo with stakeholder, once development is completed


How to access methods from other files?

Let's say I have two files:
// a.js
class a {
    someFunc() {
        b.otherFunc(); // This is what I want to achieve
    }
}

// b.js
class b {
    otherFunc() {
    }
}

How to access methods from another file?

Tried everything and got no success and out of despair I tried simply:
class a {
    someFunc() {
        const {b} = customJS;
        b.otherFunc();
    }
}

That's so meta 😆

Hah! That's funny. I wouldn't have thought to try that, but it does make sense. I believe that's the only way you can reference another file. You could also have someFunc take b as a parameter and pass it in from your obsidian note, but I think your solution is better :P


fix(FX-3293): request color aggregation

The type of this PR is: Fix

This PR resolves FX-3293
Demo
https://user-images.githubusercontent.com/3513494/132831436-12292b2c-65cb-4f23-91fe-c5dd54c4fe1b.mp4

PR Checklist (tick all before merging)

[x] I have included screenshots or videos to illustrate my changes, or I have not changed anything that impacts the UI.
[x] I have tested my changes on iOS and Android.
[x] I have added tests for my changes, or my changes don't require testing, or I have included a link to a separate Jira ticket covering the tests.
[x] I have added a feature flag, or my changes don't require a feature flag. (How do I add one?)
[x] I have documented any follow-up work that this PR will require, or it does not require any.
[x] I have added an app state migration, or my changes do not require one. (What are migrations?)
[x] I have added a changelog entry below or my changes do not require one.

Changelog updates
Changelog updates

Cross-platform user-facing changes

Show the colors filter on edit saved search page - dimatretyak

iOS user-facing changes

Android user-facing changes

Dev changes

This PR contains the following changes:

Cross-platform user-facing changes (Show the colors filter on edit saved search page - dimatretyak)

  Generated by :no_entry_sign: dangerJS against c85fa26d738cc0045f53df2ebedc4f5fad9891e1


MERGE DEC. 8 - Update PWA post 3 to use CLP instead of Lock

Consolidated into https://github.com/auth0/blog/pull/1214


[GOBBLIN-1442]Fix the bug of NoSuchElement Exception in HiveWriter

Dear Gobblin maintainers,
Please accept this PR. I understand that it will not be reviewed until I have checked off all the steps below!
JIRA

[ ] My PR addresses the following Gobblin JIRA issues and references them in the PR title. For example, "[GOBBLIN-1442] My Gobblin PR"

https://issues.apache.org/jira/browse/GOBBLIN-1442

Description

[ ] Here are some details about my PR, including screenshots (if applicable):
After recent change, we see the default value of offsetRange in GMCE change to empty map, so add one more check to make sure the map is not empty so that we won't hit the exception

Tests

[ ] My PR adds the following unit tests OR does not need testing for this extremely good reason:

Commits

[ ] My commits all reference JIRA issues in their subject lines, and I have squashed multiple commits if they address the same issue. In addition, my commits follow the guidelines from "How to write a good git commit message":

Subject is separated from body by a blank line
Subject is limited to 50 characters
Subject does not end with a period
Subject uses the imperative mood ("add", not "adding")
Body wraps at 72 characters
Body explains "what" and "why", not "how"

Codecov Report

Merging #3278 (e2dbcc1) into master (ae62d77) will decrease coverage by 37.54%.
The diff coverage is 0.00%.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ae62d77...e2dbcc1. Read the comment docs.


Fix PHP 7.4 deprecation

There's a deprecation at https://github.com/spicywebau/craft-embedded-assets/blob/master/src/Service.php#L196 with PHP 7.4.

Should be changed to:
$code = ($value instanceof Twig_Markup ? (string)$value : is_string($value)) ? $value : '';

fix has been released in v<IP_ADDRESS>