[GH-337] Create CLI support for tests for both launcher and the updater.

https://github.com/input-output-hk/cardano-shell/issues/337
This enables testing from the CLI.
I also had to refactor the CLI module a bit, the CLI belongs at the top level.
If you want to provide stubbed exit codes, you can use something like:
stack exec cardano-launcher -- --config ./cardano-launcher/configuration/launcher/launcher-config.demo.yaml --wallet-exit-codes "[CLIExitCodeFailure 21, CLIExitCodeFailure 22, CLIExitCodeFailure 20, CLIExitCodeSuccess]" --updater-exit-codes "[CLIExitCodeFailure 1, CLIExitCodeSuccess]"

The exit codes are being popped from the list in order in which they were submitted. The result of this run is:
stack exec cardano-launcher -- --config ./cardano-launcher/configuration/launcher/launcher-config.demo.yaml --wallet-exit-codes "[CLIExitCodeFailure 21, CLIExitCodeFailure 22, CLIExitCodeFailure 20, CLIExitCodeSuccess]" --updater-exit-codes "[CLIExitCodeFailure 1, CLIExitCodeSuccess]"
LauncherCLI {launcherConfigPath = LauncherOptionPath {getLauncherOptionPath = "./cardano-launcher/configuration/launcher/launcher-config.demo.yaml"}, walletExitCodes = Just [CLIExitCodeFailure 21,CLIExitCodeFailure 22,CLIExitCodeFailure 20,CLIExitCodeSuccess], updaterExitCodes = Just [CLIExitCodeFailure 1,CLIExitCodeSuccess]}
[iohk.launcher:Notice:15] [2019-10-29 12:47:56.63 UTC] Starting cardano-launcher
[iohk.launcher:Notice:15] [2019-10-29 12:47:56.64 UTC] Launcher substituted ENV variables: Object (fromList [("walletLogging",Bool False),("nodeArgs",Array [String "--tlsca",String "/home/ksaric/.local/share/Daedalus/mainnet/tls/server/ca.crt",String "--tlscert",String "/home/ksaric/.local/share/Daedalus/mainnet/tls/server/server.crt",String "--tlskey",String "/home/ksaric/.local/share/Daedalus/mainnet/tls/server/server.key",String "--no-client-auth",String "--log-console-off",String "--update-server",String "https://update-cardano-mainnet.iohk.io",String "--keyfile",String "/home/ksaric/.local/share/Daedalus/mainnet/Secrets/secret.key",String "--topology",String ".//wallet-topology.yaml",String "--wallet-db-path",String "/home/ksaric/.local/share/Daedalus/mainnet/Wallet",String "--update-latest-path",String "/home/ksaric/.local/share/Daedalus/mainnet/installer.sh",String "--wallet-address",String "<IP_ADDRESS>:0",String "--update-with-package"]),("statePath",String "/home/ksaric/.local/share/Daedalus/mainnet"),("walletPath",String "./cardano-launcher/test/testDaedalusFrontend.sh"),("nodePath",String "cardano-node"),("launcherLogsPrefix",String "/home/ksaric/.local/share/Daedalus/mainnet/Logs/"),("walletArgs",Array []),("nodeDbPath",String "/home/ksaric/.local/share/Daedalus/mainnet/DB/"),("updaterPath",String "bash"),("workingDir",String "./"),("frontendOnlyMode",Bool True),("nodeLogPath",Null),("updaterArgs",Array [String "main"]),("logsPrefix",String "/home/ksaric/.local/share/Daedalus/mainnet/Logs"),("configuration",Object (fromList [("seed",Null),("filePath",String "./cardano-launcher/configuration/cert-configuration.yaml"),("key",String "dev"),("systemStart",Null)])),("updateArchive",String "./cardano-launcher/test/testUpdater.sh"),("nodeLogConfig",String ".//log-config-prod.yaml"),("nodeTimeoutSec",Number 60.0),("tlsPath",String "./configuration"),("x509ToolPath",String "cardano-x509-certificates")])
[iohk.launcher:Info:15] [2019-10-29 12:47:56.64 UTC] Generating the certificates!
[iohk.launcher:Info:15] [2019-10-29 12:47:56.78 UTC] Does update installation exist: UpdaterExists
[iohk.launcher:Info:15] [2019-10-29 12:47:56.78 UTC] Running UNIX update.
[iohk.launcher:Notice:15] [2019-10-29 12:47:56.78 UTC] Starting the wallet with arguments: WalletArguments {getWalletArguments = []}
[iohk.launcher:Notice:15] [2019-10-29 12:47:56.78 UTC] Wallet exited with exitcode: ExitFailure 21
[iohk.launcher:Notice:15] [2019-10-29 12:47:56.78 UTC] Restart Daedalus in GPU safe mode
[iohk.launcher:Notice:15] [2019-10-29 12:47:56.78 UTC] Starting the wallet with arguments: WalletArguments {getWalletArguments = ["--safe-mode","--disable-gpu","--disable-d3d11"]}
[iohk.launcher:Notice:15] [2019-10-29 12:47:56.78 UTC] Wallet exited with exitcode: ExitFailure 22
[iohk.launcher:Notice:15] [2019-10-29 12:47:56.78 UTC] Restart Daedalus in normal mode
[iohk.launcher:Notice:15] [2019-10-29 12:47:56.78 UTC] Starting the wallet with arguments: WalletArguments {getWalletArguments = []}
[iohk.launcher:Notice:15] [2019-10-29 12:47:56.78 UTC] Wallet exited with exitcode: ExitFailure 20
[iohk.launcher:Notice:15] [2019-10-29 12:47:56.78 UTC] Running the update system
[iohk.launcher:Info:15] [2019-10-29 12:47:56.78 UTC] Does update installation exist: UpdaterExists
[iohk.launcher:Info:15] [2019-10-29 12:47:56.78 UTC] Running UNIX update.
[iohk.launcher:Notice:15] [2019-10-29 12:47:56.78 UTC] Starting the wallet with arguments: WalletArguments {getWalletArguments = []}
[iohk.launcher:Notice:15] [2019-10-29 12:47:56.78 UTC] Wallet exited with exitcode: ExitSuccess
[iohk.launcher:Notice:15] [2019-10-29 12:47:56.78 UTC] Daedalus exited with ExitSuccess, will shutdown cardano-launcher

Now we can cover all the state machine scenarios on all platforms!
The full state machine diagram:

@HirotoShioi After the CLI stub exit codes have been exhausted (they were "used") or they weren't defined, it uses the default "real" runners.
If the real runner finds something that doesn't work, it will behave as it usually does - it will return an error and exit.


#4 fix undefined $$props.$$slots

There is warning: <Nav> received an unexpected slot "default". but this happens only dev mode and is due to https://github.com/sveltejs/svelte/issues/4546


Update install-dnsmasq

@ArtakG can you please add description in the PR, to explain why you need this change. Thx


Softball QnA Knowledge

Re-Re-adding softball PR: #659

This PR is in the wrong folder- it needs to go in knowledge/sports/.....

@jjasghar - Thanks for the PR, can you please change the location of your file - knowledge/sports/overview/softball/qna.yaml

Fixed.

Thanks @jjasghar

Thank you for your submission. Here are your results:
Your PR didn't change the model performance
The model's new score is: 0.5108695652173914
The old score was: 0.5108695652173914
||||||||||||||||||||||||||||||||||||||||||||||||||| 51.08695652173913%

Hi! :wave:
With the new update and release of 0.18.0, our base knowledge submissions have drastically changed. This has given us an opportunity to significantly improve the accuracy of our fine-tuned models, which is a major win for our community!
But alas, that has caused some changes that this PR isn't able to continue forward. We greatly appreciate the work you've put into this, and wish we could accept it but the amount of work to get it to be version: 3 is unrealistic for us to ask.
If you do want to do this, please don't hesitate to take the qna.yaml update it, and build it out. Otherwise, we hope you come back to our community with a new submission and help build out our Open Source community-driven LLM.
If you have any questions directly, please don't hesitate to comment on the PR or email me at awesomeATinstructlab.ai (yes, really), and I'll do my best to answer your questions.


[Feature Request] Adding a Contribution Guide Video for newbies

🚀 Feature Request
Is your feature request related to a problem? Please describe.
Several individuals have reached out on LinkedIn seeking guidance on contributing to the repository. Currently, there isn’t a visual guide that walks new contributors through the process. A contribution video could significantly help new contributors, especially those unfamiliar with open-source practices.
Describe the solution you'd like
A short, clear, and comprehensive video tutorial that explains how to contribute to the repository. The video should cover:

Cloning the repository
Creating a new branch
Making changes or adding features to the docs folder
Running it in local to verify the changes
Committing changes and pushing to GitHub
Opening a pull request

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.

Would you like to work on this feature?

[x] Yes
[ ] No

Sure, @J-B-Mugundh, you can make the contribution guide video. We can reference it in our contributing guidelines.


WorkloadEntry telemetry does not report correct canonical_revision

Bug description
Given a WorkloadEntry with a version: v1 label and generated from istioctl workload entry configure ..., telemetry for the workload reports source_canonical_revision="latest" instead of v1. Telemetry does correctly report source_version="v1" and version="v1" though.
WorkloadEntry
apiVersion: networking.istio.io/v1beta1
kind: WorkloadEntry
metadata:
  name: details-v1
  namespace: bookinfo
spec:
  address: <IP_ADDRESS>
  labels:
    app: details
    version: v1
  network: Kubernetes
  serviceAccount: details-service-account

When the workload entry VM files are created with istioctl workload entry configure, the "service.istio.io/canonical-version" label gets generated but not the "service.istio.io/canonical-revision" label.
mesh.yaml
defaultConfig:
  discoveryAddress: istiod.istio-system.svc:15012
  meshId: mesh1
  proxyMetadata:
    CANONICAL_REVISION: v1
    CANONICAL_SERVICE: details
    ISTIO_META_CLUSTER_ID: Kubernetes
    ISTIO_META_DNS_CAPTURE: "true"
    ISTIO_META_MESH_ID: mesh1
    ISTIO_META_NETWORK: Kubernetes
    ISTIO_META_WORKLOAD_NAME: details-v1
    ISTIO_METAJSON_LABELS: '{"app":"details","service.istio.io/canonical-name":"details","service.istio.io/canonical-version":"v1","version":"v1"}'
    POD_NAMESPACE: bookinfo
    SERVICE_ACCOUNT: vm-service-account
    TRUST_DOMAIN: cluster.local
  tracing:
    zipkin:
      address: zipkin.istio-system:9411

[ ] Docs
[ ] Installation
[ ] Networking
[ ] Performance and Scalability
[X] Extensions and Telemetry
[ ] Security
[ ] Test and Release
[ ] User Experience
[ ] Developer Infrastructure
[ ] Upgrade
Expected behavior
Expected canonical_revision in telemetry to match version label.
Steps to reproduce the bug

Create a WorkloadGroup template with a version: v1 label.
Run istioctl workload entry configure ... to create the WorkloadEntry and VM config files (mesh.yaml, cluster.env, etc.)
Start the workload and inspect telemetry for that workload noting that canonical_revision="latest".

Version (include the output of istioctl version --remote and kubectl version --short and helm version --short if you used Helm)
$ istioctl version --remote
client version: 1.10.0
control plane version: 1.10.3
data plane version: 1.10.3 (8 proxies), 1.10.0 (6 proxies)

$ kubectl version --short
Client Version: v1.21.3
Server Version: v1.19.9-gke.1900

$ helm version --short
v3.5.4+g1b5edb6

How was Istio installed?
Helm for CRDs and Operator. Operator for Istio controlplane.
Environment where the bug was observed (cloud vendor, OS, etc)
GKE

@douglas-reid , here is the issue I mentioned in today's call.  Note the service.istio.io/canonical-version label, should that not be service.istio.io/canonical-revision?

@douglas-reid Is this targeted for a patch release, or 1.12?

Is there any chance we or users have taken a dependency on this wrong label?

Is there any chance we or users have taken a dependency on this wrong label?

Very small. The generated telemetry relies on the correct labelling. The dependency would have to be something involving selection of workload groups (for VMs) at the version level.

@nrfox can this be closed now that the fix was merged?

@douglas-reid yes! Thank you for the fix.


Move public headers to include dir and remove dead header.

Per discussion Wednesday, move two public headers to the include directory and remove the dead header.

Are you sure?
abieos doesn't appear to compile now.
I think you need to move abieos_ripemd160.hpp to include/eosio
and then adjust things to include via  "eosio/abieos_numeric.hpp"

#84


Develop plan for moving update of FreeCen2 from FC1 update to direct update

Develop document that outlines basic process for the change in update process to guide the prioritization of implementation stories
E4 U6 S8 C7:P 25

Needs discussion by @PatReynolds @richpomfret  @Captainkirkdawson and @Vino-S on actions needed to adapt multimodal ingestion of batches for FreeCEN.  Possibley on 10th Feb, after Systemwide, if all available.

@Vino-S can we look to identify key tasks involved in updating the FC DB and how we might do this directly into FC2? Do we convert VLD files into CSV? Can we use the FR tools/modify them to use a similar process? What about validation tools? etc.

@Captainkirkdawson to send @PatReynolds a list of steps/validation rules for FR.

Converted into an epic

An old document on process is contained in
https://docs.google.com/document/d/1poYSNWPjjaIH631BIHdRNnbZpw0HpGAE4ZmfzkjtEsk/edit?ts=5e41a415

@vino can you either point me to a document on the FreeCEN2 update process you currently use or write such a short document.
@lemon-ukgen can you either point me to a document on the FreeCEN1 update process you currently use or write such a short document.
@lemon-ukgen can you point me to a document on what steps you do to prepare for the update of FreeCEN2. Can you create is one does not exist.
We cannot develop a plan for a direct update until we understand the current process.

The FreeCEN1 database update process -- such that it is -- is in CVS at UKGEN-FreeCEN/README. You can read it on vervet at ~lemon/work/UKGEN-FreeCEN/README if you don't have a checkout handy.
@Captainkirkdawson about your second request - the only updating I have ever done on FreeCEN2 is my hand in the update-freecen2 script to update the code. I haven't ever touched the FreeCEN2 data, so I don't think I can write such a document.

Having read the linked document I think you'll find my README a little unsatisfactory, since it doesn't really help explain what happens with these VLD files.
The part of the process I've been involved in is getting the new/updated VLDs from Dropbox and into the FreeCEN1 filesystem so the build (via make all) can proceed. The backstory is that the Dropbox route came about because the previous drop-off system (Windows Network Places DAV) stopped working and we needed Something to replace it. Dropbox plus some scripting became that Something.
As for what that actual build does the best place to look is the Makefile and the scripts it invokes, see vervet:~apache/hosts/freecen/bin/Makefile and neighbours. I can't comment further, I've never needed go inside myself.

List sent of validations for FR sent to @PatReynolds

Thank you @lemon-ukgen; as you say the README is as clear as mud
After lots of digging I have come to the conclusion my understanding of CEN, its structure and processing is sufficient that any suggestions I might make are likely to be highly dangerous and likely inappropriate.
It also seems that everything revolves around Brenda and is unlikely to function without her and her brain is the documentation on CEN offline processing.
The input to CEN1 is apparently PARMS from Brenda to lemon and lemon taking pieces from a dropbox. These are loaded onto colobus.The input to CEN2 is the input to the CEN1; obtained by syncing three folders; fixed, pieces and db-stats. The terminology of fixed and its relationship to PARMS is unclear as is the role of db-stats
The CEN2 updating is apparently following a process documented in https://docs.google.com/document/d/1emA_3FtPGs5iOvmce4C8pESKpTZ957-1yM8KZzxz754/edit
There are however update scripts on the servers that indicate that 3 years ago the process was automated.
https://github.com/FreeUKGen/MyopicVicar/blob/master/lib/tasks/scripts/update_freecen2_monthly_update.sh
The update process for CEN2 is self documented in the code
0: Doing some consistency checks on the database data before starting update
1a) reading ctyPARMS.dat files
1b) reading .VLD validated piece files
These are both then separated into 5 sets DELETED MULTIPLE NEW MODIFIED UNCHANGED
2. Deleting DELETED VLDs from database
3 Deleting MODIFIED VLDs from database to be reloaded
4. Deleting MULTIPLE VLDs from database to try to fix:
5. Dropping DELETED PARMS (and all associated VLDs)
6. Dropping MULTIPLE PARMS (and all associated VLDs)
6. Dropping MODIFIED PARMS (and all associated VLDs)
7. Loading/Reloading NEW  and MODIFIED PARMS files
8. Loading/reloading NEW and MODIFIED VLDs
9 Do some consistency checks on the database data
As a separate task Update piece subplaces geolocation info for PARMS that were loaded
Conceptually then it is possible to envisage CEN2 being updated off line separately and at any time by  having a process that loads a vld file from  the drop box and /or a parms into their respective folders for CEN2 except for the role played by db-stats.
Furthermore it is possible to envisage on-line processes whereby transcribers would upload vld files. Coordinators could transfer these to proofreaders /checkers. Those people could either download or online review the file and make editing changes. If done online then they could be flagged for processing into the database. There could be a nightly processing or more frequent of the "accepted" vlds.
Similar processes could be adopted for parms although I remain confused over parms and fixed and what iis the difference.

Hi Kirk,
Many thanks.
I was ok at the start but got confused when I hit this sentence as the VLD
is the final stage  that Lemon uploads so not sure what COORDS would
transfer?
Possible typo?
Furthermore it is possible to envisage on-line processes whereby
transcribers would upload vld files. Coordinators could transfer these to
proofreaders /checkers
Anyway, my penny worth for what it is worth, as no one appears to mention
the FCTOOLS which is my lifeline.
This is because the process of FreeCEN One is,
CSV, DAT, CHE and the final stage Is  the VLD .
So that is why I am confused as to how the Transcriber gets gold of a VLD?
Although in the future will we need them all?
So just a quick summary of FC1 as it has evolved over the years.

Transcriber uses a spreadsheet that is saved as a CSV using the PIECE
number as the unique reference point.

There are two options for the Proof Reading Stage.

A. The completed CSV then gets converted to a DAT file using FCTOOLS
program, and is zipped together with the correct PARMS file for the County
x Census Year being worked on.
This zipped folder is  then sent to the Proof Reader for the next stage
using WINCC.
B. Or Alternatively the Proof Reader might prefer the ‘Visual Checking’
method as WINCC is not always friendly on Windows 10 PC or the Proof Reader
might be using a iPad which WINCC will not work in anyway.

Depending on which route was taken for the Proof Reading stage the
Validating  is then done using VALDREV.
A) if they used WINCC, then when the Proof Reader has finished the
WINCC program will convert the DAT to a CHE and produce a ZIPPED file (this
contains the CHE and the PARMS file)
B) If the Proof Reader used Visual Checking method instead, then they
will forward the finished CSV back to the Coordinator.
The COORD will then convert the CSV to a CHE using FCTOOLS and will then
zip it with the appropriate PARMS file  ready for the final Validating
process.

It does not really matter which Proof Reading system they used, either
2A or 2B as above, the resulting Zipped folder is then copied into the
VALDREV program for the Validator.

When all the entries have been Validated  the final VLD is produced.

This is then sent to me for inclusion in the next upload for Lemon.

This then takes us back to the sentence at the start that I got confused
about as the Transcriber would never see the VLD as that is the
finished product.
Having said all that and what each stage does, there is an option that
using FCTOOLS it is possible that after the CSV has been completed by
the TRANSCRIBER, we can miss out WINCC and  go straight through to the
VALDREV stage with the Proof Reader  to get to the VLD
So I think it would be a good idea for someone to actually look at what
FCTOOLS does and possibly talk to Rick Parsons who designed this
wonderful program that COORDS would be completely lost without!
Just to add a note that I personally think would be a good idea is that
when online transcribing is available the accuracy of the data entered
would improve, as many errors are caused at the moment by Columns missed
out, too many digits and POB not spelt correctly to name just a few.
So if that is sorted then the Proof Reading and Validating stages could  be
joined together to produce the final VLD.
The COORD could then have a final look and click an upload button (Or
whatever)
FCTOOLS already does this and that then takes me back to a talk with Rick.
Anyway, these are only suggestions from a none programmer who just loves
FCTOOLS which is my lifeline.
On Tue, 18 Feb 2020 at 22:50, Kirk Dawson<EMAIL_ADDRESS>wrote:

Thank you @lemon-ukgen https://github.com/lemon-ukgen; as you say the
README is as clear as mud
After lots of digging I have come to the conclusion my understanding of
CEN, its structure and processing is sufficient that any suggestions I
might make are likely to be highly dangerous and likely inappropriate.
It also seems that everything revolves around Brenda and is unlikely to
function without her and her brain is the documentation on CEN offline
processing.
The input to CEN1 is apparently PARMS from Brenda to lemon and lemon
taking pieces from a dropbox. These are loaded onto colobus.The input to
CEN2 is the input to the CEN1; obtained by syncing three folders; fixed,
pieces and db-stats. The terminology of fixed and its relationship to PARMS
is unclear as is the role of db-stats
The CEN2 updating is apparently following a process documented in
https://docs.google.com/document/d/1emA_3FtPGs5iOvmce4C8pESKpTZ957-1yM8KZzxz754/edit
There are however update scripts on the servers that indicate that 3 years
ago the process was automated.
https://github.com/FreeUKGen/MyopicVicar/blob/master/lib/tasks/scripts/update_freecen2_monthly_update.sh
The update process for CEN2 is self documented in the code
0: Doing some consistency checks on the database data before starting
update
1a) reading ctyPARMS.dat files
1b) reading .VLD validated piece files
These are both then separated into 5 sets DELETED MULTIPLE NEW MODIFIED
UNCHANGED
2. Deleting DELETED VLDs from database
3 Deleting MODIFIED VLDs from database to be reloaded
4. Deleting MULTIPLE VLDs from database to try to fix:
5. Dropping DELETED PARMS (and all associated VLDs)
6. Dropping MULTIPLE PARMS (and all associated VLDs)
6. Dropping MODIFIED PARMS (and all associated VLDs)
7. Loading/Reloading NEW and MODIFIED PARMS files
8. Loading/reloading NEW and MODIFIED VLDs
9 Do some consistency checks on the database data
As a separate task Update piece subplaces geolocation info for PARMS that
were loaded
Conceptually then it is possible to envisage CEN2 being updated off line
separately and at any time by having a process that loads a vld file from
the drop box and /or a parms into their respective folders for CEN2 except
for the role played by db-stats.
Furthermore it is possible to envisage on-line processes whereby
transcribers would upload vld files. Coordinators could transfer these to
proofreaders /checkers. Those people could either download or online review
the file and make editing changes. If done online then they could be
flagged for processing into the database. There could be a nightly
processing or more frequent of the "accepted" vlds.
Similar processes could be adopted for parms although I remain confused
over parms and fixed and what iis the difference.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/FreeUKGen/FreeCENMigration/issues/728?email_source=notifications&email_token=ADIL3VUV52RJHRRUYPZ2GWDRDRQ2HA5CNFSM4INXPBQ2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEMFU73Y#issuecomment-587943919,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ADIL3VS356PU3473MJEWEGTRDRQ2HANCNFSM4INXPBQQ
.

@FreecenBren That you there were lots of very useful stuff in your notes which helps in my education if nothing more.
You mention FCTOOLS ; the extentent of mu knowledge is such that I have never heard the term before. What is it? What does it do? Who uses it? Why do they need it?.

You also mention CHE and DAT and other bits and pieces that again mean nothing to me but are clearly of great importance to the current process but I have to ask myself are they or should they be relevant to the operation of CEN2. Also could someone point me to Rick Parsons if that is appropriate.
Seems to me there is a great deal of packaging and repackaging and transmitting data around that could be eliminated.
The real question for management is whether they want me to spend time on getting the required understanding and translating that into code and processes within CEN2 or perhaps @Vino-S already knows this.

Note by Doug
https://docs.google.com/document/d/1GvZLE1MbY_WkV-ciP9lM7-JJKe4sd7vmjQjI2WQNAEA/edit?ts=5e4d74f5

@FreecenBren Brenda @geoffj-FUG. I now fully understand why the following paragraph caused Brenda such confusion
Furthermore it is possible to envisage on-line processes whereby transcribers would upload vld files. Coordinators could transfer these to proofreaders /checkers. Those people could either download or online review the file and make editing changes. If done online then they could be flagged for processing into the database. There could be a nightly processing or more frequent of the "accepted" vlds.
Would the following make sense?
It is possible to envisage a process on CEN2 whereby transcribers would upload their csv file to CEN2 when ready. They would receive a report from CEN2 somewhat along the lines of that produced by CSVCHECK. The transcriber corrects their csv file on their computer and uploads a replacement file. They again receive a report. This can be repeated until the transcriber is satisfied with the quality of their work and wishes it to go to the checking stage. They could do this work incrementally if they wished rather than waiting until the end.
They inform their coordinator when the csv file is ready for proofreading.  The coordinator assigns a proof reader to review the file. The proof reader downloads the csv file file, the last processing report and any other files they need. They following a similar process of off line editing and uploading until they are satisfied. The proof reader informs the Coordinator that the file is ready for checking. The coordinator assigns a checker who follows the same process as the proofreader  of downloading the csv file, the report and any other files they need. Thy inform the coordinator when they are satisfied with the file. At that point the Coordinator does any final validations and indicates to CEN2 that the csv file can be processed into the database.
In this process there is only a csv file. No format changing is required. Each version of the csv file and its associated report would be archived on replacement thereby maintaining a complete history of what had been done to the file.

Hi Kirk,
Very good.
The part I have underlined at the bottom needs replacing with the following.
There are only the 3 Stages.
1 Transcriber
2 Proof Reader (was called a Checker)
3 Validator (and uploader for want of a better word)
“*The Proof reader informs the Coordinator that the file is ready for
Validating. *
The coordinator assigns a Validator (Often the COORD or one of their
trusted helpers that the COORD has trained)
The Validator follows the same process as the proofreader of downloading
the csv file, the report and any other files they need.
At  that point the Coordinator does any final validations and indicates to
CEN2 that the CSV file can be processed into the database.”
Well done. You did your homework very well!
Brenda
On Thu, 20 Feb 2020 at 19:13, Kirk Dawson<EMAIL_ADDRESS>wrote:

@FreecenBren https://github.com/FreecenBren Brenda @geoffj-FUG
https://github.com/geoffj-FUG. I now fully understand why the following
paragraph caused Brenda such confusion
Furthermore it is possible to envisage on-line processes whereby
transcribers would upload vld files. Coordinators could transfer these to
proofreaders /checkers. Those people could either download or online review
the file and make editing changes. If done online then they could be
flagged for processing into the database. There could be a nightly
processing or more frequent of the "accepted" vlds.
Would the following make sense?
It is possible to envisage a process on CEN2 whereby transcribers would
upload their csv file to CEN2 when ready. They would receive a report from
CEN2 somewhat along the lines of that produced by CSVCHECK. The transcriber
corrects their csv file on their computer and uploads a replacement file.
They again receive a report. This can be repeated until the transcriber is
satisfied with the quality of their work and wishes it to go to the
checking stage. They could do this work incrementally if they wished rather
than waiting until the end.
They inform their coordinator when the csv file is ready for proofreading.
The coordinator assigns a proof reader to review the file. The proof
reader downloads the csv file file, the last processing report and any
other files they need. They follower a similar process of off line editing
and uploading until they are satisfied

Replace this  underlined section with the  what I have said above. Only 3
Stages.

The proof reader informs the Coordinator that the file is ready for
checking. The coordinator assigns a checker who follows the same process as
the proofreader of downloading the csv file, the report and any other files
they need. Thy inform the coordinator when they are satisfied with the
file. At that point the Coordinator does any final validations and
indicates to CEN2 that the csv file can be processed into the database.

In this process there is only a csv file. No format changing is required.

Each version of the csv file and its associated report would be archived on
replacement thereby maintaining a complete history of what had been done to
the file.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/FreeUKGen/FreeCENMigration/issues/728?email_source=notifications&email_token=ADIL3VTRUVRDAQENLLD5SKDRD3I6RA5CNFSM4INXPBQ2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEMPWGSI#issuecomment-589259593,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ADIL3VQI6GK4UQ6MYR2NCCLRD3I6RANCNFSM4INXPBQQ
.

Revised process reflecting Brenda's comments;
A transcriber receives an assignment from their coordinator and prepares a csv file using spreadsheet software following currently established practices. The transcribers uploads their csv file to CEN2 when ready. They will receive a report from CEN2 somewhat along the lines of that produced by CSVCHECK. The transcriber corrects their csv file on their computer and uploads a replacement file. They again receive a report. This can be repeated until the transcriber is satisfied with the quality of their work and wishes it to go to the next stage. ( Note they could do their transcribing and checking incrementally if they wished rather than waiting until it is all transcribed.)
They inform their coordinator when the csv file is ready for proofreading. The coordinator assigns a proof reader to review the file. The proof reader downloads the csv file file, the last processing report and any other files they need. They following a similar process of off line editing and uploading until they are satisfied. The proof reader informs the Coordinator that the file is ready for validation. The coordinator assigns a validator (Often the Coordinator themselves or one of their
trusted helpers that the Coordinator has trained) who follows the same process as the proofreader of downloading the csv file, the report and any other files they need. The validator inform the coordinator when they are satisfied with the file. At that point the Coordinator does any final validations and when satisfied indicates to CEN2 that the csv file can be processed into the database.
In this process there is only a csv file. No format changing is required. Each version of the csv file and its associated report would be archived on replacement thereby maintaining a complete history of what had been done to the file.

Transcriber, checkers and validators can upload and replace their CSV files.#121 identified.

What fields are in the VLD which are not in the CSV?

Example and explanation below from a transcribed CSV to its final format as a VLD
Please find attached all the files through to the VLD for a PIECE from Bedford (BDF) for 1861 census.

The ZIP is a copy showing all the columns that the VLD has and associated files.
(I have not included a CHE as this was not done using WINCC)

We can put the VLD in FCTOOLS and convert it back to a CSV to do any corrections/amendments.

We can then do the corrections/amendments and convert it back to a VLD using FCTOOLS.

Th ‘Amended VLD’ is then sent to Lemon in a sperate folder by CHP.
That is to ensure that he knows to delete the one current ONLINE and then replace it with the AMENDED one.
If he did not do that, then it would fail as a duplicate and the amended one will not get processed.

The 2 files  called ERD & ERC are just a summary we get that should show any errors or not  whatever the case may be etc.  Just click on them are they will open in NOTEPAD.

The separate CSV is the ‘transcribed copy ‘ before it goes to the PROOF READER.

a.	The TXT is the report from the CSVCHECK program.
Anything else you need let me know.
Brenda
From: PatReynolds<EMAIL_ADDRESS>Sent: 04 March 2020 17:38
To: FreeUKGen/FreeCENMigration<EMAIL_ADDRESS>Cc: Brenda<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [FreeUKGen/FreeCENMigration] Develop plan for moving update of FreeCen2 from FC1 update to direct update (#728)
What fields are in the VLD which are not in the CSV?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub https://github.com/FreeUKGen/FreeCENMigration/issues/728?email_source=notifications&email_token=ADIL3VWACI3FXV6TRZ5Y6C3RF2GYVA5CNFSM4INXPBQ2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOENZEGVY#issuecomment-594690903 , or unsubscribe https://github.com/notifications/unsubscribe-auth/ADIL3VT5DJ7CQTLASDBCUGDRF2GYVANCNFSM4INXPBQQ .
Error listing for csv2dat (Rick Parsons) v4.11.2 Fri Dec 18 14:18:38 2015 UTC converting D:\fctools\TMP\RG090991.CSV
[When reporting program errors, be sure to send this file and the original data file]
Census year = 1861, input format = SS-CENS, output format = IN-CENS
Subtract 3 from row numbers in messages to get the corresponding record in the output file.
Warning: row 322, page number = 15 not sequential  Page 14 is deleted
Warning: row 346, page number = 17 not sequential  Page 16 is deleted
Warning: row 372, page number = 19 not sequential  Page 18 is blank
Warning: row 397, page number = 21 not sequential  Page 20 is blank
Warning: row 422, page number = 23 not sequential  Page 22 is blank
Output 6825 records, highest household number = 1643
Output file is D:\fctools\TMP\rg090991.dat


colon missing in csv

E0514 18:35:01.288729       1 reconcile_operand.go:133] Failed to convert alm-examples in the subscription ibm-auditlogging-operator to slice: invalid character '"' after object key
E0514 18:35:01.288762       1 reconcile_operand.go:74] Failed to get create or update custom resource: invalid character '"' after object key

after fix:
I0514 19:01:50.251920       1 operandrequest_controller.go:277] Add finializer to the OperandRequest audit in the namespace ibm-common-services
I0514 19:01:50.262036       1 reconcile_operator.go:39] Reconciling Operators
I0514 19:01:50.316761       1 reconcile_operator.go:149] Creating the Subscription: ibm-auditlogging-operator
I0514 19:01:50.353480       1 reconcile_operator.go:117] Finished reconciling Operators
I0514 19:01:50.353524       1 operandrequest_controller.go:214] Waiting for subscriptions to be ready ...
I0514 19:02:10.396498       1 operandrequest_controller.go:268] Subscription: ibm-auditlogging-operator, state: Ready
I0514 19:02:10.406621       1 reconcile_operand.go:40] Reconciling Operands
I0514 19:02:13.508932       1 reconcile_operand.go:311] Finish creating the Custom Resource: auditLogging
I0514 19:02:13.540194       1 reconcile_operand.go:83] Finished reconciling Operands
I0514 19:02:13.555309       1 operandrequest_controller.go:135] Reconciling OperandRequest audit in the namespace ibm-common-services
I0514 19:02:13.580405       1 reconcile_operator.go:39] Reconciling Operators
I0514 19:02:13.588246       1 reconcile_operator.go:117] Finished reconciling Operators
I0514 19:02:13.588276       1 operandrequest_controller.go:214] Waiting for subscriptions to be ready ...
I0514 19:02:13.697124       1 operandrequest_controller.go:268] Subscription: ibm-auditlogging-operator, state: Ready
I0514 19:02:13.719599       1 reconcile_operand.go:40] Reconciling Operands
I0514 19:02:13.975329       1 reconcile_operand.go:83] Finished reconciling Operands```

/lgtm


Fix Fedex remote tests

Updates the tracking tests with tracking numbers that actually work.
These are all test tracking numbers from FedEx.
@kmcphillips

:+1:


Level.String panics if Level == InvalidLevel

hi,
the method LeveL.String panics when Level==InvalidLevel.
https://github.com/apex/log/blob/master/levels.go#L44
https://github.com/apex/log/blob/master/levels.go#L17
I suggest to add a statement before the slice access so that this pseudo value does not appear in the levelNames / levelStrings variables.
It could return an empty string or something like invalid

👍 sounds good to me


Adjust memory/CPU configurations automatically in container

Signed-off-by: zhangjinpeng1987<EMAIL_ADDRESS>
What have you changed?

Fix https://github.com/tikv/tikv/issues/3923
Fetch the memory limits and CPU quota in the container environment, adjust memory and CPU related configurations automatically.
The implementation of cgroup part refers to https://github.com/uber-go/automaxprocs/tree/master/internal/cgroups

What is the type of the changes?

Improvement (a change which is an improvement to an existing feature)

How is the PR tested?

Unit test
Manual test on k8s

Does this PR affect documentation (docs) or should it be mentioned in the release notes?

No
Does this PR affect tidb-ansible?

No
Refer to a related PR or issue link (optional)
Benchmark result if necessary (optional)
Any examples? (optional)
Release Note
Get memory limit and CPU quota from the cgroup system, and then adjust TiKV's configurations.

@tennix PTAL

/release

/release

/release

/release

/release

@zhangjinpeng1987 I think this also affects tidb-ansible, since tidb-ansible supports using systemd to limit process cpu quota and memory https://github.com/pingcap/tidb-ansible/pull/563 https://github.com/pingcap/tidb-ansible/pull/721. This change can also helps avoid configuring block-cache and concurrency manually or in the tidb-ansible script.
Note: systemd also uses cgroups to limit CPU and memory for a process.

@zhangjinpeng1987 I think this also affects tidb-ansible, since tidb-ansible supports using systemd to limit process cpu quota and memory pingcap/tidb-ansible#563 pingcap/tidb-ansible#721. This change can also helps avoid configuring block-cache and concurrency manually or in the tidb-ansible script.
Note: systemd also uses cgroups to limit CPU and memory for a process.

@tennix I don't think this change is related to ansible, this change is about the default behaviour of TiKV,   the PRs you mentioned is the manual option we can manipulate with ansible.

/run-cherry-picker


Fix #116 - Name the kubelet container when starting

Fixes #116 by naming the container. Sorry about breaking it before @colemickens. This time around, I deployed, tested, and validated this change on my own cluster and it all works fine.

Hi @jpoon, I'm your friendly neighborhood Microsoft Pull Request Bot (You can call me MSBOT). Thanks for your contribution!

It looks like you're a Microsoft contributor (Jason Poon). If you're full-time, we DON'T require a Contribution License Agreement. If you are a vendor, please DO sign the electronic Contribution License Agreement. It will take 2 minutes and there's no faxing! https://cla.microsoft.com.

TTYL, MSBOT;

Accidentally closed this.
jason@k8s-master-25142663-0:~$ systemctl stop kubelet.service
jason@k8s-master-25142663-0:~$ systemctl status kubelet.service
● kubelet.service - Kubelet
   Loaded: loaded (/etc/systemd/system/kubelet.service; enabled; vendor preset: enabled)
   Active: failed (Result: exit-code) since Thu 2016-12-15 20:00:38 UTC; 5s ago
  Process: 11965 ExecStop=/usr/bin/docker stop -t 2 kubelet (code=exited, status=0/SUCCESS)
 Main PID: 5568 (code=exited, status=143)

Dec 15 20:00:23 k8s-master-25142663-0 docker[5568]: I1215 20:00:23.419937    6170 conversion.go:134] failed to handle multiple d
Dec 15 20:00:23 k8s-master-25142663-0 docker[5568]: I1215 20:00:23.420020    6170 conversion.go:134] failed to handle multiple d
Dec 15 20:00:33 k8s-master-25142663-0 docker[5568]: I1215 20:00:33.469447    6170 conversion.go:134] failed to handle multiple d
Dec 15 20:00:33 k8s-master-25142663-0 docker[5568]: I1215 20:00:33.469467    6170 conversion.go:134] failed to handle multiple d
Dec 15 20:00:37 k8s-master-25142663-0 systemd[1]: Stopping Kubelet...
Dec 15 20:00:38 k8s-master-25142663-0 docker[11965]: kubelet
Dec 15 20:00:38 k8s-master-25142663-0 systemd[1]: kubelet.service: Main process exited, code=exited, status=143/n/a
Dec 15 20:00:38 k8s-master-25142663-0 systemd[1]: Stopped Kubelet.
Dec 15 20:00:38 k8s-master-25142663-0 systemd[1]: kubelet.service: Unit entered failed state.
Dec 15 20:00:38 k8s-master-25142663-0 systemd[1]: kubelet.service: Failed with result 'exit-code'.

Docker stop is successful. Not sure why kubelet.service reports a failed status though.

Hi @jpoon, I'm your friendly neighborhood Microsoft Pull Request Bot (You can call me MSBOT). Thanks for your contribution!

It looks like you're a Microsoft contributor (Jason Poon). If you're full-time, we DON'T require a Contribution License Agreement. If you are a vendor, please DO sign the electronic Contribution License Agreement. It will take 2 minutes and there's no faxing! https://cla.microsoft.com.

TTYL, MSBOT;

Running through the start/stop cycle again worked without issue.
jason@k8s-master-25142663-0:~$ systemctl status kubelet.service
● kubelet.service - Kubelet
   Loaded: loaded (/etc/systemd/system/kubelet.service; enabled; vendor preset: enabled)
   Active: inactive (dead) since Thu 2016-12-15 21:06:48 UTC; 3s ago
  Process: 2879 ExecStop=/usr/bin/docker stop -t 2 kubelet (code=exited, status=0/SUCCESS)
  Process: 2875 ExecStart=/usr/bin/docker run --name=kubelet --net=host --pid=host --privileged --volume=/dev:/dev --volume=/sys
  Process: 2872 ExecStartPre=/bin/mount --make-shared /var/lib/kubelet (code=exited, status=0/SUCCESS)
  Process: 2863 ExecStartPre=/bin/mount --bind /var/lib/kubelet /var/lib/kubelet (code=exited, status=0/SUCCESS)
  Process: 2858 ExecStartPre=/bin/sed -i s|<kubernetesHyperkubeSpec>|gcr.io/google_containers/hyperkube-amd64:v1.4.6|g /etc/kube
  Process: 2856 ExecStartPre=/bin/mkdir -p /var/lib/kubelet (code=exited, status=0/SUCCESS)
 Main PID: 2875 (code=killed, signal=TERM)

Dec 15 21:06:37 k8s-master-25142663-0 systemd[1]: Starting Kubelet...
Dec 15 21:06:48 k8s-master-25142663-0 systemd[1]: Started Kubelet.
Dec 15 21:06:48 k8s-master-25142663-0 systemd[1]: Stopping Kubelet...
Dec 15 21:06:48 k8s-master-25142663-0 docker[2879]: kubelet
Dec 15 21:06:48 k8s-master-25142663-0 systemd[1]: Stopped Kubelet.

I don't know why this didn't occur to me before, but I think the simpler fix is flat out removing the ExecStop line. In that case, systemd should treat it as a normal process and kill off the instance of docker run. I'm also wondering if that will avoid hitting the "exit code 143" case that you hit today.

I'd slightly prefer the ExecStop method as it's a tad more graceful giving kubelet a couple seconds to shutdown before killing the process. Researching the 143 error, it seems expected as the exit code implies the application was killed with a SIGTERM.
The end result of both cases is the same and as the impact is fairly minimal in both regard, let me know if you want me to update the PR deleting the ExecStop altogether.

@jpoon - sorry for the delay on this.  We are reviewing now.  Please resolve the conflicts, and add the removal execstop from @colemickens .

Hi @jpoon, I'm your friendly neighborhood Microsoft Pull Request Bot (You can call me MSBOT). Thanks for your contribution!

It looks like you're a Microsoft contributor (Jason Poon). If you're full-time, we DON'T require a Contribution License Agreement. If you are a vendor, please DO sign the electronic Contribution License Agreement. It will take 2 minutes and there's no faxing! https://cla.microsoft.com.

TTYL, MSBOT;

I've updated the PR removing the ExecStop but still naming the kubelet container. I also updated the kubernetes_expected.json but it's not clear to me how to run these tests.

Please run make ci to run the appropriate tests and verifications.
If you're on Windows, please read the Makefile and run the equivalent steps. Thanks.
I'll review and test this in a bit and get it merged.

@colemickens thanks. had to change a few things, git push -f'd and make ci looks all good.

If you remove the ExecStop, then naming the container isn't necessary.
As is, this is very problematic. If you stop kubelet, it can not be restarted because --rm is not present on the docker run invocation.
I don't know what --rm does if systemd stops the container running in FG rather than exitting normally on it's own.
Can we just remove the --name as well?

This doc recommends something different. Can you follow the recommendations here: https://docs.docker.com/engine/admin/host_integration/
Seems the most appropriate thing to do.

@colemickens that was dumb -- sorry about that last commit; just brainlessly edited it.
i added the execstoppost which should be sufficient for post-mortem clean up.

Fixed merge conflicts through rebase and push -f. Changes are the same as last revision. I tested the changes prior to the rebase (ie. 13 days ago) and k8s came up fine.

Please give the container 10 seconds to stop. 2 is too few and it still winds up exiting uncleanly.
Then I'll merge. Thanks @jpoon !

@colemickens it has been done.


🔔 [Request]: Add Clickhouse icon

🔎 Information:

Title: Clickhouse
Category: Database
Source (.svg): https://github.com/ClickHouse/clickhouse-docs/blob/main/static/images/clickhouse.svg
Website: https://clickhouse.com/

📝 Checklist:

[x] I have permission to use this logo.
[x] The link I have provided is optimized for web use.
[x] The size of the SVG is less than 20kb.

I added a PR with this logo request: https://github.com/pheralb/svgl/pull/465


Must display exactly the TRC20 balance

No make sense to show < 0.1 in balance field

Because this is NFT token (TRC721), we do not support before. But now it is ok


feat: implement cyclonedx processor

📝 Description
Implements a CycloneDX Processor. Adding support for a guesser & XML format guesser in a separate PR
https://github.com/guacsec/guac/issues/102

Looks good but doesn't the guesser & XML format guesser a pre-req for this PR?

@lumjjb Should I close this in lieu of https://github.com/guacsec/guac/pull/140?

@cpendery i'd like to have the XML portions be integrated into that once #140 is merged... so don't throw away this code - it's going to be useful still for XML! But yea once that PR is open we'll close up this one

@cpendery i'd like to have the XML portions be integrated into that once #140 is merged... so don't throw away this code - it's going to be useful still for XML! But yea once that PR is open we'll close up this one

Sounds good, I can add the xml support as soon as https://github.com/guacsec/guac/pull/140 gets merged. I fixed the xml guesser PR which should be ready for review. Thanks @lumjjb


fixing metadata section

this topic showed up in the .NET duplicate title report because of issues with the metadata values

Hi @mairaw, I'm your friendly neighborhood Microsoft Pull Request Bot (You can call me MSBOT). Thanks for your contribution!

It looks like you're a Microsoft contributor (Maira Wenzel). If you're full-time, we DON'T require a Contribution License Agreement. If you are a vendor, please DO sign the electronic Contribution License Agreement. It will take 2 minutes and there's no faxing! https://cla.microsoft.com.

TTYL, MSBOT;

moving this to the private repo


Can't find npm module 'request'

Using this package in a meteor app but I'm getting Can't find npm module 'request' here is the full error any ideas why it's causing a conflict
Error: Can't find npm module 'request'. Did you forget to call 'Npm.depends' in package.js within the 'modules-runtime' package?
1741
2017-01-11 22:54:26-08:00 at Object.require (/app/bundle/programs/server/boot.js:200:17)
1741
2017-01-11 22:54:26-08:00 at options.fallback (packages/modules-runtime.js:445:18)
1741
2017-01-11 22:54:26-08:00 at require (packages/modules-runtime.js:112:16)
1741
2017-01-11 22:54:26-08:00 at meteorInstall.node_modules.node-updown.lib.updown.class.js (packages/modules.js:9786:11)
1741
2017-01-11 22:54:26-08:00 at fileEvaluate (packages/modules-runtime.js:181:9)
1741
2017-01-11 22:54:26-08:00 at Module.require (packages/modules-runtime.js:106:16)
1741
2017-01-11 22:54:26-08:00 at Module.Mp.import (/app/bundle/programs/server/npm/node_modules/meteor/modules/node_modules/reify/lib/runtime.js:70:16)
1741
2017-01-11 22:54:26-08:00 at meteorInstall.imports.api.business-uptime.methods.js (imports/api/business-uptime/methods.js:1:1)
1741
2017-01-11 22:54:26-08:00 at fileEvaluate (packages/modules-runtime.js:181:9)
1741
2017-01-11 22:54:26-08:00 at Module.require (packages/modules-runtime.js:106:16)

The request module should be available on npm. This seems like an issue specific to Meteor. I haven't worked with Meteor myself (and as such haven't tested this with it specifically) but a quick Google search reveals this discussion on the Meteor forum.
Could you try to install Request using meteor npm install --save request and then try again?

Thanks, I believe that has fixed it


Support for Android Feature along with Application and library

Basically the same thing, different place to take attach points from

Hmm, there is already an Android app and library using it. What's the question exactly ?
Btw, you removed the androidDev which used this plugin as code and not like android as library

androidDev: for current development
android: to test build artifact (from previous release)

Yes, I temporary removed an app to test against previous version. It's worth a while to add them back.
My plan was to add them back with a post-release automatic update if it wasn't a release candidate. What do you think about?

Btw this task became a bit bigger when I discovered proper way to attach to different AGP versions. I have no samples though.

Returning to testing vs demos, I wonder if we can just add last line with includeBuild on the fly and get rid of making copies


backfeed facebook Life Events (not currently supported by API)

facebook Life Events (eg got married, new job) look kind of like regular posts, e.g. @aaronpk's https://www.facebook.com/aaronpk/posts/10103825808505996 (original https://aaronparecki.com/2018/03/28/6/hello-okta ), so it'd be nice to backfeed them. i haven't found much in the API on them though. you can get them by id, but User doesn't have any edges to them, and the Graph API Explorer doesn't include them in a /me/feed fetch with all permissions, so i don't know how to get them for a user. (and i don't see any permissions that mention them.)

looks like i can't fetch life events by id from the API either. /11500459_10103825808505996?fields=... returns:
{
  "error": {
    "message": "Unsupported get request. Object with ID '11500459_10103825808505996' does not exist, cannot be loaded due to missing permissions, or does not support this operation. Please read the Graph API documentation at https://developers.facebook.com/docs/graph-api",
    "type": "GraphMethodException",
    "code": 100,
    "error_subcode": 33,
    "fbtrace_id": "A/rxwHCG3pU"
  }
}

...and /10103825808505996 (without user id) returns good old #496, singular statuses API is deprecated for versions v2.4 and higher.

Facebook support is dead (#817, #826), so I'm closing this as obsolete. feel free to reopen if you have any concerns!


Run "dotnet swagger tofile" with .NET 7 SDK

The current dotnet swagger tool cannot run with .NET 7. It shows:
You must install or update .NET to run this application.
App: /root/.nuget/packages/swashbuckle.aspnetcore.cli/6.4.0/tools/net6.0/any/dotnet-swagger.dll
Architecture: x64
Framework: 'Microsoft.NETCore.App', version '6.0.0-rc.2.21480.5' (x64)
.NET location: /usr/share/dotnet/
The following frameworks were found:
  7.0.0 at [/usr/share/dotnet/shared/Microsoft.NETCore.App]
Learn about framework resolution:
https://aka.ms/dotnet/app-launch-failed
To install missing framework, download:
https://aka.ms/dotnet-core-applaunch?framework=Microsoft.NETCore.App&framework_version=6.0.0-rc.2.21480.5&arch=x64&rid=ubuntu.22.04-x64

It would be great to run this tool inside the dotnet/sdk:7.0-jammy, because that is also the container that is run to build the .NET 7 application. Looking at https://www.nuget.org/packages/Swashbuckle.AspNetCore.Cli, it doesn't support net7 yet.

I think #2542 will resolve this when merged?

@domaindrivendev I ran dotnet tool install swashbuckle.aspnetcore.cli --version 7.0.0-preview-2114 --add-source https://www.myget.org/F/domaindrivendev/api/v3/index.json in a mcr.microsoft.com/dotnet/sdk:7.0-jammy container and it seems to run fine. Running the 6.4.0 version shows the missing runtime message, so I guess this is fixed.

@domaindrivendev Is there an ETA for a release that works for .NET 7?

@domaindrivendev - Any update on the .NET 7 release would be great

@domaindrivendev Version 7.0.0-preview-2114 seems to have been removed from myget and this crashes our build. We were relying on it, temporarily, until the official .net 7 version is out. Can it be added back?

@MarianSWA for what it's worth, if you install both .net 6 and 7 on build agent, you should still be able to use the CLI. Or that's what I'm doing. In Azure Pipelines it's just a matter of two UseDotNet-task calls.

Thanks @htuomola, good point! For now we've switched to 6.5.0-preview-2124 from myget which seems to have .net 7 support as well. This leads me to belive that the next version, 6.5.0 will be released soon. Hopefully the preview will not be removed from myget until then.

any updates on releasing a version compatible with .NET 7 that doesn't require both .NET 6 and .NET 7 to be installed on the build agent?

@MarianSWA for what it's worth, if you install both .net 6 and 7 on build agent, you should still be able to use the CLI. Or that's what I'm doing. In Azure Pipelines it's just a matter of two UseDotNet-task calls.

Thanks @htuomola, saved my day...or night :)

@htuomola Hi, I receive an error when trying to execute the command: Could not execute because the specified command or file was not found.
Possible reasons for this include:

You misspelled a built-in dotnet command.
You intended to execute a .NET program, but dotnet-swagger does not exist.
You intended to run a global tool, but a dotnet-prefixed executable with this name could not be found on the PATH.

I added it to the pipeline, changing the .net version. Any ideas?

@angieleba are you executing dotnet tool install or dotnet tool restore to install swagger-cli? And it installs it without errors? There shouldn't be more to it.


Return 410 code when a question is deleted

Problem

When questions get deleted for whatever reason, that URL becomes a 404. Over time, it'll generate a lot of 404s, which I'd like to avoid.

Solution

If a question is deleted, we should return a 410 status, which indicates the page no longer exists and won't be replaced.

Updated this issue @smallbrownbike as it was somewhat out of date. Note at all urgent, but would be sensible thing to do when you get a spare moment.


⚠ Aither has degraded performance

In 5a6a41a, Aither ($AIH) experienced degraded performance:

HTTP code: 200
Response time: 4314 ms

Resolved: Aither performance has improved in 6c7c7fd.


md49_base_controller: 0.1.4-0 in 'groovy/distribution.yaml' [bloom]

Increasing version of package(s) in repository md49_base_controller to 0.1.4-0:

upstream repository: https://github.com/Scheik/md49_base_controller.git
release repository: https://github.com/Scheik/md49_base_controller-release.git
distro file: groovy/distribution.yaml
bloom version: 0.5.20
previous version for package: null

md49_base_controller
* No changes, keep release on track with md49_base_controller
* Contributors: Fabian Prinzing

md49_messages
* No changes, keep release on track with md49_base_controller
* Contributors: Fabian Prinzing

md49_serialport
* Update md49_serialport CMakeLists.txt: Marked header files for installation
* Contributors: Fabian Prinzing

We don't build packages for Groovy anymore. Please release for a current distribution (either Indigo or Jade).


no sound on windows

running in Docker version 20.10.22, build 3a2c30b on windows 10, youtube videos will play but there is no audio output

Currently on mobile, but I believe you can get it to work by adding -e PULSE_SERVER right after docker run (but before fathyb/carbonyl).
If it doesn’t work you might have to search how to enable audio in Docker for your installation type. (it’s independent from Carbonyl)

No sound here on MacOS 13.2.1 too. I tried adding the pulse server tag right after docker run, but audio still did not work.


Preparing to release 4.0.0

/cc @Titan-C @contrapunctus @cireu @jethrokuan @r0man @md11235 @manateelazycat @hyatt
I plan to release EmacSQL 4.0.0 toward the end of the month.
The big new feature is the addition of two new SQLite backends. emacsql-sqlite-builtin uses the built-in support in upcoming Emacs 29, provided that wasn't disabled when configuring the build.  As a fallback, the new emacsql-sqlite-module can be used when Emacs was built with support for modules.  It uses the module provided by the sqlite3 package.
These backends should be preferred over the existing emacsql-sqlite backend, which uses a custom binary, which is slower and more prone to failure.  But it is a good final fallback and I don't intend to remove it any time soon, though eventually I probably will.
Users should not have to worry about which backend they use, which makes it necessary that packages are modified lightly.  In most cases this should be as simple as:
 (defun demo-db (file)
   (or demo-db
-      (setq demo-db
-           (make-instance 'emacsql-sqlite :file file))))
+      (setq demo-db (emacsql-sqlite-open file))))

If you already have added an option to allow users to pick a backend, you should remove that to ensure that the best backend is used. emacsql-sqlite-default-connection is used to determine that.
The other big change is that going forward all backends are distributed with the emacsql package itself.  If we didn't do that, then all packages that want users to use the best available SQLite backend would have to depend on emacsql, emacsql-sqlite, emacsql-sqlite-module and emacsql-sqlite-builtin, which would be silly. (See https://github.com/melpa/melpa/commit/4872ef038dbbf67008bfa7951574ee372d6ff68d for why we include all backends.)
The emacsql packages on Melpa and NonGNU-devel Elpa started to include all libraries a little while ago, but for the time being the backends continue to also be available as separate packages.  That's not a good situation, but in this transitional phase it is necessary to prevent packages that depend on emacsql-sqlite from breaking.  That being said, we should complete the transition as soon as possible.
So please update the dependencies, like so now:
-;; Package-Requires: ((emacsql "3.1.1") (emacsql-sqlite "3.1.1"))
+;; Package-Requires: ((emacsql "20230228"))

That is, drop the dependency on emacsql-sqlite and temporarily depend on the Melpa snapshot version of emacsql.  Doing the latter ensures that, along with your package, users update to a version of emacsql that contains emacsql-sqlite and the new backend libraries.
After depending on the snapshot, you also won't be able to create a new release until I have released EmacSQL 4.0.0, i.e. later this month (and of course you could create a release just before starting to depend on the snapshot).  When you create the first new release after EmacSQL 4.0.0 was released, you will have to make sure to change from the snapshot version to 4.0.0.

Thank you for maintaining MELPA, magit, and other things. I have understood your point described in this thread.

As a fallback, the new emacsql-sqlite-module can be used when Emacs was built with support for modules. It uses the module provided by the sqlite3 package.

Now that the snapshot version of emacsql package contains both emacsql-sqlite-builtin.el and emacsql-sqlite-module.el, which depend on sqlite.el and sqlite3.el respectively, how should an Emacs package manager handle those dependencies?
For example, Emacs 29 will choose emacsql-sqlite-builtin so it shouldn't require sqlite3 package, but is it possible for package.el to conditionally install the dependency? I don't know of any mechanism to allow specifying conditional dependencies in Emacs Lisp, but is it possible?
I am working on an alternative package manager for Emacs, so I would like to know how the package is supposed to be built and distributed to its users.

For example, Emacs 29 will choose emacsql-sqlite-builtin so it shouldn't require sqlite3 package, but is it possible for package.el to conditionally install the dependency? I don't know of any mechanism to allow specifying conditional dependencies in Emacs Lisp, but is it possible?

Unfortunately there's no such mechanism. So sqlite3.el along with some other files will always be installed. This is Melpa's recipe:
(sqlite3 :fetcher github
         :repo "pekingduck/emacs-sqlite3-api"
         :files (:defaults
                 "Makefile"
                 "consts.c"
                 "emacs-module.h"
                 "sqlite3-api.c"))

But that is acceptable. package.el won't actually attempt to build the module until sqlite3 is required. The above files sit around doing nothing, but they don't take up much space.

I am working on an alternative package manager for Emacs, so I would like to know how the package is supposed to be built and distributed to its users.

A gnu/linux or bsd distribution should probably only include the emacs-sqlite-* suitable for the emacs version they currently provide. The other extreme are package managers like package.el and my borg, which are quite a bit dumber, and have to resort to installing all backends and their dependencies. (Actually borg is even dumber and doesn't handle dependencies at all, so it is up to the user to decide whether to install sqlite3 or not.)
I don't know where your package manager falls on that spectrum, but my guess is that it would be best (and certainly simplest) to just install sqlite3. If your package manager makes sure to compile all modules when a package that ships in is installed, then it might be worth considering dropping the dependency when using emacs 29. On the other hand, the user might go back to emacs 28 for some reason and then it would be nice if sqlite3 were already installed.

A gnu/linux or bsd distribution should probably only include the emacs-sqlite-* suitable for the emacs version they currently provide.

Is it fine to even eliminate emacsql-sqlite-module.el from the output for Emacs 29? Without the dynamic module for sqlite3.el, the library fails to byte-compile, so one solution is to ignore the file and remove entirely from the output. If it is possible, it will save time on byte-compiling sources ahead of loading, which is done by some package managers (e.g. straight.el and mine).
My package manager can be as flexible as the user wants it to be, because it allows working around using Nix, which is a turing complete language.

Is it fine to even eliminate emacsql-sqlite-module.el from the output for Emacs 29?

It is fine if you know that no Emacs 29 user will ever go back to 28. Does your package manager have a "I am switching Emacs version, recompile all installed packages using the one I am switching to" command, and users are aware that they must always run that when switching?
I (and every other author of an emacs package) sometimes have to switch to old Emacs releases because users insist on sticking to those and occasionally report issues that are not present when using the latest Emacs release.
Right now it would be no problem if emacsql-sqlite-module were missing while being forced to use emacs 28; EmacSQL would just fall through even further to use the old emacs-sqlite backend. But eventually I would like to remove that backend.

Without the dynamic module for sqlite3.el, the library fails to byte-compile, so one solution is to ignore the file and remove it entirely from the output.

What library? emacsql-sqlite-module.el should compile just fine. Maybe we should add no-byte-compile: t to sqlite3.el.

Does your package manager have a "I am switching Emacs version, recompile all installed packages using the one I am switching to" command, and users are aware that they must always run that when switching?

My package manager rebuilds all Emacs Lisp packages every time the user updates Emacs. The artifacts are stored in a centralized Nix store, so multiple versions can exist simultaneously. Byte/native-compiling can be turned off, if the user wants to.

What library?

I am talking about emacsql-sqlite-module.el. It is possible to extend it to remove emacsql-sqlite-module.el for Emacs 29 and emacsql-sqlite-builtin.el for Emacs 28 or before.

emacsql-sqlite-module.el should compile just fine. Maybe we should add no-byte-compile: t to sqlite3.el

Yes, it's probably sqlite3.el which failed to byte-compile.

Sounds like I might have to do another round of testing. I probably won't do that today.

It is possible to extend it to remove emacsql-sqlite-module.el for Emacs 29 and emacsql-sqlite-builtin.el for Emacs 28 or before.

Err, I have to ask again what "it" refers too. Sounds like you are asking whether emacsql-sqlite-module.el can be extended to remove itself?!
In any case, I don't EmacSQL can remove parts of itself (how would that even work)--you would have to do that in the nix package build steps.

Err, I have to ask again what "it" refers too. Sounds like you are asking whether emacsql-sqlite-module.el can be extended to remove itself?!

Sorry for this. I meant extending my package manager.

@tarsius I just updated the paimon.el package to use the latest snapshot versions of closql and emacsql.

Note to self: don't forget to update the documentation before release.

[ ] Packages won't be split up the same as they are now.

v4.0.0 is finally out! I'll write to write an announcement next week.

There now is only one package emacsql. All the emacsql-* still exist, to prevent users from getting stuck on old versions, but all they do now, is to instruct users to uninstall them.
There is only one package left, which still depends on one of these back-end packages.
@Titan-C, please drop the dependency on emacsql-sqlite from cardano-tx.


bcm283x: Follow-up on #440: Updated DMA documentation

Constants refactoring (fixed comment on last PR and replaced the "4" by a constant)
Added documentation about the DMA channel.
Thanks!

Codecov Report

Merging #441 into master will increase coverage by 0.00%.
The diff coverage is 25.92%.

@@           Coverage Diff           @@
##           master     #441   +/-   ##
=======================================
  Coverage   63.48%   63.49%
=======================================
  Files         122      122
  Lines       12554    12554
=======================================
+ Hits         7970     7971    +1
+ Misses       4361     4360    -1
  Partials      223      223

Impacted Files
Coverage Δ

host/bcm283x/dma.go
43.34% <25.92%> (ø)

devices/lepton/lepton.go
87.19% <0.00%> (-1.22%)
:arrow_down:

host/sysfs/thermal_sensor.go
83.84% <0.00%> (+2.30%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 844755e...2a685a3. Read the comment docs.

gohci

Thanks!


how to config action of double click mouse with two fingers

Hello,
I want to change the action of double click mouse with two fingers.
(current action opens mission control, I want to change it to open Application window)
I found mouse left/right/middle keycode in KeyCode.data. But I didn't find keycode about double click mouse with two fingers. How can I change the action of double click mouse with two fingers.
thank you

Karabiner is mostly for key customize, doesn't have deep mouse customize.
You can look into "Better Touch Tool" for gesture customize.

thx for reply. I found MagicPrefs for my requirement


Add a terraform (imperative) action

The user can specify a WorkingDir which is a terraform root where the .tf files (in this case azure.tf) are expected to live (and where terraform.tfstate and .terraform folders will be output).  No ability to
destroy resources.

Closing in favour of #300


[Breaking Change] REP 2000019 - SetPaymJnlLine

When moving our 'BE' app to v16, I get breaking changes :

The event 'OnBeforeSetPaymJnlLine' is not found in the target

Used Microsoft_Base Application_16.0.11240.12362 BE symbols
Seems like #2772 has dissappeared?

Please provide event publisher OnBeforeSetPaymJnlLine with Handled pattern in function SetPaymJnlLine, report 2000019.
SetPaymJnlLine()
OnBeforeSetPaymJnlLine(VendLedgEntry, Handled); // NVTBE
IF Handled THEN
EXIT;
WITH PaymJnlLine DO BEGIN
Signature
LOCAL [IntegrationEvent] OnBeforeSetPaymJnlLine(VendorLedgerEntry : Record "Vendor Ledger Entry";VAR Handled : Boolean)
Event will be used to skip adding certain Payment Journal Lines._

We have this in Master and 16.x, but it was reimplemented AFTER branching for 16.0, so it will be available in 16.1.

[IntegrationEvent(false, false)]
local procedure OnBeforeSetPaymJnlLine(VendLedgEntry: Record "Vendor Ledger Entry"; var IsHandled: Boolean)
begin
end;


Fix Nats Failed to Unmarshal MQTT Data

Fix the following error
mainflux-mqtt             | {"level":"warn","message":"Failed to unmarshal received message: proto: cannot parse invalid wire-format data","ts":"2023-10-25T06:44:27.506603048Z"}

A possible reason behind it is the failure to decode Payload data to MF Message

When I debug I saw, that NATS resend a raw message from the MQTT client (not message.proto)

It received 2 messages, one from Mqtt (with raw format from clients) and another from NATS publisher (after converting to messaging struct)

@dborovcanin and @arvindh123  please take a look at this issue

NATS clients also receive messages from MQTT, so to fix this issue I think we need to separate MQTT Broker and NATS Message into two (don't use the same NATS)
cc: @dborovcanin, @arvindh123

Hello, @nintran52,

To fix this issue I think we need to separate MQTT Broker and NATS Message

This is true. However, we have separated it in v0.14.0 by reverting the VerneMQ to be the default MQTT broker. There are other reasons for that, such as that NATS does not support the full range of MQTT 3.1 features and it would limit our MQTT support, as well as support for protocols that are built on top of MQTT (such as Sparkplug).

Closing the issue since it was caused by using the same instance of NATS for Proto messages and MQTT messages. We opted for using VerneMQ due to better MQTT support.


select count() left antijoin returns inconsistent, orders of magnitude lower result with mini-batch enabled normally

testing flink release-1.15.0-rc1-fentik 8644cf2
running python -m stream.flink.test.flink_regression_test --postgres --audit --parallelism=2 stream/flink/test/sql/products_not_ordered_LeftAntiJoin_pk_on_left.sql 2>&1 | tee -a stream/flink/test/sql/products_not_ordered_LeftAntiJoin_pk_on_left.sql.1.out
[2022-10-11T18:31:32.699+0000 INFO flink_api] Configuring the Flink Job for the model.
[2022-10-11T18:31:32.699+0000 INFO flink_api] Turning off checkpoints since flink in its infinite wisdom does not stream results if we turn on checkpoints.
[2022-10-11T18:31:32.699+0000 INFO flink_api] Running in sql client:
CREATE CATALOG `regression-test-catalog` WITH ('type'='hive', 'hive-version'='3.1.2', 'hive-conf-dir'='/opt/hive/conf');
USE CATALOG `regression-test-catalog`;
USE source_1;
SET pipeline.name='regression_test_401cf587';
SET table.exec.sink.not-null-enforcer='DROP';
SET table.optimizer.agg-phase-strategy='ONE_PHASE';
SET parallelism.default='2';
SET table.exec.source.cdc-events-duplicate='true';
SET table.exec.mini-batch.enabled='true';
SET table.exec.mini-batch.allow-latency='3 s';
SET table.exec.mini-batch.size='25000';
SET sql-client.execution.result-mode='TABLEAU';
SET sql-client.display.max-column-width='10000';
 select count(1) from product where id not in (select product_id from order_items);

[2022-10-11T18:31:43.451+0000 INFO flink_regression_test] +I ['358']
[2022-10-11T18:31:48.457+0000 INFO flink_api] Canceling existing Flink job regression_test_401cf587 running on <IP_ADDRESS>
...
__main__.ResultMismatchError: postgres 1 unique rows:
10404
dataflo 1 unique rows:
358

if I remove the count() and instead select several columns from order_items, the test passes.
disabling mini-batch, setting mini-batch size to 5, or enabling batch-backfill mode all allow the test to pass.
the same situation obtains for stream/flink/test/sql/orders_in_product_frac_LeftAntiJoin_pk_on_right.sql, which is a slightly more complex query with a CTE (to create a subset of products, such that we have orders with no matching product), but otherwise the query is the same form.
also, there should be no orders without matching product (hence why I created the CTE to force that condition), but dataflo also gets this wrong now:
select count(1)
from order_items where product_id not in (select id from product);
__main__.ResultMismatchError: postgres 1 unique rows:
0
dataflo 1 unique rows:
401

and that number from dataflo is again inconsistent, bouncing around between 100-500.

the issue here is the same as described here -- after spitting out an initial answer after just a few seconds, it eventually produces the correct answer about 4 minutes later.  I just wasn't waiting long enough for it.
 select count(1) from product where id not in (select product_id from order_items);

[2022-10-11T21:48:12.433+0000 INFO flink_regression_test] +I ['683']
[2022-10-11T21:52:06.469+0000 INFO flink_regression_test] -U ['683']
[2022-10-11T21:52:06.469+0000 INFO flink_regression_test] +U ['10404']
[2022-10-11T21:57:06.474+0000 INFO flink_api] Canceling existing Flink job regression_test_d8ffd1e7 running on <IP_ADDRESS>
[2022-10-11T21:57:06.479+0000 INFO flink_regression_test] postgres result
[2022-10-11T21:57:06.479+0000 INFO flink_regression_test] 10404
[2022-10-11T21:57:06.479+0000 INFO flink_regression_test] PASSED


Normalize Input Data

Input data should have zero mean and identity variance.
Note: mean, and variance should be computed from the training set ONLY, and then subtracted from the training, validation and test sets.
http://cs231n.github.io/neural-networks-2/#datapre

This functionality should be left out for now. But it may be interesting to consider later in the project. Moved to the next milestone.

This could be considered in the future, but will not be part of the thesis work. Removed from milestone.


Failed to list *v1.ApisixRoute: apisixroutes.apisix.apache.org is forbidden

When i try to define a route through ApisixRoute, i get following error:
E0909 10:34:29.424696       1 reflector.go:125] pkg/mod/k8s.io/client-go@v0.0.0-20190819141724-e14f31a72a77/tools/cache/reflector.go:98: Failed to list *v1.Endpoints: endpoints is forbidden: User "system:serviceaccount:cloud:default" cannot list resource "endpoints" in API group "" at the cluster scope
E0909 10:34:29.425328       1 reflector.go:125] pkg/mod/k8s.io/client-go@v0.0.0-20190819141724-e14f31a72a77/tools/cache/reflector.go:98: Failed to list *v1.ApisixRoute: apisixroutes.apisix.apache.org is forbidden: User "system:serviceaccount:cloud:default" cannot list resource "apisixroutes" in API group "apisix.apache.org" at the cluster scope

I create a new user to fix this.

ok, we can close this issue now .


Add constructors in JedisCluster for just one node

As there is nodes auto discovering in JedisCluster, I believe to be useful a constructor who receives only one node. Something like this:
JedisCluster cluster = new JedisCluster(new HostAndPort("<IP_ADDRESS>", 7777));

Best regards!

LGTM.


fix: add slash in DEFAULT_ESCAPED_CHARS (#312)

Add slash(/) in DEFAULT_ESCAPED_CHARS to fix #312.

@ninoseki Thanks for Thanks for fixing this bug!

Codecov Report

Merging #376 (02b6c53) into main (551429c) will not change coverage.
The diff coverage is 100.00%.

@@           Coverage Diff           @@
##             main     #376   +/-   ##
=======================================
  Coverage   78.53%   78.53%
=======================================
  Files          14       14
  Lines        1160     1160
=======================================
  Hits          911      911
  Misses        249      249

Flag
Coverage Δ

unit
78.53% <100.00%> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

aredis_om/model/token_escaper.py
92.30% <100.00%> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


adding env vars

What this PR does / why we need it:
Enable users to set environment variables to init and worker containers. Used same implementation in Katib here
Which issue(s) this PR fixes (optional, in Fixes #<issue number>, #<issue number>, ... format, will close the issue(s) when PR gets merged):
Fixes #2284
Checklist:

[ ] Docs included if any changes are user facing

Pull Request Test Coverage Report for Build<PHONE_NUMBER>1
Details

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 100.0%

Totals

Change from base Build<PHONE_NUMBER>4:
0.0%

Covered Lines:
66

Relevant Lines:
66

💛  - Coveralls


Regex not working for chat highlights.

Checklist

[X] I'm reporting a problem with Chatterino
[X] I've verified that I'm running the most recent nightly build or stable release
[X] I've looked for my problem on the wiki
[X] I've searched the issues and pull requests for similar looking reports

Describe your issue
The highlight and play a sound isnt working for the regex messages, this regex is correct for the 2 phrases below it and works with the "Ignores" messages, but nothing happens when i use it to try and highlight/play a sound for it
Both Regexes tried:
(^TwitchLit A wild ([a-zA-Z]+) appears TwitchLit Catch it using !pokecatch (winners revealed in 90s))
(^TwitchLit\sA\swild\s([a-zA-Z]+)\sappears\sTwitchLit\sCatch\sit\susing\s!pokecatch\s(winners\srevealed\sin\s90s))
Messages:
TwitchLit A wild Delibird appears TwitchLit Catch it using !pokecatch (winners revealed in 90s)
TwitchLit A wild Aipom appears TwitchLit Catch it using !pokecatch (winners revealed in 90s)
Screenshots

OS and Chatterino Version
Chatterino 2.3.5 (commit 81a62764c) , Windows 10 Pro up to date

https://regex101.com/r/RRNoMM/1
You need to escape ( and ) because they have a job to do already in regex

another question, have you tested this in Chatterino?
because either you did and im really dumb or you didnt and it is still not working even with the escaped (  )..

thanks, for some reason its working fine today, but it wasnt before, still doesnt play the sound but that may be a sound file problem.


Search feature not working in 0.3.0

The globe disappears and errors appear in the console.

Fixed in commit 80dc61c1bff43b64df0301255052626299b4c225


not loading properly

whenever i load the editor everything is white, i can only see outlines of boxes

This is by design. It can't show any of the images from the game because it can't detect that you have the game installed. Please try the latest version, as I have added support for more versions of the game. Regardless if you have the game installed or not, it should still be able to open your save files and edit them, it just won't look as cool or be as user friendly.


Cannot auth Python SDK into VCenter.

[X ] I am using the latest SDK version
[X ] This API is compatible with my vCenter version (You can get the info from 'vcenter_version' in each sample)
[ X] I have searched existing issues and Troubleshooting wiki

Environment
vSphere-Automation-SDK             1.25.0
Python 3.8.2
vSphere version: 6.7.0

Operating System/Shell (used to run SDK-based apps):
Linux

##Issue
We can use the sdk against 1 VCenter system and provision resources.  But another one we keep getting user auth failed, even though the API user we are using is configured as an admin in VCenter.  Can you help in determining which auth/role settings may be missing?

Can you be more clear? Here, "another one" means another user or another VC?

My apologies - for the "another one" that is working, its a completely different VC, with a completely different set of user credentials.  The odd thing is the VC I am able to get the SDK to work with, the credentials do not have admin level access.
The user credentials for the VC that I cannot get the SDK to work on has admin level set for the credentials.  Im positive the user/pass combo is correct, as if i intentionally give a different password I then get a different error message of "authentication required".  When I try to use the SDK with the correct user/pass then I get "not authorized", so I'm pretty sure that I have the right credentials - its just there is something in VC that is not allowing it.  Thanks!

Thanks for the clarification.
Can you share the code snippet? The login step to be more specific. And the error stack too.

Here is the login config that works on other VCenters with other credentials:
session = requests.session()
session.verify = False # SSL cert verification
urllib3.disable_warnings(urllib3.exceptions.InsecureRequestWarning) # Disable a ssl cert error warning
client = create_vsphere_client(server=idcs[idc]['API'], username=os.environ['TF_VAR_vsphere_user'], password=os.environ['TF_VAR_vsphere_pass'], session=session)

And the error:
com.vmware.vapi.std.errors_client.InternalServerError: {messages : [LocalizableMessage(id='vapi.bindings.method.impl.unexpected', default_message='Provider method implementation threw unexpected exception: com.vmware.vapi.std.errors.Unauthorized', args=['com.vmware.vapi.std.errors.Unauthorized'], params=None, localized=None), LocalizableMessage(id='com.vmware.api.vcenter.unauthorized', default_message='Not authorized to perform this operation.', args=[], params=None, localized=None)], data : None, error_type : None}

And if i intentionally use the wrong password:
com.vmware.vapi.std.errors_client.Unauthenticated: {challenge : None, messages : [LocalizableMessage(id='com.vmware.vapi.endpoint.method.authentication.required', default_message='Authentication required.', args=[], params=None, localized=None)], data : None, error_type : None}

Since you are sure of admin access and correct user/pass combo, could you try logging in the vsphere ui client?
Just hit the http:///ui in the browser -> verify if you can login with these credentials.
If you get the same error, then something is wrong in the privileges or credentials, but if you're able to login via UI and not via SDK, then we'll have to investigate the SDK

My apologies - the admin of the system got back with me they had something wrong with my account and told me they "really did" make me admin this time and now its working.  sorry to waste time.


(wip): Upgrade from yarn v1 to v4

upgrade yarn from v1 to v4
check and update deps scripts
updated dependencies to latest

Description :sparkles:
Issues :bug:
Testing :alembic:
Screenshots :camera_flash:
Additional notes :spiral_notepad:

Codecov Report

Merging #1476 (d19309f) into develop (d4e0e79) will increase coverage by 29.92%.
The diff coverage is 100.00%.

@@             Coverage Diff              @@
##           develop    #1476       +/-   ##
============================================
+ Coverage    64.97%   94.90%   +29.92%
============================================
  Files         1024      188      -836
  Lines        28155     8298    -19857
  Branches      2949        0     -2949
============================================
- Hits         18294     7875    -10419
+ Misses        9420      423     -8997
+ Partials       441        0      -441

Impacted Files
Coverage Δ

backend/benefit/applications/api/v1/serializers.py
93.60% <100.00%> (+0.01%)
:arrow_up:

backend/shared/shared/azure_adfs/views.py
40.00% <0.00%> (-44.00%)
:arrow_down:

backend/shared/shared/common/tests/__init__.py
66.66% <0.00%> (-33.34%)
:arrow_down:

backend/shared/shared/common/lang_test_utils.py
80.00% <0.00%> (-20.00%)
:arrow_down:

backend/shared/shared/common/tests/conftest.py
86.95% <0.00%> (-13.05%)
:arrow_down:

backend/shared/shared/audit_log/audit_logging.py
87.23% <0.00%> (-12.77%)
:arrow_down:

backend/shared/shared/oidc/auth.py
81.48% <0.00%> (-5.56%)
:arrow_down:

backend/benefit/calculator/api/v1/serializers.py
95.83% <0.00%> (-0.51%)
:arrow_down:

...t/src/components/termsOfService/TermsOfService.tsx

... and 836 more

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


zmap issue on my vps

Mar 18 21:35:31.822 [FATAL] get_gateway: Unexpected hardware address length (0).
If you are using a VPN, supply the --vpn flag (and provide an interface via                                     -i)

im getting this error any fixes?

you can:

get the gateway mac address via arp -a  and paas it to zmap via -G mac_address
zmap can not run on openvz for some reason.
Could you give me more info about your vps? eg: ip address, gateway ipaddress virtual-tech?

i fixed it and just moved host it was a openvz so i moved host thanks tho


Possible improvement to StringConverter

Hi,
I've found that class org.pac4j.core.profile.converter.StringConverter returns null when trying to convert some non-string classes due to its default behavior inherited from AbstractAttributeConverter.
I think this can been improved adding next code to the class:
@Override
protected String internalConvert(final Object attribute) {
if (attribute == null) {
return null;
} else {
return attribute.toString();
}
}
I haven't created a PR since I don't know if the current behavior is what this class is meant to do.

This is the intended behavior. We just want to keep the expected class type (here: String).


Slidnav Documentation Problems

Bug, feature request, or proposal:
Hi, there is a bug in opening the slidenav documentation. You should take a look: https://material.angular.io/components/component/sidenav

It's being tracked here: https://github.com/angular/material2/issues/4969

Dupe of #4969


css adjustments for docs

top bar: reduces/delays the blur effect on the projects menu
scales down table font-size, padding and tweaks styles
fix the left-side indentation on code blocks

I see the data.json is checked in. Can we remove that.

@karthik2804 should I .gitignore that?

Nope, it is required for the search index until we get the CI for it sorted out. Just not commit it with this PR.

This helps enormously - thank you!  Here is what the worst of the tables looks like with this change:

From looking at the sites we shared, I wonder if a possible further improvement would be to reduce the left margin.  I realise we don't want long lines so this would mean increasing the right margin, but that would mean we could show the page TOC at lower window sizes and would have more flexibility to extend tables rightward if need be.  Both Hashi and MS Learn have a slightly wider site TOC, bring their bodies much closer in to that TOC, and leave most of their whitespace to the right (with the page TOC if they have one).  We don't need or want to ape them, of course, but do you think something like that might work for us too...?
Regardless of further tweaks - I will take this in a heartbeat - much appreciated.

@itowlson, do you mean something like this?

@karthik2804  Let me share the comparisons I shared with @flynnduism...
Hashi:

Microsoft:

I feel like the bodies of those are maybe more central than they are in your mockup?  Perhaps assisted by the wider (nested) site TOC?  I am not sure though.  I agree we would not want it too lopsided to the left!


feat: Fir 21174 new identity support

Added support for a new identity flow

pre-commit.ci run

Closing in favour of #59


Make the editor window size inputs be consistent

The input text is now the same size as other inputs and centered.
Before

After

nice!


AttributeError: 'ParseGTF' object has no attribute 'getTranscriptPosition'

Dear,
When I run the command "snakemake --core=10 all", the snakemake environment gives me the following error:
in File "AeronScripts//ThreePrime.py", line 79, in
transtart, transend = gf.getTranscriptPosition(i)
AttributeError: 'ParseGTF' object has no attribute 'getTranscriptPosition'
Indeed, GraphBuilder/ParseGTF.py script file does not define the 'getTranscriptPosition' attribute.
Do you have any suggestions?
Thank you.

Hi,
Thank you for using our tool. Due to some modifications in the tool that part got modified as well. We corrected the error and uploaded the edited version of the ParseGTF file. Can you please do a git pull and try out the new version
I apologize for the inconvenience
regards
Dilip A Durai


custom speaker no audio output

Any more info on your issue? Did you follow the recommendations https://github.com/edwko/OuteTTS?tab=readme-ov-file#speaker-profile-recommendations how long is your speaker clip?


Corpus construction from pandas Dataframes

This could be implemented as a static method in Corpus, i.e. Corpus.from_pandas(...), that takes in three arguments: a speakers dataframe, an utterances dataframe, and a conversations dataframe.
The columns of the dataframes should mirror the primary data fields of the respective components exactly. All additional metadata should be specified in columns that are prefixed with 'meta.' For example, an utterance with a subreddit metadata attribute would have a column called 'meta.subreddit' in the utterances dataframe.

I've picked this up. Will submit a PR soon!

Hi @calebchiam, was hoping you could help with a question I had regarding this issue. I noticed that functionality to read json files for utterances, speakers and conversations and create a corpus is already present. Pandas has an inbuilt "to_json" method which can create those files out of the user's dataframes.
Do you think we could internally create json files from the 3 dfs, read them as a corpus (through corpus directory) as usual? This process could be made into a static method as you suggested. Or do you think this intermediate step of creating json files from dataframes should be avoided? Because if it must be avoided, I think this issue would also have to invariably solve #78. Let me know what you think. Thanks!

Hi @Ap1075, thanks for picking this up. I think we'd want to avoid the intermediate step of creating json files from dataframes because the json file writing process in ConvoKit comes with its own set of complexities and specificities, that would only complicate this from_pandas method.
Instead, we might expect this method to look something like convert_df_to_corpus() in this piece of code -- albeit slightly more complex because it would have to handle conversation and speaker metadata as well. You would not have to solve #78, since that is more about abstracting the metadata update step into its own method, whereas here you can do something much simpler like the metadata initialisation in L41-43 of the linked code. Does that make sense?

Just to add on, the basic structure of this method would probably look something like:

Initialize Speakers from Speaker dataframe
Initialize Utterances (utt_list) from the Utterance data frame, using the Speaker object as an initialization argument for each utterance
Initialize Corpus using Corpus(utterances=utt_list), which initializes the Corpus for you + the Conversation objects.
Add Conversation metadata from dataframe to Conversation objects

Might be missing some smaller steps, but that's the rough idea.

Thanks @calebchiam that does clear things out a lot. I think I might've implemented steps 2 and 3 already for a project using the convert_df_to_corpus function as reference. I'll tie it all together. Thanks again!


🐛 BUG: wrangler pages dev not working with astro <Image /> component in hybrid output mode

Which Cloudflare product(s) does this pertain to?
Pages, Wrangler core
What version(s) of the tool(s) are you using?
3.55.0 [wrangler], 4.8.3 [astro], 10.2.6 [@astrojs/cloudflare]
What version of Node are you using?
20.11.1
What operating system and version are you using?
macOS Sonoma 14.2.1
Describe the Bug
Steps to reproduce

Run npm create cloudflare@latest cloudflare-astro -- --framework=astro.
astro.config.mjs:

import { defineConfig } from "astro/config";
import cloudflare from "@astrojs/cloudflare";

// https://astro.build/config
export default defineConfig({
  output: "hybrid",
  adapter: cloudflare({
    imageService: "compile",
    platformProxy: {
      enabled: true
    }
  })
});

src/pages/index.astro:

---
import Layout from '../layouts/Layout.astro'

import { Image } from 'astro:assets'
---

<Layout title="Welcome to Astro.">
  <main>
    <Image
      src={import('../assets/image.jpg')}
      widths={[250, 500]}
      sizes="250px"
      alt=""
      style="width: 250px; height: auto"
    />
  </main>
</Layout>

Add an image src/assets/image.jpg.
Run npm preview.

This should build the project and then execute wrangler pages dev.
Expected behavior
There should be no errors, as everything works as expected when deploying to Cloudflare Pages.
Observed behavior
wrangler pages dev fails with the errors below.
node_modules/detect-libc is a dependency of the sharp library to optimize the images on build. With output: "hybrid" and imageService: "compile" the images are only optimaized for the static pages at build time and the sharp library is never used in SSR.
Please provide a link to a minimal reproduction
No response
Please provide any relevant error logs
✘ [ERROR] Could not resolve "child_process"
node_modules/detect-libc/lib/detect-libc.js:6:29:
  6 │ const childProcess = require('child_process');
    ╵                              ~~~~~~~~~~~~~~~

The package "child_process" wasn't found on the file system but is built into node.
Add "node_compat = true" to your wrangler.toml file and make sure to prefix the module name with "node:" to enable Node.js compatibility.
✘ [ERROR] Could not resolve "fs"
node_modules/detect-libc/lib/filesystem.js:6:19:
  6 │ const fs = require('fs');
    ╵                    ~~~~

The package "fs" wasn't found on the file system but is built into node.
Add "node_compat = true" to your wrangler.toml file and make sure to prefix the module name with "node:" to enable Node.js compatibility.

Running into the same problem - was able to workaround by moving the built (e.g. with astro, ./dist/*) directory subtree into a separate parent directory that doesn't include  package.json or node_modules. It appears that even though wrangler is being told to just serve the contents of DIRECTORY it still looks into the parents and complains/fails about things it finds in node_modules that are incompatible with the CF runtime.

Probably relevant:
https://github.com/withastro/adapters/issues/213


[html] support style less content

VSCode Version: Version 1.23.1 (1.23.1)
OS Version: mac 10.13.4 (17E199)

Steps to Reproduce:
<style lang="less" type="text/less">
    .chats {
        padding: 30 px;
        .chat {
            display: flex;
            justify-content: space-between;
            align-items: center;
        }
    }
</style>

put this in a html file. editor complains about the syntax. The error tip indicates VSC is using css to parse the code. How do I tell the parser to parse less or do I need some plugin to do this?

Does this issue occur when all extensions are disabled?: Yes/No
Yes

We currently don't support less content in styles. The workaround is to disable css validation in HTML:
"html.validate.styles": false

@aeschli  kkk thanks.


Add new function to obtain connection RSSI info

These changes add support for both ESP32 and Pico-W to obtain the current signal strength (in decibels) of the connection to the associated access point using network:sta_rssi/0.
These changes are made under both the "Apache 2.0" and the "GNU Lesser General
Public License 2.1 or later" license terms (dual license).
SPDX-License-Identifier: Apache-2.0 OR LGPL-2.1-or-later

Nice, I wonder if an percentage signal_percent should be added, similar to nerves networking: https://github.com/nerves-networking/vintage_net_wifi/blob/4496d2b86166c4f0255a5a9d8e5f9ab5a9d1feef/lib/vintage_net_wifi/signal_info.ex#L21
see dbm_to_percent:
https://github.com/nerves-networking/vintage_net_wifi/blob/main/lib/vintage_net_wifi/utils.ex#L17
eg. it's somewhat hard to reason between -25 or -45 which is better and are any of them of marginal quality?

With RF signals a smaller deviation from the theoretical perfect 0 represents a stronger signal to noise ratio the point where the network becomes unusable varies by equipment and environmental factors, but typically below -70 the network will be unusable... in fact the esp-idf has a default lower limit where it will terminate the connection and emit a network disconnected event. An interesting future feature to add would be the ability to adjust the RSSI threshold.