Update the readme and add documentation

I was hoping I could dump the sphinx generated website which I used for documentation. I'll see about getting the documentation hosted somewhere. In the meantime I can update the readme to have some more detailed information about the project.

@lukecampbell, having some documentation would be great ... I would also suggest that if you could compile one or two of the presentations you've already given, that demonstrated the use of the code, that would be a helpful documentation that's hopefully easy to add -- either as a file dump or simply a link on the README file to wherever the presentation files exist. Thanks.

@lukecampbell, how is the documentation that was mentioned at the QARTOD DMAC call on Monday coming along? Pinging @tslawecki, to keep him in the loop.

@benjwadams is wrapping up the documentation using sphinx as I type this. Hopefully tomorrow.

Great, thanks!

Luke, have been testing qc.py using anaconda in a iPython notebook and had some problems with type mismatches using the rate_of_change_check.  My time variable was in an numpy array of numbers as seconds since Jan 1 1970.  I could not use as is but computed a diff of the values and then typed the the result as 'timedelta64[s]' .  If I didn't do this I got errors about ufunc not able to do the division due to wrong types.  The type of numpy.timedelta(1,'s')/quantities.second is on my machine '<m8[s]'.
I'm not using panda data frames.

http://ioos.github.io/qartod/

@flbahr could you put that in another issue?

@lukecampbell and @benjwadams: thanks so much for putting together the documentation! Looks good.

Actually, I have two small comments about https://github.com/ioos/qartod/blob/master/README.rst:

It has some syntax problems, that look like Markdown while this is an rst file (I'm not familiar with rst syntax)
Add a prominent link to the new documentation page, http://ioos.github.io/qartod/

Done.

Looks good, thanks!

Looks like this issue can be closed


Gathering basic data

Saving acceleration and wheel angle values at the moment of every screenshot

Problemy:

vehicle speed not included in the data provided by the engine our vehicle does not have brakes

Done - converted from draft


Humble install fails - rosdep microros

A couple points on the install

user should run any sudo command before the bash install_linorobot2.bash xwd etc etc to make sure the sudo password is cached
user should also run sudo rosdep update if they haven't already loaded that, or the install fails part way through
the rosdep update script fails with

updated cache in /home/blm/.ros/rosdep/sources.cache ERROR: the following packages/stacks could not have their rosdep keys resolved to system dependencies: linorobot2_bringup: Cannot locate rosdep definition for [micro_ros_agent]
This was on a fairly vanilla ros2 humble install Ubuntu 22.04 AMD64.  Due to the previous fails on steps 1 & 2, it may be that running the install again was an issue but I had deleted all previous workspaces and the repository directory.

updated cache in /home/blm/.ros/rosdep/sources.cache ERROR: the following packages/stacks could not have their rosdep keys resolved to system dependencies: linorobot2_bringup: Cannot locate rosdep definition for [micro_ros_agent]
I am facing same problem, how to resolve that ?

there’s no rosdep keys for micro ros agent you use the skip flag to omit those warnings https://github.com/linorobot/linorobot2#21-install-linorobot2-package

Thanks for quick reply, But i am trying to follow the ROBOT installation document. where we need install micro_ros_setup right ? if we skip, it is skipping micro_ros_setup installation itself ? can you advice ?

@grassjelly Finally, I am able to install the ROBOT computer with install script easily. But now I have strange problem.

I have run the brinup script from the robot, and SLAM from host computer. The ROBOT is visible in the RVIZ.
but, it is very noisy or flickering the pose (I mean ROBOT is flickering on z-axis) even after ROBOT is stopped.
Becuase of this the entire SLAM is looking like a circle, please help, if the IMU is faulty or LIDAR has problem ?

@grassjelly One more point, actually the Teensy firmware was compiled in Foxy setup, but recently i have migrated the ROBOT computer with Humble Setup. But still the old Foxy Teensy firmware will work together with Humble? or is it necessary to recompile the Teensy under Humble as well ?

Please check attached video also


v.0.33

Version 0.33
Released September 18, 2023

Add merge queue support (#1464 by @arkid15r)
Introduce ObservedHolidays class (#1444 by @KJhellico, @arkid15r)
Update Algeria holidays: add fr localization (#1467 by @abh31000)
Fix README.rst (#1472 by @KJhellico)
Update Belgium holidays: add bank holidays (#1457 by @KJhellico)
Update Brazil holidays: specify optional holidays (#1452 by @KJhellico)
Update Canada holidays (#1448 by @KJhellico)
Update Liechtenstein holidays: specify bank holidays (#1462 by @KJhellico)
Update PR template (#1461 by @arkid15r)
Update Thailand holidays: add holiday categories (#1346 by @PPsyrius, @arkid15r, @KJhellico)
Update United Kingdom holidays (#1454 by @KJhellico)
Update documentation: add language usage example to examples.rst (#1456 by @jovana, @arkid15r, @KJhellico)
Update l10n files: fix ar, en_US headers (#1468 by @abh31000)
Update pre commit automatic update workflow (#1469 by @arkid15r)
Update skipIf rules for heavy tests (#1460 by @arkid15r)
Migrate remaining countries to ObservedHolidayBase (#1463 by @KJhellico)
Tune pre-commit auto-update workflow (#1473 by @arkid15r)

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

921 of 921 (100.0%)  changed or added relevant lines in 66 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 100.0%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
9221

Relevant Lines:
9221

💛  - Coveralls


README for examples/vault-consul-ami gives conflicting advice.

A comment in the CI script that pushes example AMIs says that TLS secrets should not be baked into a static AMI:
https://github.com/hashicorp/terraform-aws-vault/blob/6a091aab16d7be0a241a6bb07d59fc2f48baf412/_ci/publish-amis.sh#L42-L43
However, baking in TLS secrets into the static AMI is exactly what the README tells you to do
Can one or the other recommendation please be updated to not be in conflict with one another, so that readers have clear guidance?

The comment in publish-amis.sh should warn about baking unencrypted secrets into the AMI. Would you be up for a quick PR to fix that?

But, the README doesn't mention anything about a step where the secrets get encrypted, and the packer script seems to just copy the unencrypted files into the image: https://github.com/hashicorp/terraform-aws-vault/blob/6a091aab16d7be0a241a6bb07d59fc2f48baf412/examples/vault-consul-ami/vault-consul.json#L114-L119

Yes, that's my point: there should be a warning about not baking unecrypted secrets into the AMI. There are many ways to encrypt data, so you could also consider sharing some of the options for that, such as using KMS.

I was hoping that someone with experience using this module could be the one to write this advice, not me. I came here looking for that advice and found it to be missing. Still trying to figure out what the common practice is for people who are actually using this module.


Additional variable impedance and admittance  models for single and multi phase quasi stationary electrical library

Reported by christiankral on 30 Nov 2013 22:19 UTC
In the current implementation only variable resistors, conductors, capacitors and inductors are included. For some applications it is advantageous to have variable impedance and admittance models.
I will include these models in the trunk version of MSL.

Migrated-From: https://trac.modelica.org/Modelica/ticket/1367

Comment by christiankral on 1 Dec 2013 07:56 UTC
Implemented variable impedance and admittance models and updated documentation, see 75563cbd7f3f7fbc632abdc8be620975cf58d976.


Mention egobox in docs and Readme

@relf I'd like to mention egobox in the Readme and the docs in the hope that others will follow your example ;) Please let me know if you're for whatever reason not ok with that.

Awesome! Thanks! 😃

Codecov Report
Base: 93.36% // Head: 93.36% // No change to project coverage :thumbsup:

Coverage data is based on head (eec69b2) compared to base (058cf76).
Patch has no changes to coverable lines.

Additional details and impacted files
@@           Coverage Diff           @@
##             main     #320   +/-   ##
=======================================
  Coverage   93.36%   93.36%
=======================================
  Files         119      119
  Lines       18986    18986
=======================================
  Hits        17726    17726
  Misses       1260     1260

Impacted Files
Coverage Δ

argmin/src/lib.rs
100.00% <ø> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


Extract: ensure all obs categoricals include all categories in the full dataset

Fix the problem discussed here: https://github.com/cellarium-ai/cellarium-ml/issues/161
The problem is that obs categoricals like "dataset_id" do not have the same categories in each h5ad shard of extracted data.

For cell type this seems to be handled here: https://github.com/cellarium-ai/cellarium-cloud/blob/99cc59ff5579b3167210ba574d297506b32e8087/src/casp/services/bq_ops/prepare_extract/main.py#L71-L72
Basically we want to do this for every obs column (if it's categorical)

You probably don't have to make a separate file for each one, you could make one file with all the obs columns

Use the information here https://github.com/cellarium-ai/cellarium-cloud/blob/99cc59ff5579b3167210ba574d297506b32e8087/src/casp/bq_scripts/extract_minibatch_to_anndata.py#L280-L282 like cell type did here https://github.com/cellarium-ai/cellarium-cloud/blob/99cc59ff5579b3167210ba574d297506b32e8087/src/casp/bq_scripts/extract_minibatch_to_anndata.py#L263-L270

This was fixed during this PR
To be more specific, this fix got lost in this commit


[hi] Add Hindi glossary entry for "manifest"

[hi] Add Hindi glossary entry for "manifest"
Description
#Fixes  Localizes content/en/docs/reference/glossary/manifest.md in Hindi content/hi/docs/reference/glossary/manifest.md

Thanks For the PR
/lgtm

/assign @dipesh-rawat. Pls approve. If any more changes required pls suggest. Thanks!!


Change findById for findByPk if sequelize version is greather than v5

This project depends of "sequelize": "^4.44.3"
But since sequelize v5 was released, the model function findById was replaced with findByPk, resulting in the next error.
TypeError: this.model.findById is not a function
at ResourceController.item (/usr/share/preferences-api/app/node_modules/@yeiniel/rest-hal-sequelize/src/controller/resource.js:42:20)
If you manually change the function name in<EMAIL_ADDRESS>the error disappears

You can see this question for references. https://stackoverflow.com/questions/41577597/sequelize-findbyid-is-not-a-function-but-apparently-findall-is

hey @alejandroalfonsoyero next time you can create a PR yourself. It will be appreciated and merged as soon as possible. No need to publish the fork on NPM.


webpack support for the plugin

As per the specs here - http://docs.nativescript.org/angular/tooling/bundling-with-webpack.html#referencing-platform-specific-modules-from-packagejson


Re-organizing the sections

Proposing the following structure for the document. The main change is that Sign, Verify, ProofGen and ProofVerify are moved to their own "core operations" section. This will allow us to more easily define "higher level functions" on top of the "core operations" if need be.
|--- Introduction
|      |--- Terminology
|      |--- Notation
|      +--- Organization of this document
|--- Conventions
|--- Considerations
|      |--- Subgroup Selection
|      |--- Messages and Generators
|      +--- Encoding of elements to be hashed
|--- BBS Scheme Definition
|      |--- Parameters
|      |--- Key Generation
|      |      |--- KeyGen
|      |      |--- SkToPk
|      |      +--- KeyValidate
|      +--- Core Operations
|             |--- Sign
|             |--- Verify
|             |--- ProofGen
|             +--- ProofVerify
|--- Utility Functions
|      |--- CreateGenerators
|      |--- MapMessageToScalar
|      |      +--- MapMessageToScalarAsHash
|      +--- Hash to scalar
|--- Serialization
|      |--- OctetsToSignatures
|      +--- SignatureToOctets
|--- Security Considerations
|--- Ciphersuites
+--- Appendix

Suggested tweaks
|--- Introduction
|      |--- Terminology
|      |--- Notation
|      +--- Organization of this document
|--- Conventions
|--- Considerations
|      |--- Subgroup Selection
|      |--- Messages and Generators
|      +--- Encoding of elements to be hashed
|--- Scheme Definition
|      |--- Parameters
|      |--- Key Generation Operations
|      |      |--- KeyGen
|      |      |--- SkToPk
|      |      +--- KeyValidate
|      +--- Core Operations
|             |--- Sign
|             |--- Verify
|             |--- ProofGen
|             +--- ProofVerify
|--- Utility Operations
|      |--- CreateGenerators
|      |--- MapMessageToScalar
|      |      +--- MapMessageToScalarAsHash
|      +--- Hash to scalar
|      |--- OctetsToSignatures
|      +--- SignatureToOctets
|--- Security Considerations
|--- Ciphersuite

Suggested tweaks

Done! Thanks!

@BasileiosKal with the merge of #155 can you rebase this PR as I think otherwise the section will end up in the wrong place, after that im happy to merge.

@BasileiosKal with the merge of #155 can you rebase this PR as I think otherwise the section will end up in the wrong place, after that im happy to merge.

@BasileiosKal with the merge of https://github.com/decentralized-identity/bbs-signature/pull/155 can you rebase this PR as I think otherwise the section will end up in the wrong place, after that im happy to merge.

Done rebase!
Since we have 4 "serialization" operations maybe they are "worth" their own sub-section?? So the Utility Operations section now looks like:
|--- Utility Operations
|      |--- CreateGenerators
|      |--- MapMessageToScalar
|      |      +--- MapMessageToScalarAsHash
|      +--- Hash to scalar
|      +---- Serialization
|              |--- OctetsToSignatures
|              |--- SignatureToOctets
|              |--- OctetsToProof
|              +--- ProofToOctets

I'm more than happy to fall back if people don't like this change.

Since we have 4 "serialization" operations maybe they are "worth" their own sub-section??
 I agree


add .gitignore for build and such

and .env

Addressed in https://github.com/smartcontractkit/chainlink-mix/pull/8


Fuel Codes | Expiry date must be after Effective date |1|

https://trello.com/c/DcXtkdnE/1325-fuel-codes-expiry-date-must-be-after-effective-date-1
Task:
Implement a validation check that ensures that the date of expiry (expiry date field) is after the date the code comes into effect (effective date field).
Purpose:
An added check to make sure that the effective dates are entered correctly and the gov't analyst did not make a mistake
Error Message:
"Error! The expiry date proceeds the effective date."

 Fuel Codes | Expiry date must be after Effective date |1|


Fix two typos in semparse_dateparse.ipynb

Thanks for this, and my apologies for overlooking this until now!


Adding support for mcp7940m and mcp7940n

Description
Adding support for mcp7940m and mcp7940n real-time clocks.
Motivation and Context
nanoFramework,Iot.Device does not provide support for these chips yet.
How Has This Been Tested?
The sample code was tested on a mcp7940m, and a mcp7940n with a ESP32-WROOM-32.
Screenshots
Types of changes

[ ] Improvement (non-breaking change that improves a feature, code or algorithm)
[ ] Bug fix (non-breaking change which fixes an issue with code or algorithm)
[x] New feature (non-breaking change which adds functionality to code)
[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] Config and build (change in the configuration and build system, has no impact on code or features)
[ ] Dependencies (update dependencies and changes associated, has no impact on code or features)
[x] Unit Tests (add new Unit Test(s) or improved existing one(s), has no impact on code or features)
[ ] Documentation (changes or updates in the documentation, has no impact on code or features)

Checklist:

[x] My code follows the code style of this project (only if there are changes in source code).
[ ] My changes require an update to the documentation (there are changes that require the docs website to be updated).
[ ] I have updated the documentation accordingly (the changes require an update on the docs in this repo).
[x] I have read the CONTRIBUTING document.
[x] I have tested everything locally and all new and existing tests passed (only if there are changes in source code).
[x] I have added new tests to cover my changes.

Thanks again forthis great addition!

`#include <IfxStm.h>
#include <IfxStm_reg.h>
#include <IfxPort.h>
#include "IfxI2c_I2c.h"
#define MCP7940M_ADDRESS	0x6F//0110 1111
#define I2C_BAUDRATE        200000//200kHz
#define RTCSEC_VALUE_REG 	0x00
#define RTCMIN_VALUE_REG 	0x01
#define RTCHOUR_VALUE_REG 	0x02
#define RTCWDAY_VALUE_REG 	0x03
#define RTCDATE_VALUE_REG 	0x04
#define RTCMONTH_VALUE_REG 	0x05
#define RTCYEAR_VALUE_REG 	0x06
#define ALMSEC_VALUE_REG0 	0x0A
#define ALMMIN_VALUE_REG0 	0x0B
#define ALMHOUR_VALUE_REG0 	0x0C
#define ALMWDAY_VALUE_REG0 	0x0D
#define ALMDATA_VALUE_REG0 	0x0E
#define ALMMONTH_VALUE_REG0	0x0F
#define ALMSEC_VALUE_REG1 	0x11
#define ALMMIN_VALUE_REG1 	0x12
#define ALMHOUR_VALUE_REG1 	0x13
#define ALMWDAY_VALUE_REG1 	0x14
#define ALMDATA_VALUE_REG1 	0x15
#define ALMMONTH_VALUE_REG1	0x16
#define CONTROL_REG 0x07
IfxI2c_I2c          g_i2cHandle;//I2C handle
IfxI2c_I2c_Device   g_i2cDeRTC;//I2C Slave device(MCP7940M) handle
void MCP7940_I2C_Init(void)
{
/* Initialize module*/
IfxI2c_I2c_Config i2cConfig;//Create configuration structure
IfxI2c_I2c_initConfig(&i2cConfig, &MODULE_I2C0);//Fill structure with default values and Module address
const IfxI2c_Pins MCP7940_pins = {&IfxI2c0_SCL_P13_1_INOUT,//SCL
&IfxI2c0_SDA_P13_2_INOUT,//SDA
IfxPort_PadDriver_ttlSpeed1};
i2cConfig.baudrate = I2C_BAUDRATE;
i2cConfig.pins = &MCP7940_pins;
IfxI2c_I2c_initModule(&g_i2cHandle, &i2cConfig);/* Initialize module */
/* init slave devices */
IfxI2c_I2c_deviceConfig i2c_MCP7940M_Config;
IfxI2c_I2c_initDeviceConfig(&i2c_MCP7940M_Config, &g_i2cHandle); /* Device config for Bus of i2c handle */

i2c_MCP7940M_Config.deviceAddress = MCP7940M_ADDRESS << 1;
IfxI2c_I2c_initDevice(&g_i2cDeRTC, &i2c_MCP7940M_Config);

}
void Write_Data_To_MCP7940M()
{
uint8 i2cTxBuffer[3] = {0x12, 0x55, 0x08};//test
/* write data to device as soon as it is ready */
while(IfxI2c_I2c_write(&g_i2cDeRTC, i2cTxBuffer, 3) == IfxI2c_I2c_Status_nak);

}`
Hi, Sir. I am using the HighTEC compiler and using TC275 to control MCP7940M, From the oscilloscope, it can be seen that the slave address was written twice, followed by the data written (0x12, 0x55, 0x08). Why is the slave address written twice? The correct ones should be the slave address, slave register address, and data. Did I configure them incorrectly? Please Help me.


'Person Name' -> 'Person Name, Orgname'?

Is there a way to customise how much of author is shown in an article title page? (Other than by supplanting the XML template in templates.xml with custom XSLT in the m:generate-titlepage mode?)
Is there a mode in which the db:author is processed by this:
    <tmp:apply-templates select="db:author">

<tmp:content/>

    </tmp:apply-templates>

?

m:titlepage mode, I believe.

Ah, I was using m:generate-titlepage mode and wondering why nothing was happening.


Create hoursWorked API

resolves #10
I think my code should work. However, I don't know how to add a parameter to the API in Swagger, so I tested adding the parameter by directly call the API in the url bar. Please let me know if it worked.

I created a new time entry in my local database to test this out. The first part of the video is the case when the requested time entry exists. The second part is when it doesn't.
https://user-images.githubusercontent.com/111351821/233251002-b349b01c-6ea2-4dec-995e-2b580793e00b.mov

I created a new time entry in my local database to test this out. The first part of the video is the case when the requested time entry exists. The second part is when it doesn't.
Screen.Recording.2023-04-19.at.11.25.23.PM.mov

Nice job Mimi. One thing left is that date query is optional. This means, if we don't insert the date query in the URL, the server still returns a 200 status response with an array of entries of all dates in the past. If this seems to be a lot, you may want to limit the number of entries to 10 or 20, whichever fits the bandwidth. Recheck the description in #10


React hook form bug if MuiFileInput is required

Describe the bug
Within a react hook form if the MuiFileInput is required the validation does not work
To Reproduce
Steps to reproduce the behavior:
<Controller     rules={{ required: true }}     control={control}     name={"consumptionFile"}     render={({ field }) => (       <MuiFileInput required {...field}       />     )}     />
The form can't be submitted even when a file was set.
Screenshots

Hello !
Can you share a codesandbox plz ?


Travis npm publishing

So this should give us some lovely auto deployments, see docs here: https://docs.travis-ci.com/user/deployment/npm/

@DavidHollins6 @kyleharper the key is encrypted (see https://docs.travis-ci.com/user/encryption-keys/ and https://docs.travis-ci.com/user/deployment/npm/#npm-auth-token)
Perhaps we can do this too: https://docs.npmjs.com/creating-and-viewing-authentication-tokens#cidr-restricted-token-errors
Open to other suggestions too :)

@kyleharper also happy to mob about this, my knowledge is just the docs I've linked in the PR description, so it'l be good to have more minds on deck.
As for tags & master confusion, if you look here: https://github.com/gathercontent/gather-ui/pull/482/files#diff-354f30a63fb0907d4ad57269548329e3R14 in our on arguments we have tags set to true, but also the branch set to master. I'm not 100% sure (requires testing) but I believe those two args will only trigger a publish when its a new tag on the master branch.


Support for Razer BlackWidow Elite Keyboard

Hello,
Would it be possible to include support for Razer BlackWidow Elite keyboard?
Thanks a lot!
C:\Users\Marcin\Downloads>razer-cli.exe enumerate
RazerDevice { vid: 0x1532, pid: 0x0228, manufacturer: Razer, product: Razer BlackWidow Elite }
RazerDevice { vid: 0x1532, pid: 0x0228, manufacturer: Razer, product: Razer BlackWidow Elite }
RazerDevice { vid: 0x1532, pid: 0x0228, manufacturer: Razer, product: Razer BlackWidow Elite }
RazerDevice { vid: 0x1532, pid: 0x0228, manufacturer: Razer, product: Razer BlackWidow Elite }
RazerDevice { vid: 0x1532, pid: 0x0306, manufacturer: , product:  }
RazerDevice { vid: 0x1532, pid: 0x0306, manufacturer: , product:  }
RazerDevice { vid: 0x1532, pid: 0x0228, manufacturer: Razer, product: Razer BlackWidow Elite }
RazerDevice { vid: 0x1532, pid: 0x0228, manufacturer: Razer, product: Razer BlackWidow Elite }
RazerDevice { vid: 0x1532, pid: 0x0228, manufacturer: Razer, product: Razer BlackWidow Elite }
RazerDevice { vid: 0x1532, pid: 0x0228, manufacturer: , product:  }
C:\Users\Marcin\Downloads>
C:\Users\Marcin\Downloads>razer-cli.exe backlight 100
Error: hidapi error: No HID devices with requested VID/PID found in the system.
C:\Users\Marcin\Downloads>razer-cli.exe -p 0x0228 info
Error: hidapi error: HidD_SetFeature: (0x00000001) Incorrect function.
C:\Users\Marcin\Downloads>
Kind regards,
Marcin.

Razer Synapse consists of multiple modules, and I believe the keyboard is controlled by the Razer Chroma module. The application intends to control the Laptop.
The reverse engineering steps described here might work for the external keyboard as well, but that's another project.


Fixed Kotlin Gradle plugin version and Type mismatch error

This PR will fix issue https://github.com/builttoroam/flutter_plugins/issues/68
and issue https://github.com/builttoroam/flutter_plugins/issues/67

lgtm

This issue is still open, does it mean the package hasn't been updated yet?

Thanks for merging it. When is it going to take effect? Should I wait for 0.0.7?


db.Delete causes no error if it fails

I have a situation that was hard to track down in my code becuase db.Error was nil when delete failed. the primary key was 0 and when it was deleted like this...
id := 0
if err := db.Where("user_id = ?", &user.ID).Delete(&thing, id).Error; err != nil {
	fmt.Println(err)
}

Is this by design, and if so, what is the purpose?

The query was probably successful, you got not SQL errors, and there's no way Gorm could know how many rows you expect to be deleted. 0 rows deleted is still a valid amount of rows to delete.

There is a RowsAffected column in the result, you could get how many rows deleted from that.

like this
result := r.db.Where("member_id = ?", task.MemberID).Delete(task)
if result.RowsAffected == 0 {
	return errors.New("delete failed")
}


some fixes to database-related tests

This PR fixes a few failing tests that were caused by changes to the underlying Plains Cree data.

Codecov Report

Merging #1020 (5f211ed) into main (92bb1c7) will decrease coverage by 0.06%.
The diff coverage is 100.00%.

:exclamation: Current head 5f211ed differs from pull request most recent head 4bb4e9d. Consider uploading reports for the commit 4bb4e9d to get more accurate results

@@            Coverage Diff             @@
##             main    #1020      +/-   ##
==========================================
- Coverage   79.05%   78.99%   -0.07%
==========================================
  Files         151      151
  Lines        5296     5295       -1
  Branches      685      685
==========================================
- Hits         4187     4183       -4
- Misses        984      989       +5
+ Partials      125      123       -2

Impacted Files
Coverage Δ

src/CreeDictionary/API/search/test_espt_crk.py
100.00% <ø> (ø)

src/CreeDictionary/CreeDictionary/test_views.py
94.23% <100.00%> (+0.05%)
:arrow_up:

src/crkeng/integration_tests/test_definitions.py
96.29% <100.00%> (ø)

src/CreeDictionary/API/search/lookup.py
93.47% <0.00%> (-2.18%)
:arrow_down:

src/CreeDictionary/API/search/espt.py
86.36% <0.00%> (-1.82%)
:arrow_down:

src/morphodict/analysis/__init__.py
84.21% <0.00%> (-1.76%)
:arrow_down:

src/CreeDictionary/CreeDictionary/views.py
78.70% <0.00%> (-0.39%)
:arrow_down:

src/CreeDictionary/API/search/presentation.py
81.12% <0.00%> (+0.51%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 92bb1c7...4bb4e9d. Read the comment docs.


Ensure multiple callbacks do not bleed wrong plot state

Currently there is a bug in the code that handles multiple callbacks being attached to one bokeh plot object. The issue arises when two streams are attached to one plot object, this can happen when one axis is linked between two plots. In these cases the RangeXY stream of one plot can end up with the y-range of another plot, which has a linked and therefore shared x-axis. The solution is to keep track of the IDs of the handles each stream is attached to, the frontend can send the matching ids along with the updated values and we can then check that only the appropriate data is actually forwarded to the stream.

Does this fix https://github.com/bokeh/datashader/issues/250?

The immediate problem there is already fixed, this is a more subtle issue that occurs under certain circumstances, in the case that it came up it was in a scenario where there are two datashader plots with RangeXY callbacks, which have one linked axis and one independent axis, e.g. two different quantities over time.

Works well for me.

Some other issue happening here where callback events are clobbering each other and it times out.

Had to make some further changes to the ACK message protocol. Previously when multiple callbacks fired consecutively it could happen that some messages were getting throttled causing one particular comm to never receive an ACK message that would unblock it. Therefore callback event messages and the response may now contain the comms_target ID, ensuring that all comms are appropriately unblocked after an event has been sent.

Need to add more tests and update existing tests.

@jlstevens I believe this is now ready for review. Both issues that I fixed here are pretty subtle and caused strange bugs. Here's the example I've been using to test the fix:
import holoviews as hv
import numpy as np
import pandas as pd
from holoviews.operation.datashader import datashade, aggregate, shade

hv.notebook_extension('bokeh')

%opts DynamicMap [width=900, tools=['xwheel_zoom']] Layout [shared_datasource=False]

n=100000
def f(n):
    return np.cumsum(np.random.randn(n))
df = pd.DataFrame({'t': range(n), 'y1': f(n), 'y2': f(n), 'y3' : .10 * f(n)} )

def p(y):
    return hv.Curve(df, kdims=['t'], vdims=[y])

layout = datashade(p('y1')) * datashade(p('y2')) + datashade(p('y3'))

layout.cols(1)

A rough explanation of the changes implemented here:

Since a callback can be shared across multiple streams, and two callbacks can share multiple handles you can end up in situations where a bokeh JS callback sends data to two different callbacks. In the example above the x-range and y-range on the top plot share a JS callback, and the x-range and y-range on the bottom plot share a JS callback. Additionally since the x-axis is linked between the two plots, the x-range model is also shared between the plots. This means that the JS callback for one plot ends up sending the x-range and the y-range to both callbacks. However since the y-range is not shared this ends up supplying the wrong y-range to the callback on the other plot. The solution is to a) keep track of the IDs of the plot handles a particular stream is attached to and b) send the ID along with the value when an event is generated. Now the callback can check that the ID of the value its been given matches the IDs of the handles for a particular stream ensuring that only the correct values are sent to the stream.

Every time a message is sent to Python, it has to send a message back. This acknowledgement  (ACK) message is used to unblock a comm for future events. In the case above it may end up unblocking the same comm twice, leaving the second comm blocked. To get around this it now sends the unique ID of the comm in the message to Python, allowing the ACK message to send that ID back, ensuring that the correct comm can be unblocked.

To summarize private discussion I've had directly with Philipp, I'll just say that I think the general strategy used in this PR looks  sound - labelling comms with an id and keeping track of plotting handles.
I intend to use inline comments for suggestions specific to this PR and here are some of the more general (future) plans that we discussed:

There is code in callbacks that references jupyter comms specifically. This should be generalized to work with any comms type (e.g a websocket comms implementation).
I would suggest renaming 'comms_target' to 'comm_id'.
We want to document our message protocol and ideally encapsulate it all in one location (ie. in a class, maybe called Protocol that lives alongside the comm classes).
We should aim to generalize our message protocol. E.g always have a 'command' or 'msg_type' field. Maybe all messages could have 'msg_type' and 'data' fields that can be dispatched appropriately in the centralized message protocol class. Then we need something for 'ACK' and 'ERROR' messages...

@jordansamuels I just updated the PR fixing the issue you reported when resetting, could you test it as well?

@jlstevens Ready for review again.


Add protection against null pointer access

Unmapped URLs are not initialized for short-circuited requests before remap as pristine url is not set until remap. Add protection against null pointer access.

The changes look good to me, but the commit log (the first line) is too long.
Please put a short summary to the first line, and move current description to the third line. Making multiple changes on one commit makes it difficult.

Updated the commit message and PR title.
Not sure though to understand what you mean by Making multiple changes on one commit makes it difficult.  This PR has only one change/commit.

I meant one for cond_satisfied and one for m_client_req_unmapped_url_*. These are technically different things. cond_satisfied is not a pointer and it cannot be nullptr, right?
I'll let you off the hook this time because the changes are simple, but I might not if it was more big and complicate change.

[approve ci autest]

[approve ci autest]

I meant one for cond_satisfied and one for m_client_req_unmapped_url_*. These are technically different things. cond_satisfied is not a pointer and it cannot be nullptr, right?
I'll let you off the hook this time because the changes are simple, but I might not if it was more big and complicate change.

Ah that one. Gotcha! Huh, the CI jobs are not happy now.

[approve ci autest]

[approve ci autest]

[ci autest approve]

[approve ci autest]

[approve ci autest]

[approve ci autest]


Update kubernetes-walkthrough.md

Add additional commands needed to succeed with walkthrough.
Add link to information in what locations preview is available.

@fredrikhaglund : Thanks for your contribution to the Azure documentation! The author, @neilpeterson, has been notified to review your proposed change.

@fredrikhaglund thanks for the PR, appreciate it.
Say, did you find yourself in a situation where the compute and network providers required registering? This should not be the case.
Also the az aks create command should not require the location argument. Did you find that it was required?
Thanks

I had several issues running through the getting started guide, some self-inflicted like trying to use ukwest as location.
Yes, I got an error message during az aks create saying that Microsoft.Compute and Microsoft.Network provider was not registered. If I do az provider list --output table most things have status NotRegistered. Things worked fine after manually registering them. I do not now why these providers where not registered, maybe because I have an account that has been around since Azure was launched at PDC 2008?
I think my default location for the account is northeurope. az aks create did not care about the location set on the resource group, it took my default location from somewhere else and failed because the location was not supported. Adding a location to the command line solved my problem.
I also tried to use ukwest as location first (since I'm located in Sweden) but first it failed to create a VM with the error "Your subscription doesn’t support virtual machine creation in UK West. Choose a different location.  Supported locations are: East US, East US 2, South Central US, West Europe, Southeast Asia, West US 2, West Central US.". I had figure out how to do az account list --output table and az account set --subscription "Microsoft Partner Network" to switch. But then it failed anyway saying "Deployment failed. Azure Container Service is unable to provision an AKS cluster in ukwest, due to an operational threshold.".

@fredrikhaglund - thanks again for the PR. I believe we have addressed all concerns in product. I am going to close this PR.
#please-close


Can't delete the jar once I read the Manifest

Hello!
Thanks for the job, I tested the package and it worked well... until I would delete the jar.
I use jarfile in an electron application and once I read infos from a jar, I need to delete it.
However, it seems the jar stays open, or used somewhere, because while the application is running I get an error when I try to delete it :
Error: EPERM: operation not permitted, lstat '<path_of_jar>'
Do you have any idea about this ?

Hmm, unless there is some OS specific stuff going on, my understanding is that if you delete a file (unlink() it) while a process has it open, no error is thrown. The reference in the file system is removed, but processes that still have an open file descriptor can still access it.
Based on the error message referencing lstat() I think you may be lacking a proper execute permission on an ancestor directory of the jar file. It’s weird that it only happens while your app is running though, but maybe something else is messing up the permissions of your directories?
If you can make reproducible test case I’m happy to investigate further!

Thanks for answer :)
I'm on Windows 10 if you wonder..
I create a small electron app with only this read and delete jar : https://github.com/eloiletagant/jar-deletion
just clone, npm install and npm start to launch it, you'll see:
the 'success' message is displayed, but the jar is delete only when you close the app...
And I get same behaviour when the deletion is outside the callback!
Hope you'll find out what is going on :)

I ran it and wasn’t able to reproduce the issue. However, I’m on macOS, and I unfortunately don’t have a convenient way to test this on Windows currently.
Are you able to get the test case to reproduce the issue without the Electron dependency (just in a Node process)? Another thing to try might be to see if you can reproduce the issue just by using the ls-archive module, which is the dependency that jarfile uses to access the contents of the jar. If there is an issue, I think it’s likely to be an issue with ls-archive.

You were right, it seems the error come from ls-archive dependency !
I should checked this before open an issue here, thanks for the help :)

No worries, issues with dependencies have a way of becoming issues with their dependents! 😄


Add a "prompt" option to leave the prompt alone

Add an option (both a flag and a .hermit.hcl field) to tell hermit not
to make changes to the prompt when activating an environment.
The "prompt" option is an enum with the values "env", "short", and
"none". "env" is the same as the current prompt - the environment name
and hermit icon in the prompt. "short" is the same as the short-prompt
option - just the hermit icon in the prompt. "none" prevents hermit from
changing the prompt at all.
This subsumes the short-prompt option. As a CLI flag, it has been made
hidden, but is still present for backward compatibility. If both
"prompt" and "short-prompt" are set, "short-prompt" will override
whatever has been set for "prompt".

LGTM and thanks 😀


OCM-10756 | fix: add missing aliases for describe/delete autoscaler commands

https://issues.redhat.com/browse/OCM-10756

/retest


Possible to Use Multiple Instances of Same Request in Single Test?

I'm sure there are much smarter ways to go about what I'm trying to do. I've reviewed the documentation and I can't find what I need.
        MockClient::global([
           // ❌ DOES NOT GET USED
           NetworkCreatePrivateRequest::class => MockResponse::fixture(
                "create_private_network_request"
            ),
            // ✅ GETS USED FOR BOTH NETWORK CREATE
            NetworkCreatePrivateRequest::class => MockResponse::fixture(
                "create_vm_network_request"
            ),
           // ❌ DOES NOT GET USED
            CreateServer::class => MockResponse::fixture(
                "create_server_1"
            ),
           // ❌ DOES NOT GET USED
            CreateServer::class => MockResponse::fixture(
                "create_server_2"
            ),
           // ✅ GETS USED FOR ALL 3 CREATE SERVER
            CreateServer::class => MockResponse::fixture(
                "create_server_3"
            ),
        ]);

I have a test where I use the same request classes multiple times. Each time the request class is used it needs to respond with data from a different fixture to mimic what the code is doing.
I assumed the MockClient would use the first instance of a request class encountered and after it is used once it looks for the next instance in the MockClient but that is not how it works.
The problem I am running into is that it seems that only the last instances in the MockClient::global array are used.

In my example above I have 2 network create requests

Both network requests end up using the fixture "create_vm_network_request"

In my example above I have 3 server create requests.

All 3 create server requests end up using the "create_server_3" fixture.

Is it possible to tailor these calls in order with responses to have different fixtures/data - or is there another way to achieve this?
I would like to avoid create a separate class for each possible instance of network or server because the requests are so similar - but the responses need to be different.
Best,
Chris

There are multiple ways to do it.
In your test, call the MockClient again
 MockClient::global([
           NetworkCreatePrivateRequest::class => MockResponse::fixture(
                "create_private_network_request"
            ),
            CreateServer::class => MockResponse::fixture(
                "create_server_1"
            ),
        ]);

// Do first load of tests to trigger requests

 MockClient::global([
            NetworkCreatePrivateRequest::class => MockResponse::fixture(
                "create_vm_network_request"
            ),
            CreateServer::class => MockResponse::fixture(
                "create_server_2"
            ),
        ]);

// Do next load of tests to trigger next set of requests

Depending on your code, you could also pass a closure to the mock.
 MockClient::global([

           NetworkCreatePrivateRequest::class => function (PendingRequest $pendingRequest) {
               $request = $pendingRequest->getRequest(); // This will get the underlying instance of NetworkCreatePrivateRequest

               $networkName = $request->name; // assuming you have a name property on your request but you could get it from the body or anything else you pass in.

               return MockResponse::fixture("create_{ $networkName }_network_request");

            },
]);

@craigpotter I used the second recommendation you made and it worked perfectly. Thanks so much for your help!
This kind of thing works well
 MockClient::global([

           NetworkCreatePrivateRequest::class => function (PendingRequest $pendingRequest) {
               $request = $pendingRequest->getRequest(); // This will get the underlying instance of NetworkCreatePrivateRequest

               $networkName = $request->name; // assuming you have a name property on your request but you could get it from the body or anything else you pass in.

               return MockResponse::fixture("create_{ $networkName }_network_request");

            },
]);

Glad I could help 😌 ☺


Missing Fields in CSV Export from Database

Hello,
I hope this message finds you well. I've encountered an issue with the CSV export feature in the Notion Exporter tool. Previously, when exporting data from a database, all fields were included in the CSV file. However, it seems that now only the fields from the first tab are being exported, and some fields may be missing.
I noticed that in Notion itself, a new option has been added to control which fields are included in the export. However, this option is not available in your Notion Exporter library.

This issue is affecting my workflow as I rely on having access to all the data fields in the exported CSV file. It would be greatly appreciated if this issue could be addressed and resolved in an upcoming update of the Notion Exporter tool.
If you need any additional information or would like me to provide more details about this problem, please let me know. I'm eager to assist in any way I can to help resolve this issue.

plz change
    this.getCsvString = function (idOrUrl) {
      return _this.getFileString(idOrUrl, function (e) {
        return e.name.endsWith(".csv");
      });
    };

to
    this.getCsvString = function (idOrUrl) {
      return _this.getFileString(idOrUrl, function (e) {
        return e.name.endsWith("_all.csv");
      });
    };

Coming back to this now. I'll look into your proposed change but will also contemplate some flags to adapt the behaviour.

Fixed with upcoming release.


"graphics" feature gate

This pull request move graphics-related features behind a feature gate because graphics is not what every user needs. I was trying to create a separate crate for graphics, but I found it's a bit difficult to untie the code that are tightly related each other.

It is time for extendr to get a separate Features section in Readme, it is hard to track all the options we have right now.

My preference: a separate PR summarizing features as a list in extendr README and somewhere on the web site, perhaps also on the front page.

I stumbled upon this crate serial_test. Have you ever tried it out? I wonder if decorating your graphics tests with #[serial(graphics)] can help with memory issues while still running tests multithreaded?
(Note that crate guarantees that marked test will run in serial, but other tests will run arbitrary, including in parallel to the #[serial()] ones).

Yes, I already tried it, but it didn't save me from #370. I guess this part matters

but other tests will run arbitrary

But I didn't investigate much, so it might be worth looking it again at some point....

Thanks! The label is really useful.

@andy-thomason
I'm going to merge this in a week. If you have any concern on moving graphics-related code into a feature gate, please comment here (if not, please just ignore).

Merging this and will address https://github.com/extendr/extendr/issues/378


vue: migrate to v15

a package called js-yaml was unpublished from npm due to security reasons
this was a dependency of vue until v14
v15 does not require js-yaml anymore
however, migrating to v15 requires a number of additional steps: https://app.netlify.com/sites/op-user/deploys

closed by #214


MUPX mongodb failed to connect, following docker upgrade > info & workaround

If

Everything works fine
You have "setupMongo": false in your mup.json
You apt-get dist-upgrade your Ubuntu server, so you will update docker-engine, for us from 1.8.2 to 1.9.0.
Reboot your server
mupx deploy

Then

Your docker ps says Restarting..., and you get Error: failed to connect to [mongodb:27017] with mupx logs

Two possible workaround :

sudo apt-get install docker-engine:amd64=1.8.2-0~trusty, to force package downgrade (so with security issues), we didn't try with 1.8.3
Or add --link=mongodb:mongodb \ in file https://github.com/arunoda/meteor-up/blob/mupx/templates/linux/start.sh line 35.

Comments :

This seems to be a bug. We don't know how to correct properly, we can help if necessary, good luck on it :/
Identical problem if we rm -rf ~/.meteor/* $PROJECT_DIR/.meteor/local/*
Our mup.json http://pastebin.com/ZjuQm3G7

Possible duplicate :

https://github.com/arunoda/meteor-up/issues/712
https://github.com/arunoda/meteor-up/issues/749 (https://forums.meteor.com/t/solved-serious-mupx-docker-issue-help/13217)

If you're using your own mongo database on the same machine as your app, always make sure setupMongo is set to true. Setting it to false tells mupx to not spin up a mongo container and to use a remote URL instead.

Setting it to false tells mupx to not spin up a mongo container and to use a remote URL instead.

Yes we know it. But we have more than one database on mongodb.
Moreover, difference between production and development environment should be avoid as much as possible. So it should be an URL to prepare later stage in our case.
Anyway, this issue should not happen, isn't it ?

I'm not sure, I've never used more than one database with Meteor. Sorry I can't help!

It's not about a multi-database setup, it's about having multiple apps using the same database.
Imagine we have appName1 and appName2 and we want both app to use the same database.
appName1 is setting up a mongo container appNameDB1.
Right now, the /opt/appName2/config/start.sh script needs to be monkey-patched to configure the linking functionality of docker (here, mongodb is an hosts created dynamically when linking container):
    --link=mongodb:mongodb \
    --env=MONGO_URL=mongodb://mongodb:27017/appName1 \

I also downgraded to 1.8.2 as the original reporter suggested, but I'm not sure it's really necessary.

If I'm following I'd put one mupx conf to say yes to mongodb and the others to false for setup Mongo but point to the mongodb launched in the first config for the others?
I either didn't understand or that should be the easiest way.


Fix errors that occur when unrelated tag is investigated by Rails/ContentTag

I encountered a strange error when running rubocop-rails on our Rails app that uses FactoryBot.
The file that caused the problem was, in simplified form, the following code:
FactoryBot.define do
  factory :article do
    tag factory: :article_tag
  end
end

and the error output was like this:
$ bundle exec rubocop spec/factories/articles.rb
Inspecting 1 file
An error occurred while Rails/ContentTag cop was inspecting /workspace/spec/factories/articles.rb:3:4.
To see the complete backtrace run rubocop -d.
.

1 file inspected, no offenses detected

1 error occurred:
An error occurred while Rails/ContentTag cop was inspecting /workspace/spec/factories/articles.rb:3:4.
Errors are usually caused by RuboCop bugs.
Please, report your problems to RuboCop's issue tracker.
https://github.com/rubocop/rubocop/issues

Mention the following information in the issue report:
1.36.0 (using Parser <IP_ADDRESS>, rubocop-ast 1.21.0, running on ruby 2.7.2) [x86_64-linux]

This Pull Request has been created to fix this problem.
We could add {spec,test}/factories/**/*.rb to Exclude section of this cop, but that would not prevent the problem from reoccuring in other places. Since extensive investigation is performed on the generic method name tag, I think it should be checked more rigorously in this way.

Before submitting the PR make sure the following are checked:

[x] The PR relates to only one subject with a clear title and description in grammatically correct, complete sentences.
[x] Wrote good commit messages.
[ ] Commit message starts with [Fix #issue-number] (if the related issue exists).
[x] Feature branch is up-to-date with master (if not - rebase it).
[x] Squashed related commits together.
[x] Added tests.
[x] Ran bundle exec rake default. It executes all tests and runs RuboCop on its own code.
[ ] Added an entry (file) to the changelog folder named {change_type}_{change_description}.md if the new code introduces user-observable changes. See changelog entry format for details.
[ ] If this is a new cop, consider making a corresponding update to the Rails Style Guide.

Nice! Can you add a changelog entry?


Integration Test - Release - 2019/06/20 17:14:04

Auto create for integration test. AnotherAuthorUpdatedArticleFlow

@PRMergerTest2 : Thanks for your contribution! The author(s) have been notified to review your proposed change.

@PRMergerTest2 : Thanks for your contribution! The author(s) have been notified to review your proposed change.


Missing Windows-1252 encoding DLL (Mono, Linux x86_64)

When building the game the necessary files for Windows-1252 encoding will be missing in the exported player.
Copying I18N.West.dll and I18N.dll (from the editor) to the exported game directory or into the *_Data/Managed directory fixes this, as suggested at https://answers.unity.com/questions/42955/codepage-1252-not-supported-works-in-editor-but-no.html
Perhaps Unity could be instructed to include these in Mono builds?
I have not tested if this issue affects Mono builds on other platforms than x86_64 Linux.

Here is the error the game spits out if you don't manually copy the DLLs.
System.NotSupportedException: Encoding 1252 data could not be found. Make sure you have correct international codeset assembly installed and enabled.
  at System.Text.Encoding.GetEncoding (System.Int32 codepage) [0x0023f] in <d7ac571ca2d04b2f981d0d886fa067cf>:0
  at SanAndreasUnity.Importing.GXT.GXT.Win1252ToString (System.Byte[] bytes) [0x00000] in <344420f216234bcc963a3cbf1e979971>:0
  at SanAndreasUnity.Importing.GXT.GXT.LoadTKEY (System.IO.BinaryReader binaryReader, System.String tableName) [0x000f2] in <344420f216234bcc963a3cbf1e979971>:0
  at SanAndreasUnity.Importing.GXT.GXT.InternalLoad () [0x00047] in <344420f216234bcc963a3cbf1e979971>:0
  at SanAndreasUnity.Importing.GXT.GXT.Load () [0x00017] in <344420f216234bcc963a3cbf1e979971>:0
  at SanAndreasUnity.Behaviours.Loader.StepLoadGXT () [0x00000] in <344420f216234bcc963a3cbf1e979971>:0
  at SanAndreasUnity.Behaviours.Loader+<LoadCoroutine>d__36.MoveNext () [0x001bb] in <344420f216234bcc963a3cbf1e979971>:0

Thank you for reporting the bug. It's caused by the recent GXT importing code. I didn't get a chance to build it.

I am not sure how to fix this right now. Probably including those DLLs in the project. Or skip GXT loading. Or implementing 1252 encoding manually (there is probably code for this somewhere).

Including the DLLs was a solution that seemed to be widely suggested, but frankly it doesn't exactly sound very robust.
It appears to even be what Unity themselves suggest in their manual.

For now, I will skip GXT loading. GXT is not used in the game anyway.

This is temporarly fixed with dbeaf86.


Feature Request: Italics Mode?

Greetings! I've been using Tol since it was released in 2021, absolutely love it for Elixir, Go & Rust development.
Any possibility of creating an Italics mode or update current mode to support Italics?
I find them helpful for function signatures & calls.
Let me know your thoughts or if no italics support was a design choice.

I don't personally use italic fonts for coding, but I'm happy to take a PR for an italic variant. Unfortunately, JSON theme formats don't make it convenient to just add a feature gate, so the usual approach is to copy the entire theme to a new file under themes/tol-italic.json, add italics to the desired scopes, and then register it as a new theme with "label": "Tol (italic)" in package.json. Alternatively, if the number of scopes you want is small, you can just override locally with "fontStyle": "italic" in settings.json as shown in the README.


[GraphQL/Events][EASY] Event::try_from_stored_transaction clean-ups

Description
Move the impl block after the GraphQL interface, as per-convention, replace
let Some(serialized_event) = stored_tx
    .events
    .get(idx)
    .ok_or_else(|| {
        Error::Internal(format!(
            "Could not find event with event_sequence_number {} at transaction {}",
            idx, stored_tx.tx_sequence_number
        ))
    })?
    .as_ref()
else {
    return Err(Error::Internal(format!(
        "Unexpected None value for event with event_sequence_number {} at transaction {}",
        idx, stored_tx.tx_sequence_number
    )));
};

with
let Some(Some(serialized_event)) = stored_tx.events.get(idx) else {
    return Err(Error::Internal(format!(
        "Could not find event with event_sequence_number {} at transaction {}",
        idx, stored_tx.tx_sequence_number
    )));
};

for readability, and avoid an unnecessary clone (of native_event.contents).
Test Plan
sui-graphql-rpc$ cargo nextest run

No worries! This is a bit of a special case for GraphQL, under the assumption that when you're looking at a module that defines a GraphQL type, you probably care about the implementations of its fields as entrypoints.


Escape character handling problem

When uploading, the command doesn't handle the spaces on the path.
RP2040 Platform (1.2.0)
tool-rp2040tools (1.0.2)
Generating UF2 image
C:\Users\Adam Alfath\.platformio\packages\tool-rp2040tools\elf2uf2 ".pio\build\pico\firmware.elf" ".pio\build\pico\firmware.uf2"
'C:\Users\Adam' is not recognized as an internal or external command,
operable program or batch file.
*** Error 1
Checking size .pio\build\pico\firmware.elf
Advanced Memory Usage is available via "PlatformIO Home > Project Inspect"
RAM:   [==        ]  18.6% (used 50240 bytes from 270336 bytes)
Flash: [          ]   3.5% (used 72392 bytes from 2097152 bytes)
Configuring upload protocol...
AVAILABLE: cmsis-dap, jlink, picotool, raspberrypi-swd
CURRENT: upload_protocol = picotool
Looking for upload port...
Auto-detected: COM56
Forcing reset using 1200bps open/close on port COM56
Uploading .pio\build\pico\firmware.elf
'C:\Users\Adam' is not recognized as an internal or external command,
operable program or batch file.
*** [upload] Error 1

Hi @adamalfath, many thanks for reporting! Should be fixed in the dev branch, please retest with the upstream version of the platform (a Git client is required):
[env:pico]
platform = https://github.com/platformio/platform-raspberrypi.git
framework = arduino
board = pico

@valeros actually I have noticed a regressiion with that commit -- very strangely, the uploading won't work then anymore. It always results in
rp2040load 1.0.1 - compiled with go1.15.8
.....................
*** [upload] Error 1
=============================== [FAILED] Took 14.92 seconds ===============================

when I go into the platform code and change it back to the full path I get
C:\Users\Max\.platformio\packages\tool-rp2040tools\rp2040load -v -D .pio\build\pico_earlephilhower\firmware.elf
rp2040load 1.0.1 - compiled with go1.15.8
.Loading into Flash: [                              ]  0%
Loading into Flash: [=                             ]  6%
Loading into Flash: [===                           ]  12%
Loading into Flash: [=====                         ]  19%
Loading into Flash: [=======                       ]  25%
Loading into Flash: [=========                     ]  31%
Loading into Flash: [===========                   ]  38%
Loading into Flash: [=============                 ]  44%
Loading into Flash: [===============               ]  50%
Loading into Flash: [=================             ]  57%
Loading into Flash: [==================            ]  63%
Loading into Flash: [=====================         ]  70%
Loading into Flash: [======================        ]  76%
Loading into Flash: [========================      ]  82%
Loading into Flash: [==========================    ]  89%
Loading into Flash: [============================  ]  95%
Loading into Flash: [==============================]  100%

=============================== [SUCCESS] Took 4.51 seconds ===============================

Very strange.. Maybe the program doesn't like being called via the PATH and there are some current-working-directory (cwd) issues.

@maxgerhardt Indeed a strange problem, I reversed the changes and wrapped the path to upload tools, so now it should work as expected. Thanks for pointing it out.


fix: properly follow the CLICOLOR standards

See http://bixense.com/clicolors/

@aymanbagabas are we doing this in v2? If not, sounds like we might as well?

@aymanbagabas are we doing this in v2? If not, sounds like we might as well?

Actually this is now part of colorprofile and no longer needed in lipgloss. Closing...


using makefile instead of tasks

Changes Unknown when pulling 9011c0eeca9f6fba619eaffe5dd8086478f805df on makefile into ** on master**.

I also suggest 2 more changes on https://github.com/limetext/lime-backend

IMHO the name of the repo should be limetext/backend not limtext/lime-backend

Also we can now remove the lib directory and move the contents to repo top directory
although I'm not sure this is a good idea

resolves #94

Changes Unknown when pulling 5079c8f555de166a8bac9ace8ac7ee896c25d437 on makefile into ** on master**.

Changes Unknown when pulling d6175991fbf1de9f5ba7b90e7ce7be7c14040d38 on makefile into ** on master**.

Agree about renaming lime-backend to backend. Also if the need for the tasks folder is gone, I don't see why not to move lib into the root.

Though I'm not sure I'm a fan of putting gen_license.go in the root...

Though I'm not sure I'm a fan of putting gen_license.go in the root...

I don't think this is good to also as you said its duplicated across all the projects. I will work on a better solution for this later.


Patches fail to apply when new files are introduced into the appdata application folder

If the build folder, under appdata, contains a new file, such as a log file or crash dump, any attempt to apply a patch will result in a full install download, which is considerably larger than the bsdiff4 based patch.
The problem lies in the calculate_digest function which walks the entire directory of the application. If a file has been created in the build folder, or the user has created a file, such as a shortcut, it will be added to the calculated hash. Since the file doesn't exist at the time the patch is created, the calculated hash and read hash won't match and a PatchError exception is raised. This is silently caught by the update mechanism, and the full (new) build is downloaded.

What is actually the point of the verification step?


Make users profile icon clickable

In the LoginWithDiscordButton component, if the user is logged in, make their profile picture clickable and takes them to their profile page.

Can i work on this?

Can i work on this?

Feel free to. Branch off the Dev branch

Thanks for contributing. Decent implementation. However, the way you implemented the linking was essentially telling the browser to point itself to a new URL and or reload the page. While this is good for linking to external URLs, it's not ideal for navigating within the Next.js framework, as doing it that way, reloads the entire page, also re-mounts all components on that page, causing redundancies in re-mounting already mounted components and triggering its network calls again.
Here is the next.js way:

Create a function that handles the navigation

 const handleNavigation = (path: string) => {         router.push(path)     }

In the return() use onClick to call the handleNavigation function that passes the path to the router.

<Link onClick={() => handleNavigation(/user/${userId})}>                                     <Avatar                                         radius="large"                                         size="5"                                         src={user.user_metadata.avatar_url}                                         fallback={user.user_metadata.custom_claims.global_name.charAt(0)}                                     />                                 </Link>


Enable cpp tests

This PR enables cpp tests to run as part of the CI.
Signed-off-by: Srikar Vanavasam<EMAIL_ADDRESS>

build


dockerd listens on unused port in swarm mode

Description
I have no services that use 80 port:
# docker service inspect `docker service ls -q` | grep Port | grep 80
<nothing here>

But on every node in cluster I have dockerd process that listens to this port:
# netstat -ltnp
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name
tcp6       0      0 :::80                   :::*                    LISTEN      3126/dockerd
tcp6       0      0 :::22                   :::*                    LISTEN      1548/sshd

Steps to reproduce the issue:

Create service that use 80 port on Docker 1.12
Wait 2-3 month
Upgrade Docker to 1.13.1
Remove service

Additional information you deem important (e.g. issue happens only occasionally):
If I create service that uses default port-mapping behavior (via dockerd) - all works fine, and all requests are passed to this service. But when I try to use mode=host,target=80,published=80 - I got error:
[
    {
        "ID": "wzfkjk6u847n0y556hon6rajk",
        "Version": {
            "Index": 400599
        },
        "CreatedAt": "2017-03-02T10:04:20.432246101Z",
        "UpdatedAt": "2017-03-02T10:04:26.81854979Z",
        "Spec": {
            "ContainerSpec": {
                "Image": "balancer:latest@sha256:a3543be3a858c35e08022d6ed1065a6eb5da900ce0fb79c34bf994fc2efd76c1",
                "Hostname": "balancer",
                "StopGracePeriod":<PHONE_NUMBER>0,
                "DNSConfig": {}
            },
            "Resources": {
                "Limits": {},
                "Reservations": {}
            },
            "RestartPolicy": {
                "Condition": "any",
                "Delay":<PHONE_NUMBER>,
                "MaxAttempts": 0
            },
            "Placement": {
                "Constraints": [
                    "node.labels.mission==docker-manager"
                ]
            },
            "Networks": [
                {
                    "Target": "8s8upuu0vheg0skmgfsj4epbk"
                }
            ],
            "LogDriver": {
                "Name": "gelf",
                "Options": {
                    "gelf-address": "udp://localhost:12201",
                    "tag": "balancer"
                }
            },
            "ForceUpdate": 0
        },
        "ServiceID": "e8be3icse8z10t31d7ee7m28h",
        "NodeID": "5lt7gosndij6sva4xusz0xdky",
        "Status": {
            "Timestamp": "2017-03-02T10:04:26.459565365Z",
            "State": "failed",
            "Message": "starting",
            "Err": "starting container failed: container 73a71d2e5052117ff4a62a693af842669be00252b1a3415c5ed43a1fd6794e39: endpoint join on GW Network failed: driver failed programming external connectivity on endpoint gateway_73a71d2e505
2 (00973254ae969c4fa8475e4b2d31c52688bddbe5d303802062b5fd0450da2375): Error starting userland proxy: listen tcp <IP_ADDRESS>:80: bind: address already in use",
            "ContainerStatus": {
                "ContainerID": "73a71d2e5052117ff4a62a693af842669be00252b1a3415c5ed43a1fd6794e39",
                "ExitCode": 128
            },
            "PortStatus": {}
        },
        "DesiredState": "shutdown",
        "NetworksAttachments": [
            {
                "Network": {
                    "ID": "8s8upuu0vheg0skmgfsj4epbk",
                    "Version": {
                        "Index": 399212
                    },
                    "CreatedAt": "2016-12-14T16:15:29.476670623Z",
                    "UpdatedAt": "2017-03-02T06:12:36.251009479Z",
                    "Spec": {
                        "Name": "onenet",
                        "DriverConfiguration": {
                            "Name": "overlay"
                        },
                        "IPAMOptions": {
                            "Driver": {
                                "Name": "default"
                            },
                            "Configs": [
                                {
                                    "Subnet": "<IP_ADDRESS>/24",
                                    "Gateway": "<IP_ADDRESS>"
                                }
                            ]
                        }
                    },
                    "DriverState": {
                        "Name": "overlay",
                        "Options": {
                            "com.docker.network.driver.overlay.vxlanid_list": "262"
                        }
                    },
                    "IPAMOptions": {
                        "Driver": {
                            "Name": "default"
                        },
                        "Configs": [
                            {
                                "Subnet": "<IP_ADDRESS>/24",
                                "Gateway": "<IP_ADDRESS>"
                            }
                        ]
                    }
                },
                "Addresses": [
                    "<IP_ADDRESS>/24"
                ]
            }
        ]
    }
]

Output of docker version:
Client:
 Version:      1.13.1
 API version:  1.26
 Go version:   go1.7.5
 Git commit:   092cba3
 Built:        Wed Feb  8 06:42:29 2017
 OS/Arch:      linux/amd64

Server:
 Version:      1.13.1
 API version:  1.26 (minimum version 1.12)
 Go version:   go1.7.5
 Git commit:   092cba3
 Built:        Wed Feb  8 06:42:29 2017
 OS/Arch:      linux/amd64
 Experimental: false

Output of docker info:
Containers: 202
 Running: 0
 Paused: 0
 Stopped: 202
Images: 11
Server Version: 1.13.1
Storage Driver: aufs
 Root Dir: /var/lib/docker/aufs
 Backing Filesystem: extfs
 Dirs: 458
 Dirperm1 Supported: true
Logging Driver: json-file
Cgroup Driver: cgroupfs
Plugins:
 Volume: local
 Network: bridge host macvlan null overlay
Swarm: active
 NodeID: 75bbuzc5vxmu1zpbbfdr0xuj2
 Is Manager: true
 ClusterID: c9i27x67p4vr4vkzo143b61nd
 Managers: 3
 Nodes: 15
 Orchestration:
  Task History Retention Limit: 5
 Raft:
  Snapshot Interval: 10000
  Number of Old Snapshots to Retain: 0
  Heartbeat Tick: 1
  Election Tick: 3
 Dispatcher:
  Heartbeat Period: 5 seconds
 CA Configuration:
  Expiry Duration: 3 months
 Node Address: X.X.X.X
 Manager Addresses:
  X.X.X.X:2377
  Y.Y.Y.Y:2377
  Z.Z.Z.Z:2377
Runtimes: runc
Default Runtime: runc
Init Binary: docker-init
containerd version: aa8187dbd3b7ad67d8e5e3a15115d3eef43a7ed1
runc version: 9df8b306d01f59d3a8029be411de015b7304dd8f
init version: 949e6fa
Security Options:
 apparmor
Kernel Version: 4.4.0-64-generic
Operating System: Ubuntu 14.04.5 LTS
OSType: linux
Architecture: x86_64
CPUs: 1
Total Memory: 992.5 MiB
Name: dmgr-01
ID: WHST:GMS2:WKVW:UW4M:EW7G:5AXM:EH44:A4CG:AWZ6:5PID:NG24:DAFR
Docker Root Dir: /var/lib/docker
Debug Mode (client): false
Debug Mode (server): false
Username: filiatixbot
Registry: https://index.docker.io/v1/
WARNING: No swap limit support
Experimental: false
Insecure Registries:
 <IP_ADDRESS>/8
Live Restore Enabled: false

Are there any way to get access to internal Docker-Swarm-Mode key-value store and edit values?


MINOR: Add test case for follower fetch

This PR adds a test case for follower fetch when segments are archived and expired from remote storage. This test case verifies the following scenario (from comment):

Leader is archiving to tiered storage and has a follower.
Follower has caught up to offset X (exclusive).
While follower is offline, leader moves X to tiered storage and expires data locally till Y, such that, Y = leaderLocalLogStartOffset and leaderLocalLogStartOffset > X. Meanwhile, X has been expired from tiered storage as well. Hence, X < globalLogStartOffset.
Follower comes online and tries to fetch X from leader.

Committer Checklist (excluded from commit message)

[x] Verify design and implementation
[x] Verify test coverage and CI build status

@showuon @divijvaidya thanks for your reviews! I have addressed all the comments, and believe this PR is ready to be merged.

@divijvaidya , do you want to have another look at this PR?

Apologies for the delay. This dropped off my radar. I don't fully understand why first fetch call wouldn't move start offset directly to 5 but that's on me. I need to dig a bit more in the code to understand his better. Please don't wait for me to merge this in.


Remove variable shadowing?

What is a good use of overshadowing a variable?

I'm thinking maybe that overshadowing should require an extra keyword rather than being the default (depending on context?)? I think some language do this already...

zig doesn't allow shadowing. another point to disallow this... :)


Average number is 0 for CPU

Describe the bug
I am trying to get in real time the cpu usage statistic, ram usage statistic, HHD/SSD usage statistic and internet usage statistic.
When I am trying to get the avg load for the cpu then it is 0 everytime. I did request the currentLoad but it is not correct with the task manager.
To Reproduce
Steps to reproduce the behavior:

I installed the systeminformation package
I did import the package as in the example documentation:
const si = require('systeminformation');
I did use this code:

setInterval(function () {
       si.currentLoad().then(data => {
           console.log(data.avgLoad);
       })
   }, 1000)

Current Output
I get this:
{
  avgLoad: 0,
  currentLoad: 62.72130329980883,
  currentLoadUser: 57.91704762696368,
  currentLoadSystem: 4.546587981048957,
  currentLoadNice: 0,
  currentLoadIdle: 37.27869670019117,
  currentLoadIrq: 0.25766769179619314,
  rawCurrentLoad: 7546,
  rawCurrentLoadUser: 6968,
  rawCurrentLoadSystem: 547,
  rawCurrentLoadNice: 0,
  rawCurrentLoadIdle: 4485,
  rawCurrentLoadIrq: 31,
  cpus: [
    {
      load: 100,
      loadUser: 78.77906976744185,
      loadSystem: 18.217054263565892,
      loadNice: 0,
      loadIdle: 0,
      loadIrq: 3.003875968992248,
      rawLoad: 1032,
      rawLoadUser: 813,
      rawLoadSystem: 188,
      rawLoadNice: 0,
      rawLoadIdle: 0,
      rawLoadIrq: 31
    },
    {
      load: 20.3,
      loadUser: 15.6,
      loadSystem: 4.7,
      loadNice: 0,
      loadIdle: 79.7,
      loadIrq: 0,
      rawLoad: 203,
      rawLoadUser: 156,
      rawLoadSystem: 47,
      rawLoadNice: 0,
      rawLoadIdle: 797,
      rawLoadIrq: 0
    },
    {
      load: 100,
      loadUser: 100,
      loadSystem: 0,
      loadNice: 0,
      loadIdle: 0,
      loadIrq: 0,
      rawLoad: 1000,
      rawLoadUser: 1000,
      rawLoadSystem: 0,
      rawLoadNice: 0,
      rawLoadIdle: 0,
      rawLoadIrq: 0
    },
    {
      load: 25,
      loadUser: 20.3,
      loadSystem: 4.7,
      loadNice: 0,
      loadIdle: 75,
      loadIrq: 0,
      rawLoad: 250,
      rawLoadUser: 203,
      rawLoadSystem: 47,
      rawLoadNice: 0,
      rawLoadIdle: 750,
      rawLoadIrq: 0
    },
    {
      load: 100,
      loadUser: 100,
      loadSystem: 0,
      loadNice: 0,
      loadIdle: 0,
      loadIrq: 0,
      rawLoad: 1000,
      rawLoadUser: 1000,
      rawLoadSystem: 0,
      rawLoadNice: 0,
      rawLoadIdle: 0,
      rawLoadIrq: 0
    },
    {
      load: 26.573426573426573,
      loadUser: 21.878121878121878,
      loadSystem: 4.695304695304695,
      loadNice: 0,
      loadIdle: 73.42657342657343,
      loadIrq: 0,
      rawLoad: 266,
      rawLoadUser: 219,
      rawLoadSystem: 47,
      rawLoadNice: 0,
      rawLoadIdle: 735,
      rawLoadIrq: 0
    },
    {
      load: 100,
      loadUser: 100,
      loadSystem: 0,
      loadNice: 0,
      loadIdle: 0,
      loadIrq: 0,
      rawLoad: 1000,
      rawLoadUser: 1000,
      rawLoadSystem: 0,
      rawLoadNice: 0,
      rawLoadIdle: 0,
      rawLoadIrq: 0
    },
    {
      load: 32.732732732732735,
      loadUser: 23.423423423423422,
      loadSystem: 9.30930930930931,
      loadNice: 0,
      loadIdle: 67.26726726726727,
      loadIrq: 0,
      rawLoad: 327,
      rawLoadUser: 234,
      rawLoadSystem: 93,
      rawLoadNice: 0,
      rawLoadIdle: 672,
      rawLoadIrq: 0
    },
    {
      load: 100,
      loadUser: 98.49849849849849,
      loadSystem: 1.5015015015015014,
      loadNice: 0,
      loadIdle: 0,
      loadIrq: 0,
      rawLoad: 999,
      rawLoadUser: 984,
      rawLoadSystem: 15,
      rawLoadNice: 0,
      rawLoadIdle: 0,
      rawLoadIrq: 0
    },
    {
      load: 18.8,
      loadUser: 15.6,
      loadSystem: 3.2,
      loadNice: 0,
      loadIdle: 81.2,
      loadIrq: 0,
      rawLoad: 188,
      rawLoadUser: 156,
      rawLoadSystem: 32,
      rawLoadNice: 0,
      rawLoadIdle: 812,
      rawLoadIrq: 0
    },
    {
      load: 100,
      loadUser: 100,
      loadSystem: 0,
      loadNice: 0,
      loadIdle: 0,
      loadIrq: 0,
      rawLoad: 1000,
      rawLoadUser: 1000,
      rawLoadSystem: 0,
      rawLoadNice: 0,
      rawLoadIdle: 0,
      rawLoadIrq: 0
    },
    {
      load: 28.1,
      loadUser: 20.3,
      loadSystem: 7.8,
      loadNice: 0,
      loadIdle: 71.89999999999999,
      loadIrq: 0,
      rawLoadUser: 203,
      rawLoadSystem: 78,
      rawLoadNice: 0,
      rawLoadIdle: 719,
      rawLoadIrq: 0
    }
  ]
}

Expected behavior
Giving the correct avg value.
Environment (please complete the following information):

systeminformation package version: 5.9.2
OS: Windows 10 Pro x64
OS Build: 19043.1237
Hardware CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz   3.70 GHz
Hardware Motherboard: MSI Z370 TOMAHAWK (MS-7B47)

Additional context
I don't know if it is the right method to check the CPU, Memory and other components load which could be seen in the task manager. If there is better method then I am open to every methods.

@StrangerGithuber as described in the docs (https://systeminformation.io/processes.html), avgLoadis currently not supported for windows. If you have an Idea, what value would be appropriate for that (and how to get this), I would of course consider to implement and add this here.

Ah ok. Unfortunately I can't say much how it should be done. I am not a pro programmer sadly. I hope someone can give a suggestion for you. :)

@sebhildebrandt if you're fine with 3rd party node modules, you could try using
this node module I found.
And then do some variable and if statement trickery to differentiate the windows loadavg code from the Unix loadavg code, use the windows loadavg only if the OS equals some version windows, or something like that
It'd probably the best way to get loadavg on windows, if you decide you want to implement the feature...

@BitesPotatoBacks Thank you, I already thought of implementing it the same way ... there is only one downside, As this has to keep its own stats (for the last 15 min) you need to call this regularly to get correct values. I still think that having it this way is better then nothing ;-) ... will try to come up with a solution as soon as I have time for it.

I'd just like to mention the fact that native os.cpus() returns idle/tick values properly on windows which can be used to calculate the CPU usage over a certain span of time, though it would need to be done periodically in the background.


swayosd: unstable-2023-05-09 -> unstable-2023-07-18

Description of changes
swayosd: unstable-2023-05-09 -> unstable-2023-07-18
Things done

Built on platform(s)

[X] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[X] Tested basic functionality of all binary files (usually in ./result/bin/)
23.11 Release Notes (or backporting 23.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

This pull request has been mentioned on NixOS Discourse. There might be relevant details there:
https://discourse.nixos.org/t/prs-ready-for-review/3032/2439


[FR]: LiteLLM integration

Willingness to contribute
No. I can't contribute this feature at this time.
Proposal summary
Add Litellm integration
Motivation
https://www.litellm.ai/ (including Litellm proxy) is a leightweight wrapper that makes models openai compartible. opik will benefit a lot if it will add its integration

Hi @antonkulaga ! we have an open PR with litellm for an Opik Integration! Would appreciate any comments/upvotes on the PR to get it merged soon!

Thank you @sherpan ! I see your PR was merged, so now looking forward for litellm specific opik setup instruction to test it in our projects

can anyone elaborate the issue

@antonkulaga @veer-debug The PR was indeed merged but the integration was not implemented. Based on feedback from the LiteLLM team, we re-implemented the integration in this PR: https://github.com/BerriAI/litellm/pull/6062
We are currently waiting for the LiteLLM team to get back to us as we ran into an issue with the recommended approach, we are hoping to hear back and have the integration merged in soon !

@veer-debug @antonkulaga The integration was merged and the documentation was updated: https://www.comet.com/docs/opik/tracing/integrations/litellm
If you have any questions, let me know


Error on 'charmap' codec can't encode character

Hi,
Can someone explain why I'm experiencing this. I tried different urls and same outcome :
🌟 Welcome to the Crawl4ai Quickstart Guide! Let's dive into some web crawling fun! 🌐
⛳ First Step: Create an instance of WebCrawler and call the `warmup()` function.
If this is the first time you're running Crawl4ai, this might take a few seconds to load required model files.
[LOG] 🚀 Initializing LocalSeleniumCrawlerStrategy

DevTools listening on ws://<IP_ADDRESS>:61566/devtools/browser/ff15fd50-5eab-447a-97bb-1ca9d57126bb
[LOG] 🌤  Warming up the WebCrawler
Error retrieving cached URL: no such column: links
[LOG] 🌞 WebCrawler is ready to crawl
🛠  Basic Usage: Simply provide a URL and let Crawl4ai do the magic!
[LOG] 🕸 Crawling https://www.morningstar.fr/fr using LocalSeleniumCrawlerStrategy...
Checking page load: 0
Checking page load: 1
Checking page load: 2
Checking page load: 3
Checking page load: 4
Checking page load: 5
[ERROR] 🚫 Failed to crawl https://www.morningstar.fr/fr, error: Failed to crawl https://www.morningstar.fr/fr: 'charmap' codec can't encode character '\uff1a' in position 237304: character maps to <undefined>
[LOG] 📦 Basic crawl result:
        Result:
        url: https://www.mornings...
        error_message: Failed to crawl http...

Windows 11
Python 3.11
Any insight ?

Hi,
Can someone explain why I'm experiencing this. I tried different urls and same outcome :
🌟 Welcome to the Crawl4ai Quickstart Guide! Let's dive into some web crawling fun! 🌐
⛳ First Step: Create an instance of WebCrawler and call the `warmup()` function.
If this is the first time you're running Crawl4ai, this might take a few seconds to load required model files.
[LOG] 🚀 Initializing LocalSeleniumCrawlerStrategy

DevTools listening on ws://<IP_ADDRESS>:61566/devtools/browser/ff15fd50-5eab-447a-97bb-1ca9d57126bb
[LOG] 🌤  Warming up the WebCrawler
Error retrieving cached URL: no such column: links
[LOG] 🌞 WebCrawler is ready to crawl
🛠  Basic Usage: Simply provide a URL and let Crawl4ai do the magic!
[LOG] 🕸 Crawling https://www.morningstar.fr/fr using LocalSeleniumCrawlerStrategy...
Checking page load: 0
Checking page load: 1
Checking page load: 2
Checking page load: 3
Checking page load: 4
Checking page load: 5
[ERROR] 🚫 Failed to crawl https://www.morningstar.fr/fr, error: Failed to crawl https://www.morningstar.fr/fr: 'charmap' codec can't encode character '\uff1a' in position 237304: character maps to <undefined>
[LOG] 📦 Basic crawl result:
        Result:
        url: https://www.mornings...
        error_message: Failed to crawl http...

Windows 11 Python 3.11
Any insight ?

got same error why scraping the url if you found the solution then please share your solution

@arcontechnologies  @Nikky000 This has been fixed and will be part of version 0.2.73 soon.

@Ritha24 @Udara-Sampath The issue with llama3 is its inability to generate correct JSON, causing trouble in converting it to standard JSON. We are striving to introduce an additional layer to assist smaller or inadequately trained models producing JSON output. It's important to note that we can't guarantee complete accuracy, especially with smaller models. We are considering implementing a fallback model. Nevertheless, the upcoming helper layer is expected to address the majority of these issues, so please stay updated.

I am also getting the same error
[LOG] 🚀 Initializing LocalSeleniumCrawlerStrategy

DevTools listening on ws://<IP_ADDRESS>:55270/devtools/browser/047fe112-fa77-4808-a19d-4e8330e43b76
[LOG] 🌤  Warming up the WebCrawler
Error retrieving cached URL: no such column: links
[LOG] 🌞 WebCrawler is ready to crawl
Error retrieving cached URL: no such column: links
[ERROR] 🚫 Failed to crawl https://openai.com/api/pricing/, error: Failed to crawl https://openai.com/api/pricing/: 'charmap' codec can't encode character '\U0001f47b' in position 71832: character maps to <undefined>
None

@xarchangel12 Please remove the "~/.crawl4ai" folder, as you're using the old cache database version. My bad for not removing it during the new version install. I'm pushing 0.2.74, so you can reinstall it. In the meantime, remove the folder and then install the library again.

@unclecode Hi, Still dealing with same error after upgrading to 0.2.73 and removing the .crawl4ai cache.
Welcome to the Crawl4ai Quickstart Guide! Let's dive into some web crawling fun! 🌐
⛳ First Step: Create an instance of WebCrawler and call the warmup() function.
If this is the first time you're running Crawl4ai, this might take a few seconds to load required model files.
[LOG] 🚀 Initializing LocalSeleniumCrawlerStrategy
DevTools listening on ws://<IP_ADDRESS>:65485/devtools/browser/4abcfd66-2a6b-4e93-aee4-3bf423bec128
[LOG] 🌤  Warming up the WebCrawler
Error retrieving cached URL: no such column: links
[LOG] 🌞 WebCrawler is ready to crawl
🛠  Basic Usage: Simply provide a URL and let Crawl4ai do the magic!
[LOG] 🕸 Crawling https://openai.com/api/pricing/ using LocalSeleniumCrawlerStrategy...
[ERROR] 🚫 Failed to crawl https://openai.com/api/pricing/, error: Failed to crawl https://openai.com/api/pricing/: 'charmap' codec can't encode character '\U0001f47b' in position 74044: character maps to
[LOG] 📦 Basic crawl result:
Result:
url: https://openai.com/a...
error_message: Failed to crawl http...

@arcontechnologies Please clone the latest version from this link "https://github.com/unclecode/crawl4ai/tree/v0.2.74", ensure to remove the ".crawl4ai" folder. Afterwards, execute the provided code in a separate file, and instead of running the quickstart.py, run this code using your current version. Please let me know.
import os
import sys
from pathlib import Path
import numpy as np
from crawl4ai.extraction_strategy import LLMExtractionStrategy
from crawl4ai.crawler_strategy import LocalSeleniumCrawlerStrategy
from crawl4ai.web_crawler import WebCrawler
from pydantic import BaseModel, Field

class OpenAIModelFee(BaseModel):
    model_name: str = Field(..., description="Name of the OpenAI model.")
    input_fee: str = Field(..., description="Fee for input token for the OpenAI model.")
    output_fee: str = Field(..., description="Fee for output token ßfor the OpenAI model.")

crawler = WebCrawler()
crawler.warmup()

url = r'https://openai.com/api/pricing/'

# Fetch a single page
result = crawler.run(
    url=url,
    word_count_threshold=1,
    extraction_strategy= LLMExtractionStrategy(
        provider= "openai/gpt-4o", api_token = os.getenv('OPENAI_API_KEY'),
        schema=OpenAIModelFee.model_json_schema(),
        extraction_type="schema",
        instruction="""From the crawled content, extract all mentioned model names along with their fees for input and output tokens.
        Do not miss any models in the entire content. One extracted model JSON format should look like this:
        {"model_name": "GPT-4", "input_fee": "US$10.00 / 1M tokens", "output_fee": "US$30.00 / 1M tokens"}."""
    ),
    bypass_cache=True,
)

https://github.com/unclecode/crawl4ai/tree/v0.2.74

I deleted the "~/.crawl4ai" folder and I am still facing the same error
[LOG] 🚀 Initializing LocalSeleniumCrawlerStrategy

DevTools listening on ws://<IP_ADDRESS>:51441/devtools/browser/2ced0dd3-a5e7-41a0-91c9-e58b1ea06d8a
[LOG] 🌤  Warming up the WebCrawler
Error retrieving cached URL: no such column: links
[LOG] 🌞 WebCrawler is ready to crawl
Error retrieving cached URL: no such column: links
[ERROR] 🚫 Failed to crawl https://openai.com/api/pricing/, error: Failed to crawl https://openai.com/api/pricing/: 'charmap' codec can't encode character '\U0001f47b' in position 72375: character maps to <undefined>
None

and here is the test code I used like in the video

crawler = WebCrawler()

crawler.warmup()

result = crawler.run(url="https://openai.com/api/pricing/")
print(result.markdown)

@xarchangel12 Found it at last! I had been searching for this for a few days! Could you kindly clean up everything, then proceed with these steps and test your code again? The code below shows how I tested it on my Windows system. It is now functioning after resolving the problem.
mkdir crawl4ai-v74
git clone -b v0.2.74 https://github.com/unclecode/crawl4ai .\crawl4ai-v74\
py -3.11 -m venv myenv
pip install -e .

@xarchangel12 I have already pushed the latest version so you can clone the main branch and no need "v0.2.74", thx

@arcontechnologies Thx for your nice words and you are absolutely right. I will update it soon.


Gate API: Remove BPN from Business Partner Input

It makes no sense that a sharing member can set the BPN in the Gate as it is a derived value from our golden record process. It is unclear in what way a self-set BPN would help the overall process, if it all. Therefore, the BPN field should be removed in all Business Partner Input DTOs.

BPN should not be removed from the entities as it would be needed for the output DTOs


CoreSimulator folder permissions issue on some Mac machines

Build
https://dev.azure.com/dnceng-public/public/_build/results?buildId=822026
Build leg reported
E2E Apple - Simulator Commands Helix Tests Build_Debug
Pull Request
https://github.com/dotnet/xharness/pull/1282
Known issue core information
Fill out the known issue JSON section by following the step by step documentation on how to create a known issue
{
  "ErrorPattern": "permission to save the file.*in the folder.*CoreSimulator",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

@dotnet/dnceng

Release Note Category

[ ] Feature changes/additions
[ ] Bug fixes
[ ] Internal Infrastructure Improvements

Release Note Description
Additional information about the issue reported
Build error leg or test failing:

Failed job: E2E Apple - Simulator Commands Helix Tests Build_Debug
Failed test: System.Numerics.Vectors.Tests

When testing simulator commands on some machines we get:
[08:21:48] dbug: Running /Applications/Xcode_14.3.app/Contents/Developer/usr/bin/simctl boot 4B1F47EA-7853-45DF-B459-37A3E6BCABF8
[08:21:49] dbug: An error was encountered processing the command (domain=NSCocoaErrorDomain, code=513):
[08:21:49] dbug: You don’t have permission to save the file “4B1F47EA-7853-45DF-B459-37A3E6BCABF8” in the folder “CoreSimulator”.
[08:21:49] dbug: You don’t have permission.
[08:21:49] dbug: To view or change permissions, select the item in the Finder and choose File > Get Info.
[08:21:49] dbug: Underlying error (domain=NSPOSIXErrorDomain, code=13):
[08:21:49] dbug: The operation couldn’t be completed. Permission denied
[08:21:49] dbug: Permission denied
[08:21:49] dbug: Process simctl exited with 1

Full log for context as it repeats the permission denied throughout the sequence: https://helixre107v0xdeko0k025g8.blob.core.windows.net/dotnet-xharness-refs-pull-1282-merge-6620621afd364a37b1/System.Numerics.Vectors.Tests.Attempt.3/1/console.fd153acd.log?helixlogtype=result
Additional info
This was occurring before as reported in: https://github.com/dotnet/dnceng/issues/1878

Known issue validation
Build: :mag_right: https://dev.azure.com/dnceng-public/public/_build/results?buildId=822026
Error message validated: [permission to save the file.*in the folder.*CoreSimulator]
Result validation: :white_check_mark: Known issue matched with the provided build.
Validation performed at: 10/1/2024 2:44:39 PM UTC

This is happening on dci-mac-build-250
Can someone please log in to dci-mac-build-250 via KVM please check the folder permissions.


gRPC static library

We have https://github.com/apache/skywalking-goapi for the upstream, do you consider we have a skywalking-api-php repo in this org. So you could recompile it first?


Can you provide the code for visualizing your Gradcam?

Can you provide the code for visualizing your Gradcam？I cannot reproduce the results of your paper.

Have you resolved this issue?

你解决了这个问题吗？
I have trained several seeds, but according to the method of the paper, none of them can reproduce the results of the paper

你解决了这个问题吗？

If you can reproduce the results, can you help me

I can't resolve this issue either


Renamed WTS into XYZ (user layers)

No much to review, I just want you to let you know.

Please add changes to CHANGES.md for this and also for bar chart

Done!


panic during tags processing

At the Process method iteration is done over the fields slice, but tags variable is being assigned to the tagsGroup slice element with an index which can be out of range. This happens in the case when the tags contain a typo.
For example, this code would fail with panic:
package config

type Config struct {
	Host string `envconfig:"HOST" required:"true"`
	Port string `envconfig:"PORT" required:"true`
}

panic: runtime error: index out of range [1] with length 1

Are you using tagalign binary in standalone mode?  If so, then I can feel you.
tagalign should check if the  tags syntax are correct and provide more specific error messages when errors are detected, rather than panic.
Will fix it.

I use it with the gitlabci-lint, but since tagalign fails with panic, gitlabci-lint cannot handle it well
Thanks for looking into that!

In most cases, the structtag analyzer will report these syntax issues in development stage.
Anyway, I'll see what tagalign can do.

I was just hit by this.


Wrap JS in missing callbacks for DOMContentLoaded

Until now, those calls have been executed synchronously with the call of addEventListener. This was not really an issue, because those script-tags where placed after the relevant DOM nodes, but it may lead to bugs in the future if those scripts or the HTML get moved.
I've found those calls while implementing #9528, where I've first copied the lines from https://github.com/wagtail/wagtail/blob/b84825487381b3d5ac7bb0859924c20157227d61/wagtail/admin/templates/wagtailadmin/home/locked_pages.html#L56-L59 and wondered, why they aren't working in for the side panel.
Testing:

locked_pages.html
Lock a page, go to the CMS homepage, click the unlock-button -> should unlock it.
workflow_pages_to_moderate.html
Edit a page and submit it for moderation, go to the CMS homepage and use one of the moderation actions (e.g. approve with comment) -> should execute the action or open an overlay.

Please check the following:

[x] Do the tests still pass?[^1]
[x] Does the code comply with the style guide?

[x] Run make lint from the Wagtail root.

[ ] For front-end changes: Did you test on all of Wagtail’s supported environments?[^2]

[ ] Please list the exact browser and operating system versions you tested: Firefox 106 (Linux Mint)
[ ] Please list which assistive technologies [^3] you tested:

Please describe additional details for testing this change.
[^1]: Development Testing
[^2]: Browser and device support
[^3]: Accessibility Target

Code looks good - thanks @th3hamm0r !
I will run it locally to be 100% sure though.

Cherry pick into 4.1 stable branch<PHONE_NUMBER>c54f8674a33b48b52f39a61a76126e


Revert "python312Packages.numba: use a single numpy version; don't propagate it"

Description of changes
This reverts commit https://github.com/NixOS/nixpkgs/commit/3bad18825ec132da9f34a41f37cc28e26084862e.
Numba doesn't work without NumPy and it's in upstream's setup_requires as well as install_requires.

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
24.11 Release Notes (or backporting 23.11 and 24.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

If there was a single numpy version in all of python3.pkgs

There is, at least once this PR is merged. Every Python package uses numpy rather than numpy_2.

If you'd be able to iterate all usages of numpy_1 and make sure that there are no breakages when that is upgraded to numpy_2, I will let it go.

I already showed you how you'd make sure of that: https://github.com/NixOS/nixpkgs/pull/327446#issuecomment-2323417416
@doronbehar Honestly, you're not engaging with my proposed solutions so I don't see why I should keep arguing against your non-solution.
But again, it's a non-solution because as of right now, python3.withPackages (ps: [ ps.numba ]) is broken:
$ python3 -c "import numba"
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/nix/store/w5af1gfflkph66mrghmqdhvxspz2dl7y-python3-3.12.5-env/lib/python3.12/site-packages/numba/__init__.py", line 54, in <module>
    _ensure_critical_deps()
  File "/nix/store/w5af1gfflkph66mrghmqdhvxspz2dl7y-python3-3.12.5-env/lib/python3.12/site-packages/numba/__init__.py", line 34, in _ensure_critical_deps
    import numpy as np
ModuleNotFoundError: No module named 'numpy'


Add time filtering for prompt leaderboard

i.e. last 90 days, last week, etc.

I was thinking top X of last day, week, month, all time

Redundant with #101


Does transient properties get sync with ensemble?

I have transient property on my model, but it doesn't seem to sync this is by design? Can I do anything to make this sync?

If it is transient, it won't sync. That would make no sense. It is never stored in the store, so never synced to another store.
You should make it non transient if it needs to sync. Transients are for in memory variables only used on one device, and discarded on quit.
Kind regards,
Drew

On 09 Apr 2016, at 09:30, Sarun Wongpatcharapakorn<EMAIL_ADDRESS>wrote:
I have transient property on my model, but it doesn't seem to sync this is by design? Can I do anything to make this sync?
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub