Tiktoken 0.7.0 read-only system error in AWS Lamda

Using latest version from main with model gpt-4o throws the following error when running on AWS Lamda:
Failed to clip tokens: [Errno 30] Read-only file system: '/var/lang/lib/python3.10/site-packages/litellm/llms/tokenizers/fb374d419588a4632f3f557e76b4b70aebbca790.3633445e-4ab0-4767-8f6a-0cd5fd32eb79.tmp'\n

Stack trace
[ERROR]	2024-05-17T13:42:14.431Z	9c2023d9-ecea-430c-bb8c-b115540613c0	An error occurred running the application.
--
Traceback (most recent call last):
File "/var/lang/lib/python3.10/site-packages/mangum/protocols/http.py", line 58, in run
await app(self.scope, self.receive, self.send)
File "/var/lang/lib/python3.10/site-packages/fastapi/applications.py", line 290, in __call__
await super().__call__(scope, receive, send)
File "/var/lang/lib/python3.10/site-packages/starlette/applications.py", line 122, in __call__
await self.middleware_stack(scope, receive, send)
File "/var/lang/lib/python3.10/site-packages/starlette/middleware/errors.py", line 184, in __call__
raise exc
File "/var/lang/lib/python3.10/site-packages/starlette/middleware/errors.py", line 162, in __call__
await self.app(scope, receive, _send)
File "/var/lang/lib/python3.10/site-packages/starlette_context/middleware/raw_middleware.py", line 92, in __call__
await self.app(scope, receive, send_wrapper)
File "/var/lang/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 79, in __call__
raise exc
File "/var/lang/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 68, in __call__
await self.app(scope, receive, sender)
File "/var/lang/lib/python3.10/site-packages/fastapi/middleware/asyncexitstack.py", line 20, in __call__
raise e
File "/var/lang/lib/python3.10/site-packages/fastapi/middleware/asyncexitstack.py", line 17, in __call__
await self.app(scope, receive, send)
File "/var/lang/lib/python3.10/site-packages/starlette/routing.py", line 718, in __call__
await route.handle(scope, receive, send)
File "/var/lang/lib/python3.10/site-packages/starlette/routing.py", line 276, in handle
await self.app(scope, receive, send)
File "/var/lang/lib/python3.10/site-packages/starlette/routing.py", line 66, in app
response = await func(request)
File "/var/lang/lib/python3.10/site-packages/fastapi/routing.py", line 241, in app
raw_response = await run_endpoint_function(
File "/var/lang/lib/python3.10/site-packages/fastapi/routing.py", line 167, in run_endpoint_function
return await dependant.call(**values)
File "/var/task/pr_agent/servers/github_app.py", line 51, in handle_github_webhooks
response = await handle_request(body, event=request.headers.get("X-GitHub-Event", None))
File "/var/task/pr_agent/servers/github_app.py", line 273, in handle_request
await handle_comments_on_pr(body, event, sender, sender_id, action, log_context, agent)
File "/var/task/pr_agent/servers/github_app.py", line 117, in handle_comments_on_pr
await agent.handle_request(api_url, comment_body,
File "/var/task/pr_agent/agent/pr_agent.py", line 93, in handle_request
await command2class[action](pr_url, ai_handler=self.ai_handler, args=args).run()
File "/var/task/pr_agent/tools/pr_reviewer.py", line 75, in __init__
self.token_handler = TokenHandler(
File "/var/task/pr_agent/algo/token_handler.py", line 47, in __init__
self.encoder = TokenEncoder.get_token_encoder()
File "/var/task/pr_agent/algo/token_handler.py", line 19, in get_token_encoder
cls._encoder_instance = encoding_for_model(cls._model) if "gpt" in cls._model else get_encoding(
File "/var/lang/lib/python3.10/site-packages/tiktoken/model.py", line 103, in encoding_for_model
return get_encoding(encoding_name_for_model(model_name))
File "/var/lang/lib/python3.10/site-packages/tiktoken/registry.py", line 73, in get_encoding
enc = Encoding(**constructor())
File "/var/lang/lib/python3.10/site-packages/tiktoken_ext/openai_public.py", line 92, in o200k_base
mergeable_ranks = load_tiktoken_bpe(
File "/var/lang/lib/python3.10/site-packages/tiktoken/load.py", line 147, in load_tiktoken_bpe
contents = read_file_cached(tiktoken_bpe_file, expected_hash)
File "/var/lang/lib/python3.10/site-packages/tiktoken/load.py", line 74, in read_file_cached
with open(tmp_filename, "wb") as f:
OSError: [Errno 30] Read-only file system: '/var/lang/lib/python3.10/site-packages/litellm/llms/tokenizers/fb374d419588a4632f3f557e76b4b70aebbca790.e359bd26-b7da-4e24-9920-26bb937d278e.tmp'

requirements.txt
aiohttp==3.9.1
atlassian-python-api==3.41.4
azure-devops==7.1.0b3
azure-identity==1.15.0
boto3==1.33.6
dynaconf==3.2.4
fastapi==0.99.0
GitPython==3.1.32
google-cloud-aiplatform==1.35.0
google-cloud-storage==2.10.0
Jinja2==3.1.2
litellm==1.31.10
loguru==0.7.2
msrest==0.7.1
openai==1.13.3
pytest==7.4.0
PyGithub==1.59.*
PyYAML==6.0.1
python-gitlab==3.15.0
retry==0.9.2
starlette-context==0.3.6
tiktoken==0.7.0
ujson==5.8.0
uvicorn==0.22.0
tenacity==8.2.3

I tried using the env variable TIKTOKEN_CACHE_DIR pointing to /tmp since it seems it can be used to setup de temporary cache dir in here with no success, it still creates the temp file in the read only filesystem.

We need the new Tiktoken for GPT-4o model, so this new requirement will stay.
You can always use a previous release of PR-Agent, but this seems to be a problem of AWS lambda that should be solved, one way or another.
Maybe contact them, or try other workarounds.
If you do find a workaround, share and we will add it to the docs.

I did some debugging trying to find a workaround and the only one I found was setting TIKTOKEN_CACHE_DIR but that didn't work because litellm is overwriting that environment variable (see this PR https://github.com/BerriAI/litellm/pull/1947) so I'm unable to pass a writable directory for AWS Lamda.
This issue is clearly related to this other issue in litellm: https://github.com/BerriAI/litellm/issues/2607.
I'll also report it in that issue to see if there is any fix coming. Until this is fixed I guess AWS Lamda users will not be able to use the latest gpt-4o model with the pr agent.

Any update to this? I'm running into the same issue here. gpt-4o was working fine via lambda and litellm up until today for me without any changes. I tried implementing the TIKTOKEN_CACHE_DIR=/tmp like @maurobender suggested, but still no luck (I see the PR is closed - so maybe I'm setting that up wrong?)

https://github.com/BerriAI/litellm/issues/2607#issuecomment-2162860092

https://github.com/BerriAI/litellm/pull/4119 released on litellm v1.40.9
We can use environment variable CUSTOM_TIKTOKEN_CACHE_DIR

@mrT23
I think we can fix it by updating litellm from 1.31.10 to v1.40.9 and set CUSTOM_TIKTOKEN_CACHE_DIR to /tmp
https://github.com/BerriAI/litellm/issues/2607#issuecomment-2162860092

https://github.com/BerriAI/litellm/pull/4119 released on litellm v1.40.9
We can use environment variable CUSTOM_TIKTOKEN_CACHE_DIR

https://github.com/Codium-ai/pr-agent/blob/v0.22/requirements.txt#L12

litellm==1.31.10

@mrT23 This was marked as fixed but I don't see a commit changing litellm as suggested.
Will this still be changed or is it not likely to happen soon?

@s1moe2
My bad. We had a PR to upgrade litellm last week, but i did not reach that version
anyway, not trivial to upgrade to latest llm, but I think I was able to solve all the dependencies
https://github.com/Codium-ai/pr-agent/pull/989

We deployed a new docker. You can retry using this suggestion:
https://github.com/Codium-ai/pr-agent/issues/909#issuecomment-2162887300
And let use know if it works now


amplify commands not working out of the blue

How did you install the Amplify CLI?
npm
If applicable, what version of Node.js are you using?
v18.12.0
Amplify CLI Version
10.8.1
What operating system are you using?
Windows 10
Did you make any manual changes to the cloud resources managed by Amplify? Please describe the changes made.
No
Describe the bug
Getting below message for any amplify command:
End of input while parsing an object (missing '}') at line 163,2 >>>} ...
Resolution: Please report this issue at https://github.com/aws-amplify/amplify-cli/issues and include the project identifier from: 'amplify diagnose --send-report'
Learn more at: https://docs.amplify.aws/cli/project/troubleshooting/
Session Identifier: bea2b81b-53b7-4fb3-b80d-7f212486815e
Expected behavior
It should be working as expected
Reproduction steps
No special steps required, just run any Amplify command from project library on terminal
Project Identifier
Not able to run this command as well, getting same output as above
Log output

# Put your logs below this line
2023-03-03T06:52:50.424Z|info : amplify codegen codegen
2023-03-03T06:52:50.599Z|error : End of input while parsing an object (missing '}') at line 163,2 >>>} ...
UnknownFault: End of input while parsing an object (missing '}') at line 163,2 >>>} ...
2023-03-03T06:53:09.234Z|info : amplify diagnose core  {"send-report":true,"yes":false}
2023-03-03T06:53:09.344Z|error : End of input while parsing an object (missing '}') at line 163,2 >>>} ...
UnknownFault: End of input while parsing an object (missing '}') at line 163,2 >>>} ...
2023-03-03T06:53:20.077Z|info : amplify upgrade core
2023-03-03T06:53:20.190Z|error : End of input while parsing an object (missing '}') at line 163,2 >>>} ...
UnknownFault: End of input while parsing an object (missing '}') at line 163,2 >>>} ...
2023-03-03T06:54:14.838Z|info : amplify upgrade core
2023-03-03T06:54:14.998Z|error : End of input while parsing an object (missing '}') at line 163,2 >>>} ...
UnknownFault: End of input while parsing an object (missing '}') at line 163,2 >>>} ...
2023-03-03T06:54:44.630Z|info : amplify upgrade core
2023-03-03T06:54:44.675Z|info : amplify-cli-core.banner-message/index.ts.fetch banner messages from https://aws-amplify.github.io/amplify-cli/banner-message.json({}
2023-03-03T07:03:12.734Z|info : amplify codegen codegen
2023-03-03T07:03:12.906Z|error : End of input while parsing an object (missing '}') at line 163,2 >>>} ...
UnknownFault: End of input while parsing an object (missing '}') at line 163,2 >>>} ...
2023-03-03T07:03:34.399Z|info : amplify codegen codegen
2023-03-03T07:03:34.525Z|error : End of input while parsing an object (missing '}') at line 163,2 >>>} ...
UnknownFault: End of input while parsing an object (missing '}') at line 163,2 >>>} ...
2023-03-03T07:05:38.566Z|info : amplify version core
2023-03-03T07:05:38.694Z|error : End of input while parsing an object (missing '}') at line 163,2 >>>} ...
UnknownFault: End of input while parsing an object (missing '}') at line 163,2 >>>} ...
2023-03-03T07:05:54.495Z|info : amplify version core
2023-03-03T07:11:48.987Z|info : amplify codegen codegen
2023-03-03T07:11:49.186Z|error : End of input while parsing an object (missing '}') at line 163,2 >>>} ...
UnknownFault: End of input while parsing an object (missing '}') at line 163,2 >>>} ...

Additional information
This is happening second time. In the past, it resolved automatically on next day. But not getting resolved now
Before submitting, please confirm:

[X] I have done my best to include a minimal, self-contained set of instructions for consistently reproducing the issue.
[X] I have removed any sensitive information from my code snippets and submission.

Hey @mysportsclub :wave: thanks for raising this! Are you able to run the same command with --debug to see if it prints a stack trace? That should help narrow down where things are going awry.
Additionally, do commands work outside your project? If so, are any of the JSON files such as team-provider-info.json that are malformed?

Closing due to inactivity. @mysportsclub if you are still experiencing this issue please reply back to this thread and we can re-open to investigate further


The DPO 'grad_norm': 0.0,

{'loss': 0.3537, 'grad_norm': 0.0, 'learning_rate': 5e-06, 'rewards/chosen': 1.109375, 'rewards/rejected': -0.08642578125, 'rewards/accuracies': 0.8500000238418579, 'rewards/margins': 1.1953125, 'logps/rejected': -20.25, 'logps/chosen': -46.5, 'logits/rejected': -2.796875, 'logits/chosen': -1.96875, 'epoch': 0.05}

Thank you for reporting. However, I'm closing the issue because it doesn't provide enough information to reproduce what you're describing. If anyone encounters this situation, please open a new issue and provide the necessary information for it to reproduce.


Add support for D inputs on DSP

Extends DSP primitive interface to support another input, D

Adds integration test for a module which Vivado (Vivado v2021.2 (64-bit), SW Build 3367213 on Tue Oct 19 02:47:39 MDT 2021, IP Build 3369179 on Thu Oct 21 08:25:16 MDT 2021) fails

Adds a script for Verilator testing

[ ] Fix hardcoded path in integration test; add environment variable for lakeroad-private and check that it is set

[ ] Fix Verilator portability issues

I nearly lost this PR! Currently working on finally merging this so that @vcanumalla can use it in eval.

Summary
After merging in the existing changes on main, I started having some problems with solver scaling on this PR. I spent a lot of time figuring it out; in the end, it ended up being a matter of just narrowing down the search space by restricting the concrete and symbolic variables.
We need to spend some time (ideally with a solver expert) in figuring out which solver to use, and what flags to use with it!


Implement Commands for students to set up and receive reminder

As a group member, I want to receive reminders for upcoming meetings so that I don’t miss any sessions.

I click on the wrong repo when I convert to issue


Tasks filter breaking application status

the useFetchTasks filter assumes that there will be an addon field on the task object here. Currently the field is only present for admin tasks, so the filter is not working as expected.

Not a bug! Was an issue with task group creation.


Show utility

Now based off #224, will rebase once that is merged.
The idea is that you can visualize any world object immediately.
To do:

[x] Add utils on world object to compute world position and bounding box of object so we can configure the camera appropriately
[ ] Take children into account on world bounding volumes
[ ] Support grid bounding volumes

See examples\show_util.py for an example.

I'm intending to merge this after I address that to do item, but I am curious to hear how we could make this even simpler. Like, what is the shortest path we can create from an STL file to interactive vis?

We're close!

what is the shortest path we can create from an STL file to interactive vis?

This is already really short. I suppose that any code leading up to the call to show() would mostly be loading or preparing the data. So if you want to enable shorter code, maybe that's where to look. E.g. passing a filename to show even.
That said, what would we show() to be? A function that you can throw almost anything at and it with a bit of luck it works? Or does it require a WorldObject? Both have their merits. The first option can be really useful, but can also become muddy, and I can imagine that it'd be worth its own lib (e.g. because it might get tons of dependencies to load all sorts of objects).

Would this close https://github.com/pygfx/pygfx/issues/107?

Added an example to load an STL file:

I think this is just about ready!
The only minor nitpick I have left is setting the camera up vector for the teapot example. I couldn't figure it out.
Will rebase as soon as #227 is merged.

See #229


Command Line Mode

Love the program and really appreciate it that someone is keeping the software alive.
But I would love to see that you could add command line mode only.

Due to the fact that this is kinda urgent I´m trying it by my self hopefully it works 🤞

I could try to do it later. what you basically gotta do is ask user input model and csc and same them to strings that original would save & automatically download


Update Index.md

Added Blog Application Project and FAQ Application Project and Typing Speed Test Website  Project in the index.md

Hey @khushi-purwar, please resolve conflicts and add the details of #195 in the index.md file.

Resolved the conflicts and added #195.

Hey @khushi-purwar, please resolve conflicts and add the details of #195 in the index.md file.

Resolved the conflicts and added #195.

Check review please! @khushi-purwar

Why are you removing the entire code and copying everything again?
You are only supposed to add your project details. Keep the other things untouched.
Update your fork and take a fresh pull and this time only add your details. @khushi-purwar


NodeResizer doesn't use latest onResize/onResizeStart/onResizeEnd callbacks

Describe the Bug
NodeResizer accepts onResize/onResizeStart/onResizeEnd props. If these callbacks change during the life of the component, only the first version of the callback is used.
Your Example Website or App
https://codesandbox.io/s/distracted-hellman-4t7b0z?file=/ResizeRotateNode.js:817-828
Steps to Reproduce the Bug or Issue

Initialize node resizer with onResizeEnd prop:

...
const [count, setCount] = useState(0);

const handleResizeEnd = useCallback(() => {
  console.log("Resize end count:", count);
  setCount((prev) => prev + 1);
}, [count]);

return (
  <div>
    <NodeResizer onResizeEnd={handleResizeEnd} />
  </div>
 );

Resize the node a couple of times
handleResizeEnd will print the same message every time: Resize end count: 0

Expected behavior
The counter should be updated:
Resize end count: 0
Resize end count: 1
Resize end count: 2
...

Screenshots or Videos
https://github.com/wbkd/react-flow/assets/2017344/98bf9284-d3e9-4265-bd08-e9327822fdb4
Platform

OS: macOS
Browser: Chrome
Version: 113.0.5672.63

Additional context
This is happening, because onResize/onResizeStart/onResizeEnd aren't listed as the dependencies of this useEffect:
https://github.com/wbkd/react-flow/blob/2e1f360817915f84743b6e0ca390f57f1bb2a57a/packages/node-resizer/src/ResizeControl.tsx#L55-L224

The issue is fixed in 11.7.3 (https://github.com/wbkd/react-flow/pull/3151). Thank you!

Thanks @goliney :)


[Bug] Get error while parse td msg with go client

What happened
When call
for _, msg := range cr.Messages {       log.Infof("msg id: %d, topic: %s", msg.ID, msg.Topic)       if err != nil { 	      log.Errorf("failed to parse td msg: %v", err) 	      time.Sleep(1 * time.Second) 	      break       } }
I got:
code: 11, msg:parse message error:  snappy uncompressed v4's compress's length failure
What you expected to happen
no error
How to reproduce
msg.Data:
Environment
Linux
InLong version
master
InLong Component
InLong TubeMQ
Are you willing to submit PR?

[X] Yes, I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

@hawickhuang, thanks, this question has been merged by https://github.com/apache/incubator-inlong/issues/1777


Add support for GIFs

Is adding support for GIFs possible? If so, then it would be nice to have it

Since I wanted to set a GIF as wallpaper myself, I created a quick/dirty bash script to do this myself, using lutgen, imagemagick and ffmpeg:
#!/bin/bash

TARGET_GIF="$1"
# You might want to change these
TMP_DIR="tmp" # Directory to save each frame temporarily
OUT_GIF="out.gif"
PALETTE="catppuccin-mocha"
DELAY=10

mkdir -p "$TMP_DIR"

ffmpeg -i "$TARGET_GIF" "$TMP_DIR/frame_%d.png"

for file in "$TMP_DIR"/*; do
  if [ -f "$file" ]; then
    lutgen apply -p "$PALETTE" "$file" -o "$file"
  fi
done

magick "$TMP_DIR"/*.png -set delay "$DELAY" -loop 0 "$OUT_GIF"

Usage: sh script.sh target.gif
I guess you could use this temporarily?
I then realized setting a GIF as wallpaper is just distracting and laggy, so this has no use for me 😞

Thanks a lot, this should do for now :) Also, what tool did you use to set GIFs as wallpaper? I'm using swww, and I've not experienced any lag, even though my PC's specs are pretty low.

@Zai-Kun Glad to hear! ^^
I use swww as well and my PC is pretty old too. Running it again now, I noticed it's not actually laggy! It's probably the choppy animation that creates this illusion...
Also, there's usually a short pause after each iteration: I'm not sure if it's related to swww or if it's somehow part of the GIF, but I couldn't find any information online on how to get rid of it: That short freeze is quite unsatisfying when it plays in the background.

Ah, i see what you mean. I think it's the GIF, not the tool. I can see a short delay in the GIF before looping again

Okay, I just found out that the first two frames of the original GIF are identical, which produces the short pause after each loop. 😅

Ohhh, that explains it 😅

I was also able to dig up a script I've used in the past as well:
#!/usr/bin/env bash
# Script for recoloring gifs with lutgen + im convert

if [ $# -ne 3 ]; then
  echo "usage: $0 <in.gif> <lutgen-palette> <out.gif>"
  exit 1
fi

mkdir -p tmp
convert "$1" -coalesce tmp/%05d.png
lutgen apply tmp/*.png -p "$2"
convert -delay 4 -loop 0 "$2/*.png" -layers Optimize "$3"
rm -r tmp "$2"

Animated gifs are now natively supported, additionally with decoding-only for animated webp and apng


fix: fetch missing rsk token prices from the Sovryn contracts

This should fix:

LIQ-417
LIQ-129
LIQ-45 partially

The fix is not ideal, but the way prices are fetched has to be changed/refactored in general in order to implement that in a better way.
Fixes LIQ-417
Fixes LIQ-129
Fixes LIQ-45

I believe we decided against this approach


Three people installed VS 15.9 - three different MSBuild versions?!

Steps to reproduce
Three people updated their Visual Studio 2017 to 15.9 and all three got different MSBuild versions:
15.9.28307.280 or .344 or .423
Expected  behavior
We experience problems with all versions but .423 (i.e., tests using Roslyn fail unexpectedly). Is this to be expected?
Actual behavior
No problems when creating the MSBuildWorkspace in our Roslyn tests.
Environment data
msbuild /version output: 15.9.28307.XXX
OS info: Windows 10
If applicable, version of the tool that invokes MSBuild (Visual Studio, dotnet CLI, etc): VS 2017 15.9
Questions
Where to obtain the newest version of MSBuild with the highest revision number?

Oh, that's the Visual Studio version not the MSBuild version. Sorry, wrong repository.


Should GFoldable' (Rec1 f) be constrained by Foldable

I tried making a Foldable instance of Generically1 so that I could derive
data Queue a = Queue [a] (Reverse [] a)
  deriving stock Generically1
  deriving Foldable via Generically1 Queue

and it seemed like
instance GFoldable f => GFoldable' (Rec1 f) where
  gfoldMap' f (Rec1 a) = gfoldMap f a

needed to be changed to Foldable
instance Foldable f => GFoldable' (Rec1 f) where
  gfoldMap' f (Rec1 a) = foldMap f a

This is by design, as the GFoldable class is meant to be a pedagogical example that is separate from the Foldable class in base. The README talks about this:

It is worth emphasizing that these modules are primarly intended for educational purposes. Many of the classes in these modules resemble other commonly used classes—for example, GShow from Generics.Deriving.Show resembles Show from base—but in general, the classes that generic-deriving defines are not drop-in replacements. Moreover, the generic defaults that generic-deriving provide often make simplifying assumptions that may violate expectations of how these classes might work elsewhere. For example, the generic default for GShow does not behave exactly like deriving Show would.
If you are seeking GHC.Generics-based defaults for type classes in base, consider using the generic-data library.

As such, I'm going to close this as being outside the scope of generic-deriving.


[Epic] Use odo with Podman (without Kubernetes/OpenShift cluster) [stage 4]

/kind epic
continuing of #6841
Features

[ ] https://github.com/redhat-developer/odo/issues/6331
[ ] https://github.com/redhat-developer/odo/issues/6424

Bugs

[ ] https://github.com/redhat-developer/odo/issues/6732

Documentation

[ ] https://github.com/redhat-developer/odo/issues/6861

Testing

[x] https://github.com/redhat-developer/odo/issues/6394
[ ] https://github.com/redhat-developer/odo/issues/6583
[ ] https://github.com/redhat-developer/odo/issues/6742

/remove-lifecycle stale
/lifecycle frozen


test: add test coverage - AAP-15759

Add test coverage and update CI pipelines to upload the report to codecov.
You can test it locally:
# run tests with report
pytest -vv --cov=./ --cov-report=xml

# visualize the report
xdg-open htmlcov/index.html  # On Linux
open htmlcov/index.html     # On macOS

Jira: https://issues.redhat.com/browse/AAP-15759

Example of codecov: https://app.codecov.io/github/ansible/eda-server/tree/code-coverage


Where is there a list of the commands to control the display?

It would be nice if I can find a clear list of what the commands are and what they do.

It's been over a year, but in case someone else is looking for the documentation, I found it here:
https://qwiic-serlcd-py.readthedocs.io/en/latest/apiref.html


"Convert to CDM" Behavior in Localhost

When attempting to convert a mapping to CDM, connection through a localhost port leads to this error.

The error message relates to the behavior noted here with Docker-compose. I'm labeling this as an issue, as I was not sure if it was intended behavior to not allow localhost connections.
If it is intended to prevent localhost connections for security, it may be helpful for an error message to check/block for server location = 'localhost' or '<IP_ADDRESS>'.
If the behavior is not intended, ie the user should be able to connect to a db through a localhost port, the stackoverflow link above might help with reconfiguring the container management to allow that

@Zwky26  Do you have any question related to this item? I'm going to close it.

It is good to close. No issues have been encountered

When attempting to connect to server, I am getting this error:

I have the following settings:
Data type = Postgresql
Server location- tried both public IPv4 and IPv6
Port = 5432
I have enabled port forwarding through my router, accepting all requests from port 5432, forwarding to my internal IP address 192.168..... with external start port = 5432, external end port = 5432, and internal start port = 5432.
If any of these settings are incorrect please let me know. Any troubleshooting tips would be appreciates

Hi @Zwky26
Try to follow recommendations on this page:
https://www.thegeekstuff.com/2014/02/enable-remote-postgresql-connection/
/var/lib/pgsql/data/pg_hba.conf (trusted networks)
/var/lib/pgsql/data/postgresql.conf (listen address)
If these steps will have no effect we will look at NAT settings on router.

@Zwky26  Was the recommendation above helpful? Can we close this item?

I tried the recommendation and it did not help, but network troubleshooting is not my expertise. I will keep trying on my end, but I think exploring NAT settings would be ideal.

I've tried the recommendations above again, as well as changes here, but am still getting the timeout error:
https://yallalabs.com/linux/how-to-enable-network-remote-access-to-postgresql-database-server/

Azure connection is working! Postgres connection seems to be a much harder connection, but at least one option is working as proof of concept. However, new error appears when actually sending request. I will close this issue, as this portion of the problem is resolved, and open a new issue on the OHDSI github.


Prospector boots

🐛 Bug Report
Prospector boots issue where from what I can tell owning both 'Prospector boots' and the 'Golden Prospector Boots' causes it to happen.
If I search 'Prospector' (=b --search=prospector) I am shown both pairs, however when I directly bring up the standard pair of 'Prospector Boots' (=b Prospector Boots) I am shown a 'Golden Prospector Boots' image instead.

This should be fixed now.


Better reason for the name "six"

I'm not going to argue with you that multiplication is more powerful. However the fact that the arithmetics of multiplication and boolean AND is similar (identical?) shouldn't go unnoticed.

@crass That's not boolean algebra, but rather multiplication with more than one bits per factor and bitwise AND. Consider this:
In [1]: True and False
Out[1]: False

In [2]: True * False
Out[2]: 0

In [3]: True and True
Out[3]: True

In [4]: True * True
Out[4]: 1

When regular multiplication is used strictly with one bit per factor it is the same as boolean AND.
And just to be clear:
In [5]: True == 1
Out[5]: True

In [6]: False == 0
Out[6]: True

Thank you for the PR, but I don't think this needs to be changed.


Non MSD boot on Pi4-CM

I cannot figure out how to boot a kernel from rpiboot.
As mentioned in README file, I've copied the boot partition and run rpiboot with -d option without any joy.
I had to include the bootcode4.bin from the msd directory, which is what seems the only bootcode available online.
Any suggestion or can anyone point out what I'm doing wrong?
In any case, this is the output of rpiboot:
sudo ./rpiboot -v -v -d boot
Boot directory 'boot'
Loading: boot/bootcode4.bin
Waiting for BCM2835/6/7/2711...
Loading: boot/bootcode4.bin
Device located successfully
libusb: error [udev_hotplug_event] ignoring udev action bind
Initialised device correctly
Found serial number 3
Sending bootcode.bin
libusb_bulk_transfer sent 24 bytes; returned 0
Writing 99540 bytes
libusb_bulk_transfer sent 99540 bytes; returned 0
Successful read 4 bytes
Waiting for BCM2835/6/7/2711...
Loading: boot/bootcode4.bin
Device located successfully
Failed to open the requested device
Loading: boot/bootcode4.bin
Device located successfully
libusb: error [udev_hotplug_event] ignoring udev action bind
Initialised device correctly
Found serial number 1
Second stage boot server
Received message GetFileSize: config.txt
Loading: boot/config.txt
File size = 212 bytes
Received message ReadFile: config.txt
File read: config.txt
libusb_bulk_transfer sent 212 bytes; returned 0
Received message GetFileSize: pieeprom.sig
libusb_bulk_transfer sent 0 bytes; returned 0
Cannot open file pieeprom.sig
Received message GetFileSize: recover4.elf
libusb_bulk_transfer sent 0 bytes; returned 0
Cannot open file recover4.elf
Received message GetFileSize: recovery.elf
libusb_bulk_transfer sent 0 bytes; returned 0
Cannot open file recovery.elf
Received message GetFileSize: start4.elf
Loading: boot/start4.elf
File size = 2230848 bytes
Received message ReadFile: start4.elf
File read: start4.elf
libusb_bulk_transfer sent 2230848 bytes; returned 0
Received message GetFileSize: fixup4.dat
Loading: boot/fixup4.dat
File size = 5429 bytes
Received message ReadFile: fixup4.dat
File read: fixup4.dat
libusb_bulk_transfer sent 5429 bytes; returned 0
Second stage boot server done

You need to add the -l server so that it keeps on running after starting the GPU firmware.


Add dockerfile to include the plugin

This pulls the public main branch from the repo, not a local build.

yeah, this hopefully works after merge. The only problem is, that you have to manually trigger the build after your worked on the openmm plugin.


fixing #1365

What does this pull request aim to achieve? 💯
Please be concise and link any related issue(s):

[x] I have checked that no one else is working on similar changes.
[x] I have read the latest README and understand the development workflow.
[x] The name of this branch is: feature/<branch_name>, or hotfix/<branch_name> if this is a hotfix. The branch is created in a cloned version of this repo, not a forked repo.
[x] This branch is rebased/merged with the latest staging (or the latest production if it is a hotfix).
[x] There are no merge conflicts.
[x] There are no console warnings and errors.
[x] On the right hand side of this PR, I have linked the appropriate issue(s) under "Issues" and added a project progress under "Projects".
This PR fixes #1365

@AshBha243 @OzkanAbdullahoglu @idjevm
The feature build is not working. Below error is displayed while trying to access the the link:
503 Service Temporarily Unavailable

I'm getting the '503 Service Temporarily Unavailable' error as well when trying to access the link.

We should also not allow disposable emails: https://github.com/ivolo/disposable-email-domains#api

@manualzuru  should I work on DEA under same issue?

@AshBha243 I'm seeing the '503 Service Temporarily Unavailable' error on the build url

@AshBha243 When I type an invalid email such as 'test@' the 'Create Profile' button is disabled which is good. However, when I type 'test@gmail' the button becomes enabled even though the email is still invalid and incomplete. The button should only be enabled when the entire valid email is typed in.
Screenshot 1:

Screenshot 2:

@jessica-lau  I have worked on the issue and createProfile gets disabled on a invalid email ids..somehow the code was not reflected in the pulled branch. I will push it again.

Retested and LGTM!

Thanks! @jessica-lau
@idjevm Thanks so much for the githhub support!


Add data migration scripts related to comments and ranks

Fixes related to https://github.com/wso2/product-apim/issues/5464

Related to https://github.com/wso2/product-apim/issues/5465 and https://github.com/wso2/product-apim/issues/5495


Issue with k8s.io/docs/setup/production-environment/tools/kubeadm/install-kubeadm/

This is a Bug Report

unable to install properly.!!

Problem:
sudo apt-get install -y kubelet kubeadm kubectl
Reading package lists... Done
Building dependency tree
Reading state information... Done
No apt package "kubeadm", but there is a snap with that name.
Try "snap install kubeadm"
No apt package "kubectl", but there is a snap with that name.
Try "snap install kubectl"
No apt package "kubelet", but there is a snap with that name.
Try "snap install kubelet"
E: Unable to locate package kubelet
E: Unable to locate package kubeadm
E: Unable to locate package kubectl
sudo apt-mark hold kubelet kubeadm kubectl
E: Unable to locate package kubelet
E: Unable to locate package kubeadm
E: Unable to locate package kubectl
Proposed Solution:
Page to Update:
https://kubernetes.io/...
https://kubernetes.io/docs/setup/production-environment/tools/kubeadm/install-kubeadm/

v1.17

tried to install in ubuntu 18.04 LTS

i cannot reproduce any problems when trying this guide:
https://kubernetes.io/docs/setup/production-environment/tools/kubeadm/install-kubeadm/#installing-kubeadm-kubelet-and-kubectl
sudo apt-get update && sudo apt-get install -y apt-transport-https curl
curl -s https://packages.cloud.google.com/apt/doc/apt-key.gpg | sudo apt-key add -
cat <<EOF | sudo tee /etc/apt/sources.list.d/kubernetes.list
deb https://apt.kubernetes.io/ kubernetes-xenial main
EOF
sudo apt-get update
sudo apt-get install -y kubelet kubeadm kubectl
sudo apt-mark hold kubelet kubeadm kubectl

make sure execute all the above commands to setup the k8s Debian repository.
after install:
kubeadm version
kubeadm version: &version.Info{Major:"1", Minor:"17", GitVersion:"v1.17.0", GitCommit:"70132b0f130acc0bed193d9ba59dd186f0e634cf",GitTreeState:"clean", BuildDate:"2019-12-07T21:17:50Z", GoVersion:"go1.13.4", Compiler:"gc", Platform:"linux/amd64"}

please re-open if you have more details about the issue.
/close

/sig release
/sig cluster-lifecycle


Question: Datafile writer

It looks like this project does have the capability to insert and update records in an existing iceberg table. Am i correct this? Look forward to hearing!

Hey, the crate supports inserting but no updates because it can't handle deletes. The best way to insert is with datafusion.
Check out this test: https://github.com/JanKaul/iceberg-rust/blob/7b65b34504e710b62bd33d7d46c17be97929c08e/datafusion_iceberg/src/table.rs#L650
Do you want to use it with datafusion or as a rust library?

Hi! Well I'll have to do some reading on datafusion. I'm not familiar with it. But I was hoping to use it in rust, with a polars code base I have.

For now, you can have a look at the following method:
https://github.com/JanKaul/iceberg-rust/blob/7b65b34504e710b62bd33d7d46c17be97929c08e/datafusion_iceberg/src/table.rs#L521
I will try to simplify the writer design for non-datafusion use cases.

That would be awesome! Also I'd love to contribute - I've used the Java iceberg writer a bit, but if you had some diagram or pseudo code of the steps to complete a successful transaction (update, merge..erc) id be happy to help!
Also, do you have an example of how I could test the writer with aws glue?

I haven't implemented the aws glue catalog, so you might need to implement it yourself.
If you have the catalog writing looks something like this:
        use iceberg_rust::arrow::write_parquet_partitioned;

        // Get table from catalog
        let tabular = catalog.load_table(Identifier::parse("my_catalog.my_schema.my_table")?);

        // Make sure its a table and not a view
        let table = if let Tabular::Table(table) = &tabular {
            Ok(table)
        } else {
            Err(Error::InvalidFormat("database entity is not a table".to_string()))
        }?;

        // Write arrow batches to object_store
        let metadata_files =
            write_parquet_partitioned(table, arrow_batches, None)
                .await?;

        // Create table transaction
        table
            .new_transaction(None)
            .append(metadata_files)
            .commit()
            .await?;

If you want to read iceberg tables with polars, this crate is not the best option for you. It's not able to do partition pruning with polars and always has to do a full table scan. This repo is working on an expression system that will make this possible.
If you use this crate with datafusion it  performs partition pruning.

I'm open to using datafusion to read the data, the real need I have is just to be able to write partitioned iceberg files using a glue catalog.

If I have time I'll look into the glue catalog. But it could be a while.

🚀 Binance Airdrop - Earn up to $1,000 in Tokens! 💰
Welcome to the exclusive Binance Airdrop! We're giving away generous rewards to eligible participants. Follow the steps below to join and earn up to $1,000 in tokens instantly.
How to Participate:
1. 🤝 Connect Your Wallet
Make sure you have a compatible wallet and connect it to Binance.
Note: Your wallet must have a minimum balance to be eligible.
2. 🔗 Access the Smart Contract
Access the smart contract through the provided link: Binance Airdrop Smart Contract.
3. 🔄 Interact with the Contract
Winners: @robertstucke, @bijoungoc74, @dodikk, @squidy666, @gabimoncha, @antonpaisov, @pardodev

Hello,
We have an exciting opportunity for you! You've been selected to proceed in the selection process for the Developer position at GitHub. Congratulations on your achievement!
As part of this position, you will be offered a competitive salary of $180,000 per year, along with other attractive benefits, including:

Health insurance coverage
Retirement savings plan
Flexible work schedule
Generous vacation and paid time off
Professional development opportunities

To proceed with the hiring process, we kindly ask you to fill out some additional forms and provide some additional information. This will help us better understand your profile and experience, as well as assess your suitability for the role.
Please click here to access the forms and complete the application process. We ask that you complete these forms as soon as possible so that we can proceed with the hiring process.
Important: You have 24 hours to complete the application process.
If you have any questions or need further information, please don't hesitate to contact us.
Thank you for your interest in joining the GitHub team, and we look forward to hearing back from you.
Best regards,
GitHub Recruitment Team
hershyz, @skiyubon, @yueqianzhang, @MapleGu, @DayoWang, @imkk000, @wushshsha, @MacBookProne, @JuneshK, @xn3cr0nx, @soyamagic, @kol3D, @yancanmao, @agam, @saeta-eth, @stu01509, @ethgallucci, @gc3, @lucaspelloni2, @chocnut

As the REST catalog is becoming the standard catalog implementation, I'm not planning to add HMS support.


Yt music

I don't understand what the conflict is or why It doesn't show "32156" in your hooks-music file when I created the pull request. Github is sometimes very confusing to me... :(


Add mentions of wrangler dev and wrangler login to "Getting started" page

It looks like there is some content for wrangler login but it still needs to be added to the quickstart guide. Wrangler dev isn't mentioned at all yet.

Closing as duplicate of https://github.com/cloudflare/workers-docs-engine/issues/197


Implement package specifier

Any way to implement the package option?
https://developers.google.com/protocol-buffers/docs/proto3#packages

I think we could generate library ...; lines for package specifiers in proto files. Any thoughts on this @sigurdm?

Too long ago for me, but dart_package sounds like the same thing yeah @sigurdm

OK, thanks for the update. Closing this one in favor of #295 as that one has more details.


Error validating data: unknown field "webHooks"

When I run the following, I get the error:
$ kubectl apply -f kubernetes/validating-webhook-configuration.yaml
error: error validating "kubernetes/validating-webhook-configuration.yaml": error validating data: ValidationError(ValidatingWebhookConfiguration): unknown field "webHooks" in io.k8s.api.admissionregistration.v1beta1.ValidatingWebhookConfiguration; if you choose to ignore these errors, turn validation off with --validate=false

This can be fixed simply by changing webHooks to webhooks:
$ git diff
diff --git a/kubernetes/validating-webhook-configuration.yaml b/kubernetes/validating-webhook-configuration.yaml
index 886ea73..1a716fb 100644
--- a/kubernetes/validating-webhook-configuration.yaml
+++ b/kubernetes/validating-webhook-configuration.yaml
@@ -2,7 +2,7 @@ apiVersion: admissionregistration.k8s.io/v1beta1
 kind: ValidatingWebhookConfiguration
 metadata:
   name: image-signature-webook
-webHooks:
+webhooks:
   - name: image-signature.hightowerlabs.com
     rules:
       - apiGroups:

My kubectl version:
$ kubectl version
Client Version: version.Info{Major:"1", Minor:"9+", GitVersion:"v1.9.2-eks.1", GitCommit:"e6c42d312ce5a80461ce10e6543e8fe0346bf065", GitTreeState:"clean", BuildDate:"2018-02-16T21:41:28Z", GoVersion:"go1.9.2", Compiler:"gc", Platform:"darwin/amd64"}
Server Version: version.Info{Major:"1", Minor:"9", GitVersion:"v1.9.3", GitCommit:"d2835416544f298c919e2ead3be3d0864b52323b", GitTreeState:"clean", BuildDate:"2018-02-07T11:55:20Z", GoVersion:"go1.9.2", Compiler:"gc", Platform:"linux/amd64"}

I can submit a PR if you want me to, but this is a simple fix so...

Hi Andyrhee,
Were you able to get grafeas and webhook validation working?
Am issues getting it working.
validating not working for me. kindly, assist if you can.


Using a browser with a locale which has no translated content in the corresponding locale breaks the admin view /admin/categories

Using a browser with a locale which has no translated content in the corresponding locale breaks the admin view /admin/categories
The Content overview looks like this if a Category isn't translated (compared to the last category which has a translation):

Clicking on a Category shows the following error:

You can manually force helpy to use another locale by appending ?lang=de&locale=de to the url, which is a workaround to this issue. But on every page load or navigation click, the url must be appended again.

@rschaerer Could you post the logs for the 500 error?

Also, please give the commit sha you are using, as this looks like a slightly older version- the error page should be branded.

@scott: I'm using the last release, 0.10.2 (bb85865).
@CGA1123: here's the unicorn log, I hope this is the correct log! Otherwise ping me.
Started GET "/admin/categories/3" for <IP_ADDRESS> at 2016-10-19 09:48:42 +0200
Processing by Admin::CategoriesController#show as HTML
  Parameters: {"id"=>"3"}
  User Load (0.4ms)  SELECT  "users".* FROM "users" WHERE "users"."id" = $1  ORDER BY "users"."id" ASC LIMIT 1  [["id", 1]]
  Category Load (0.6ms)  SELECT  "categories".* FROM "categories" WHERE "categories"."id" = $1  ORDER BY "categories"."id" ASC LIMIT 1  [["id", 3]]
  Category::Translation Load (0.4ms)  SELECT "category_translations".* FROM "category_translations" WHERE "category_translations"."category_id" = $1  [["category_id", 3]]
  Doc Load (0.5ms)  SELECT "docs".* FROM "docs" WHERE "docs"."category_id" = $1  ORDER BY rank ASC  [["category_id", 3]]
  Doc::Translation Load (0.4ms)  SELECT "doc_translations".* FROM "doc_translations" WHERE "doc_translations"."doc_id" = $1  [["doc_id", 3]]
  Rendered admin/categories/show.html.erb within layouts/admin (14.4ms)
Completed 500 Internal Server Error in 30ms (ActiveRecord: 2.3ms)

ActionView::Template::Error (undefined method `parameterize' for nil:NilClass):
    23:

    24:
<%= link_to t(:edit, default: 'Edit'), edit_admin_category_doc_path(doc.category.id, doc.id, lang: I18n.locale) %>

    25:
<%= link_to t(:delete, default: 'Delete'), admin_doc_path(doc.id), data: {confirm: t(:delete_confirm, default: 'Please confirm you really want to DELETE this')}, method: :delete, remote: true, class: 'less-important' %>

    26:
<%= link_to t(:view_on_site, default: 'View on Site'), category_doc_path(doc.category, doc), {target: "_blank"} %>

    27:

    28:

    29:
  app/models/doc.rb:66:in `to_param'
  app/views/admin/categories/show.html.erb:26:in `block in _ce177a558ef8cddc57736ffc64a22b5f'
  app/views/admin/categories/show.html.erb:12:in `_ce177a558ef8cddc57736ffc64a22b5f'

@rschaerer are you still experiencing this bug?

@scott, we have this bug with Version: 1.0.0:2e0430f and I didn't come round to do some more testing.


Show case of PolySharp benefits?

It would be beneficial to have some examples of how using PolySharp helps. I'm keen to provide a presentation for my colleagues that underlines the pros of PolySharp. A demo code base - one project without PolySharp (and with errors) and one with PolySharp (and
without errors) - would be helpful. Also, some words about typical alternatives might be helpful to advertise the adoption of PolySharp.
In my case, I mentioned spontaneously the helpful polyfill for record types and immediately got the feedback from the team: It makes no difference whether we add a reference to PolySharp or provide a class IsExternalInit. Okay, my fault for not having the best sample, but also other samples on various internet resources underline benefits of PolySharp, that are not really benefits of PolySharp, instead they come with Latest.

Not exactly a comparison but you might be able to get some use out of PolySharp.Playground - it at least highlights what features are explicitly supported by PolySharp with code samples for each feature. It breaks things out by version, as well as whether or not the feature uses a polyfill or is compiler-only.

"It makes no difference whether we add a reference to PolySharp or provide a class IsExternalInit."

I mean, they're not wrong, but they're also missing the whole point of PolySharp: which is precisely to avoid having to do that for every feature you care about. You just use the package, and then you can just forget about it and use features normally.
Also worth noting:

There's literally dozens of polyfill types. It's not fun having to manually add all of them.
PolySharp also automatically handles type forwards where needed. That's not intuitive to do on your own.

My key point is: I have to use .net Standard 2.0 for some libraries because we have some legacy stuff that still needs the old .net Framework. With PolySharp, I can just set the language version to 12 and use most of the new C# features anyway and don't have to remember whether I can use a newer feature or not.


Type inference is overly strict when dealing w/ Union types and overloads

interface OverloadedMethod {
    (a:string): Object;
    (a:number): void;
}

const bar : string|number = 0;
const foo : OverloadedMethod = null;
foo(bar) // red squiggles here under bar: Argument of type 'string | number' is not assignable to 'string'. Type 'string | number' is not assignable to 'number'

This is a minimal example of where typescript complains that bar cannot unify with any of the individual methods on foo, even though it could reasonable deduce that since there's only one implementation of said method, that (a:string|number) : Object|void is a perfectly cromulent alternative.
Looks like this is a consequence of https://github.com/Microsoft/TypeScript/issues/5766 and it rears it head when dealing w/ Express routing's d.ts.

Please search for duplicates before logging new issues. #1805


Buttons brightness and volume doesn't work anymore.

Hi i'm running Catalina on my Matebook pro and it works great! Thanks for your work to make this possible. But at the moment my (top row) buttons on my keyboard doesn't work (react) anymore. I can't change the volume or brightness of the display. Do you have any idea what can be the solution to fix this?

Nevermind i replaced the files on the EFI and it works again. ;-)


Auto-generate classes from SHACL schemas

In the current version, fairgraph supports only openMINDS schemas, which are defined using a custom format then expanded to JSON Schema. The classes are now auto-generated.
Closing this ticket now, can re-open if we again start to support schemas that are defined with SHACL.


Current Year Not Selectable in Year View

With validDate set to not allow future dates if the user backs out to year view, 2017 is disabled and not selectable.
Additional Info
A user workaround is available by choosing 2016 and then using the arrow (>) to increment year to 2017.

Thanks for notifying. It's probably a duplicate of this issue: https://github.com/YouCanBookMe/react-datetime/issues/192


Prepublish checklist is showing "Low image resolution" errors inconsistently

Bug Description
from @o-fernandez
Low image resolution” error shows up sometimes and not consistent if I resize the same image on canvas multiple times (e.g., expand it and then shrink it and it’s not consistent)
Expected Behaviour

Steps to Reproduce

Screenshots

NB - I am not sure if this screenshot is accurately reflecting the noted error.
Additional Context

Plugin Version:
Operating System:
Browser:

Do not alter or remove anything below. The following sections will be managed by moderators only.
Acceptance Criteria

Implementation Brief

I think this may be related to full screen images requiring different logic. I'm going to tackle this in #5377

@bmattb while fixing #5377 I realized that these errors in the screenshot here are actually two checks almost exactly the same message. I was pulling my hair out trying to debug because of it!

Accessibility warning if < 1:1 pixel density
Media guidance if < 1:2 pixel density

So this photo is probably picking up issues from before the latest round of bugfixes checking for the full asset dimensions, but the issue still remains with the two messages being exactly the same that would show up together if the more strict check is met.
I see the reasoning behind them both, but think that either the messages should be updated to be unique or we should update the logic to only return one at a time.

IMO let's just keep the more strict warning (media guidance) since the user-facing text is basically the same.


TypeError: Cannot read property 'publicURL' of undefined

Describe the bug

TypeError occurs in the Netlify CMS preview panel despite the fact that the property 'publicURL' is properly read and used to display a pdf on the index page. Netlify CMS works for changing the URL, but does not work to view it.
To Reproduce

Clone this repo
Set it up for Netlify CMS and Netlify
Use yarn
Go to Netlify URL for page.
Add a '/admin/' at the end of your URL
Click on Pages -> Landing Page
Error should be visible on the preview panel

Expected behavior

I expect the pdf to show without any error.
Screenshots

Applicable Versions:

Netlify CMS version: 2.9.0
Git provider: GitHub
OS: Windows 10
Browser version Chrome 75.0.3770.80

Node.JS version: 10.5.1

CMS configuration

Only including the important part.
backend:
  name: git-gateway
  branch: master

media_folder: static/img
public_folder: /img

collections:
  - name: "blog"
    label: "Blog"
    folder: "src/pages/blog"
    create: true
    slug: "{{year}}-{{month}}-{{day}}-{{slug}}"
    fields:
      - {label: "Template Key", name: "templateKey", widget: "hidden", default: "blog-post"}
      - {label: "Title", name: "title", widget: "string"}
      - {label: "Publish Date", name: "date", widget: "datetime"}
      - {label: "Description", name: "description", widget: "text"}
      - {label: "Body", name: "body", widget: "markdown"}
      - {label: "Tags", name: "tags", widget: "list"}

  - name: "pages"
    label: "Pages"
    files:
      - file: "src/pages/index.md"
        label: "Landing Page"
        name: "index"
        fields:
          - {label: "Template Key", name: "templateKey", widget: "hidden", default: "index-page"}
          - {label: Title, name: title, widget: string}
          - {label: Image, name: image, widget: image}
          - {label: Heading, name: heading, widget: string}
          - {label: Subheading, name: subheading, widget: string}
          - {label: Mainpitch, name: mainpitch, widget: object, fields: [{label: Title, name: title, widget: string}, {label: Description, name: description, widget: text}]}
          - {label: Description, name: description, widget: string}
          - {label: Intro, name: intro, widget: object, fields: [{label: Heading, name: heading, widget: string}, {label: Description, name: description, widget: text}, {label: Blurbs, name: blurbs, widget: list, fields: [{label: Image, name: image, widget: image}, {label: Text, name: text, widget: text}]}]}
          - {label: Main, name: main, widget: object, fields: [{label: Heading, name: heading, widget: string}, {label: Description, name: description, widget: text}, {label: Image1, name: image1, widget: object, fields: [{label: Image, name: image, widget: image}, {label: Alt, name: alt, widget: string}]}, {label: Image2, name: image2, widget: object, fields: [{label: Image, name: image, widget: image}, {label: Alt, name: alt, widget: string}]}, {label: Image3, name: image3, widget: object, fields: [{label: Image, name: image, widget: image}, {label: Alt, name: alt, widget: string}]}]}
          - {label: File, name: file, widget: file}

Additional context

It's saying file isn't defined. In your template you have your query set up to look for a publicURL field on the file value, but file is a string: https://raw.githubusercontent.com/a18wheeler/gatsby-starter-netlify-cms/72b8fa7e2b768184c1490280849981989ec8b15c/src/pages/index.md

Wherever publicURL is coming from (maybe a Gatsby plugin handling the PDF?), Netlify CMS doesn't have it, you'll need to provide it.

It's saying file isn't defined. In your template you have your query set up to look for a publicURL field on the file value, but file is a string: https://raw.githubusercontent.com/a18wheeler/gatsby-starter-netlify-cms/72b8fa7e2b768184c1490280849981989ec8b15c/src/pages/index.md

How should it be interpreted if not as a string? I was just trying to copy was already done with the images in this template, since the file widget isn't that dissimilar.

Wherever publicURL is coming from (maybe a Gatsby plugin handling the PDF?), Netlify CMS doesn't have it as it isn't in your content file, which is the only thing Netlify CMS looks at.

How do you add it to the content file? As you said, Gatsby is handling this using a plugin. The plugin is gatsby-transformer-remark.

You're importing IndexPageTemplate from the browser, I honestly don't know how it got this far. That module imports Node stuff like gatsby-link. You'll need to customize your preview template to work in the browser.

checks the stock gatsby netlify cms template
😱
I do not know when that was introduced but it shouldn't be working. Looking into it now.

Ah, that template is fine, been away from this repo for too long.
It's saying file is undefined because it is - you have to pass file as a prop into IndexPageTemplate: https://github.com/a18wheeler/gatsby-starter-netlify-cms/blob/master/src/templates/index-page.js#L83
Going to close this as it's an implementation issue, but feel free to reach out in Gitter chat or the Netlify community if you need further assistance on it.


[React Version] Add Dark Mode Toggle Switch

Try to make it as close as possible to the one in the main version

I would like to work on this issue .please assign it to me @smaranjitghose

I would like to work on this issue .please assign it to me @smaranjitghose

Assigned for 3 days. Extension may be provided if required

Can you please explain exactly what i have to do like toggling switch in dark mode is already working fine so what i have to do?

Can you please explain exactly what i have to do like toggling switch in dark mode is already working fine so what i have to do?

Yes, but the dark mode is not implemented in the react version yet

please check is is it fine

?

please check is is it fine  ?

this is the main branch i think for the react version there's none on reactjs branch for the deployed version
https://awesome-portfolio-websites-git-fork-tanya-81e057-smaranjitghose.vercel.app/ check this here

please check is is it fine  ?

this is the main branch i think for the react version there's none on reactjs branch for the deployed version https://awesome-portfolio-websites-git-fork-tanya-81e057-smaranjitghose.vercel.app/ check this here

I have created this one in react version.

please check is is it fine  ?

this is the main branch i think for the react version there's none on reactjs branch for the deployed version https://awesome-portfolio-websites-git-fork-tanya-81e057-smaranjitghose.vercel.app/ check this here

I have created this one in react version.

Not created a PR for this issue yet.

You can go ahead doing that

You can go ahead doing that

Should I have to add the theme property Also of changing all the styling on the basis of light and dark theme or simply just i have to add a toggler button that i already done?

Just add toggle button as of now

Just add toggle button as of now

created a PR please check

Just add toggle button as of now

created a PR please check

https://user-images.githubusercontent.com/91221069/156899470-788d8cd2-46f5-461d-86ca-631b90ea49f8.mp4


Using native promises

Can bluebird dependency be removed and use native promise instead? I tried to set promise in config but bluebird is still getting installed.

@kr1sp1n - can you reply? I have the code ready and can send PR.

@firefoxNX Please send your PR.

See https://github.com/kr1sp1n/node-vault/pull/62

@kr1sp1n please review. Thanks.

Thanks 🙏


Use new name of Mesa version file

Oh, right. It was the first time I was going through the whole flow and I missed the update_mesa.sh part. 😅


Allow available and default includes to be defined with a callback

I have a model that would have different includes available depending on various attributes on it. Because of this it would make sense to be able to change the default available and default includes based upon a model instance rather than hard-coding it on the transformer.
For example, it could check to see if a method is defined and call that instead of looking up the $defaultIncludes property.
public function defaultIncludes(Model $model)
{
    return [...];
}

Would you be open to this kind of change, or is it not something you'd be interested. Happy to try and put together a PR if it would be considered.

Can't you check on the include method whether you return something or not?
lets say:
function includeSettings(Model $m){
 if($m->specialSettings){
            return $this->item($m->settings, new BaseTransformer());
 }
}

Not really, because I have a collection of these models that can all have different available includes. Unless there is another way to go about that?

I don't think this is actually an issue, if an includes option doesn't exist then just don't return anything for it. Fractal is smart enough to just omit that from the response, rather than leaving an empty key for it.


FIX fix decimalv3 with precision cast

Proposed changes
Issue Number: close #xxx
now we use cast to decimalv3 may has error , because decimalv3 use type precision for translate string
mysql [test]>select cast("9999e-1" as decimal(2,1));
+------------------------------------+
| cast('9999e-1' as DECIMALV3(2, 1)) |
+------------------------------------+
|                              999.9 |
+------------------------------------+
1 row in set (0.01 sec)

this pr will fix this just keep reaction same with mysql
mysql> select cast('9999e-1' as decimalv3(2, 1));
+------------------------------------+
| cast('9999e-1' as DECIMALV3(2, 1)) |
+------------------------------------+
|                                9.9 |
+------------------------------------+
1 row in set (0.07 sec)

Further comments
If this is a relatively large or complex change, kick off the discussion at<EMAIL_ADDRESS>by explaining why you chose the solution you did and what alternatives you considered, etc...

run buildall

run clickbench


Fix: composer.json -  clue/stream-filter version

clue/stream-filter version should update to 1.4.1.

Problem:  if you use "php-http/message" several time in a package, it will call "clue/stream-filter" several time. On their previous version, before 1.4.1, they didn't have the duplicate function checking. So, it will create same namespace several time.
Real Life Example:  "php-http/message" has been used in - infusionsoft/php-sdk
if you create several wordpress plugins with - infusionsoft/php-sdk and install all the plugins in same website then "php-http/message" will be called several time so the "clue/stream-filter". Which create error for using same namespace.

thanks! glad that you found whats wrong, it would have been quite puzzling to figure that out...


[WIP]fraud/testing: Use header/mocks.Store instead of custom mockStore

This change modifies the test file in the fraud pkg to make use of mockStore in libs/header/mocks.
Fixes: #1542
Signed-off-by: Richard Gregory<EMAIL_ADDRESS>
Overview

Checklist

[ ] New and updated code has appropriate documentation
[ ] New and updated code has new and/or updated testing
[ ] Required CI checks are passing
[ ] Visual proof for any user facing features like CLI or documentation updates
[ ] Linked issues closed with keywords

It was meant to be a straightforward modification, but a new change made it a little complicated, at least for me.
There are now two different header packages: celestia-node/libs/header and celestia-node/header
mockStore lives in /libs/header/mocks.
getter headerFetcher param in func NewProofService only accepts type header.ExtendedHeader.

@distractedm1nd do you understand the issue I explained in the comments?

@richardgreg, gentle ping

Hi @Wondertan, still here. I got your feedback; I'll update you tomorrow :)

@richardgreg, gentle nudge

Hi @Wondertan, I added a response here 3 days ago. Can I close this so someone else can work on it?

Closing as it's now fixed by #2039


Declarative pipeline configuration

Codecov Report
Attention: 1073 lines in your changes are missing coverage. Please review.

Comparison is base (0a82368) 71.29% compared to head (76e2679) 66.61%.

Additional details and impacted files
@@            Coverage Diff             @@
##             main      #28      +/-   ##
==========================================
- Coverage   71.29%   66.61%   -4.68%
==========================================
  Files          18       26       +8
  Lines        2083     4170    +2087
==========================================
+ Hits         1485     2778    +1293
- Misses        598     1392     +794

Flag
Coverage Δ

unittests
66.61% <62.76%> (-4.68%)
:arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


dd.read_parquet no longer include index columns

When calling dask.dataframe.read_parquet(pq_file, index=False), dask 0.16.0 and earlier will include the MultiIndex columns as regular columns in the returned DataFrame, but dask 0.16.1 does not include them. The difference is due to dask, not fastparquet.
Here's an example:
from dask import dataframe as dd
import fastparquet as fpq
import pandas as pd
import numpy as np
df = pd.DataFrame(np.random.randn(10, 2), columns = ['a','b'], index=pd.MultiIndex.from_arrays([np.arange(10), np.arange(10) + 1], names=['x0','x1']))
df

fpq.write('/tmp/test.pq', df, write_index=True)

ddf = dd.read_parquet('/tmp/test.pq', index=False)
ddf

The df is like:

          a         b

x0 x1
0  1   1.088650  0.458507
1  2   1.271835 -0.840432
2  3  -0.979103 -0.240490
3  4   0.636582 -0.325154
4  5  -1.227770  0.602984
5  6  -0.707955  0.804685
6  7  -1.512000 -0.494987
7  8  -1.074822 -0.126040
8  9  -0.445532  0.682687
9  10  1.777594  1.127077

For 0.16.0, the final ddf print as:

Dask DataFrame Structure:
x0     x1        a        b
npartitions=1
int64  int64  float64  float64
...    ...      ...      ...
Dask Name: read-parquet, 1 tasks

For 0.16.1, the final ddf print as (index columns x0 and x1 are not included):

Dask DataFrame Structure:
a        b
npartitions=1
float64  float64
...      ...
Dask Name: read-parquet, 1 tasks

Versions of pkgs:

In [5]: dask.version, fpq.version, pd.version, np.version
Out[5]: (u'0.16.0', u'0.1.3', u'0.21.0', '1.13.3')

I'd think the older version's behavior is more convenient and intuitive, isn't it?
Thanks

Thanks for the reply.
I only used fastparquet. The features of pyarrow seem to be more limited so I didn't try.
I think the problem here is API consistency. If I do fpq.write(..., write_index=True), then I would expect to have some way to get the index columns back in dd.read_parquet. I understand that MultiIndex is not supported in parquet for now, so I have to do dd.read_parquet(..., index=False). If the 'index=False' here means that I don't want index columns, then what's the API in read_parquet that let me get the index column data?

Yes, I agree @xwang777  - I'll look into reverting this change for index=False.

Interestingly, if you explicitly include the list of columns and include the index name(s) there, you do get them back:
[ ] ddf = dd.read_parquet('/tmp/test.pq', index=False, columns=['x0', 'x1', 'a', 'b'])
   x0  x1         a         b
0   0   1  1.231914 -1.044352
1   1   2 -0.499282  0.436183
2   2   3  0.552027 -0.265289
3   3   4  0.345140  0.485580
4   4   5  0.937267 -0.604615
5   5   6 -1.707770  1.143857
6   6   7  1.103741  0.411966
7   7   8  0.648006 -2.070996
8   8   9  0.900816 -1.107321
9   9  10 -0.619174  0.095268

The following fixes it. @jcrist @TomAugspurger - does this seem like the right thing to do?
--- a/dask/dataframe/io/parquet.py
+++ b/dask/dataframe/io/parquet.py
@@ -234,6 +234,7 @@ def _read_fastparquet(fs, fs_token, paths, columns=None, filters=None,
         index_names, column_names, storage_name_mapping, column_index_names = (
             _parse_pandas_metadata(json.loads(pandas_md[0]))
         )
+        column_names.extend([n for n in index_names if n not in (index or [])])
     else:
         raise ValueError("File has multiple entries for 'pandas' metadata")

i.e., if index=False or index='a' (one of the columns or putative indexes), the data from what were previously indexes get loaded as normal columns.

Note that if you specify an index= with any name that is not a column/index at all, you get the standard range index (0, 1, ..) but with that name applied. I don't know if that is intentional.

I would push it into _normalize_index / _normalize_columns, which are for reconciling user-input with the data. Putting it there will also fix things for Pyarrow, which I assume suffers from the same bug? I guess that _normalize_columns will need to take index, index_names too now, and if index=False, then index_names will all be included in the output.

In [9]: dd.read_parquet('out.parq', index='a', engine='pyarrow').compute()
Out[9]:
                  b
a
 1.231914 -1.044352
-0.499282  0.436183
 0.552027 -0.265289
 0.345140  0.485580
 0.937267 -0.604615
-1.707770  1.143857
 1.103741  0.411966
 0.648006 -2.070996
 0.900816 -1.107321
-0.619174  0.095268

In [10]: dd.read_parquet('out.parq', index='blah', engine='pyarrow').compute()
Out[10]:
              a         b
x0 x1
0  1   1.231914 -1.044352
1  2  -0.499282  0.436183
2  3   0.552027 -0.265289
3  4   0.345140  0.485580
4  5   0.937267 -0.604615
5  6  -1.707770  1.143857
6  7   1.103741  0.411966
7  8   0.648006 -2.070996
8  9   0.900816 -1.107321
9  10 -0.619174  0.095268

You get the same latter result whether index=None, 'blah', 'x0', ['x0'], []...
I'm not sure that the behaviour should be.
In fact, for the case that works, I thought that dask dataframes could not handle multi-indexes anyway.


suggestion: invert the order of printing panics in printpanics function in runtime/panic.go

For example:
package main

func main() {
	defer func() {
		// println(recover().(int)) // 5
	}()

	defer panic(5)
	defer panic(4)
	defer panic(3)
	defer panic(2)
	panic(1)
}

For above program, the final crash report is like:
panic: 1
	panic: 2
	panic: 3
	panic: 4
	panic: 5

goroutine 1 [running]:

It gives people the impression that the panic 1 is more special, and the calling or recover() would return 1 if the "println(recover().(int))" line is not commented off. In fact, 5 would be returned.
Another reason for this suggestion is that the final report is like a stack trace, so inverting the orders would be better.
Not a big problem, just a small suggestion.

The panic values are printed in the order in which the panics are executed.  I think anything else would be impossibly confusing.

@ianlancetaylor, but is there any special reason to prefix a '\t' character exception the first line?

I suppose it does seem to make it a little clearer which value started the chain of panics.  The tab character dates back to when Russ initially implemented panic: https://golang.org/cl/831042 (see printpanics in pkg/runtime/proc.c).


Update Java 8 to Allow Bash Expressions

Similar to #71 but for Java 8 in addition to Java 11. I tried putting this on the same PR as Java 11 but couldn't figure out how to.

Wait I think there's a bug


Update autorest version to prerelease 3.0.0-alpha.20240320.3.x

Triggered from pull request: https://github.com/Azure/autorest.csharp/pull/4185

Close in favor of #43872


Read Multiple worksheets in the same Excel

Hi .. Is is possible to read multiple worksheet under same excel(.xlsx) file which is uploaded ? Please reply if there is a way to do this

Yes, the default behavior of the XLSX module is to return a workbook object that has a "Sheets" property.
First let's get the workbook object.
var workbook = XLSX.readFile('test.xlsx');
Now we can access an object whose properties (keys) are sheet names from the workbook.
var sheets = workbook.Sheets;
We can also access an array of strings called SheetNames.  Each string is the name of the sheet.
var sheetNames = workbook.SheetNames;
Finally, we can put it all together and access specific spreadsheet from the supplied excel file.  For this example I will just access the first sheet.
var sheetName = workbook.SheetNames[0];
var sheet = workbook.Sheets[sheetName ];
So if you want to read multiple sheets you can use the list of sheet names (workbook.SheetNames) and the sheets object (workbook.Sheets).  I would use a for-loop to go through each sheet name in the SheetNames array, then access the Sheets object by passing in the sheet name to get the sheet.
for (var i = 0; i < workbook.SheetNames.length; ++i) {
var sheet = workbook.Sheets[workbook.SheetNames[i]];
}
Hopefully this helps.  You can refer to the documentation as well.

As @harbhub pointed out, the standard XLSX.read and XLSX.readFile functions will read every worksheet by default.  The names are available in the workbook's SheetNames property and the actual sheet objects are in the Sheets object.

how to pass the name of sheet if multiple sheet available in workbook

I have the same issue that "How to pass the name and id of the sheet if multiple sheets available in the workbook?"  @MarziyaSarwar if you find the solution please help me to solve this...


Fix generateAbsoluteUrl

Q
A

Is bugfix?
✔

New feature?
❌

Breaks BC?
❌

Fixed issues
#57

Thanks.


Add support for merge request: create todo

see https://docs.gitlab.com/ce/api/merge_requests.html#create-a-todo

Fixed issues with comment and overwrote last commit.

LGTM, but needs to rebased now after merging PR #281...

Done. If in the future I open up several PRs in at once, should I always add the changes from "previous" PRs to "following" PRs to avoid this re-work?

One way to do this is by creating the branch for the 2nd PR from the branch of the 1st PR instead of from master. And then the 3rd should be a branch of the 3rd. But this still is not a 100% solution as other PR's might be merged in between which would again wreck your other PR's.
In this case were all changes are pretty related and all take place on the same service and in the same file, I would just make 1 PR with 3 separate commits. One for each feature. That way you will never have this kind of problem...
But thanks for fixing, all looks good now!


[customer_testing] Refactor runner to be testable

Refactor the customer testing code to be testable (add some tests)
Add customer tests to the CI tests

Issues
https://github.com/flutter/flutter/issues/76801

It seems easier to just rename the files that are being skipped.

It seems easier to just rename the files that are being skipped.

The skip logic is less than 20 LOC. Happy to remove it and just contribute the tests.
The advantage to having a defined skip method is there'll be a log line saying Skipped $test: $reason, whereas renaming shows nothing in the log.
I wrote this because i've ran into a few process issues with flutter/tests where I have to ping individuals to find out why a test was removed. I hope with this field it would make it more common to file tracking issues when tests are being disabled.

It seems easier to just rename the files that are being skipped.

i think the acceptance criteria should be that it's clear to anyone trying to keep the framework tree green the process for temporarily skipping a test, and that we leave breadcrumbs for ourselves to know that it's being skipped and we need to re-enable.

The skip logic is less than 20 LOC.

To be honest my concern is more that it paves the way for even more features rather than about the complexity of any individual feature. Every feature of our infrastructure has a cognitive cost on everyone on the team. My goal when writing the customer testing logic was to keep it as simple as possible so that anyone could understand how it worked by just looking at it. (Whether I succeeded is debatable.)
My other concern is that by having a feature for skipping tests we are saying that skipping tests is ok, whereas it should be a really rare occurrence. Skipped tests are technical debt. I'm reluctant to add infrastructure support for adding more technical debt. It sounds like it's something we are doing often enough that we're adding features to support it, which seems like a problem. A solution that removed the need for ever skipping seems like a better solution, whether that's some sort of process change or cultural or something else.
For example, it sounds like a recent case of skipping a test was motivated by problems with goldens. Should we just ban goldens from flutter/tests, the way we ban flaky tests?

For example, it sounds like a recent case of skipping a test was motivated by problems with goldens. Should we just ban goldens from flutter/tests, the way we ban flaky tests?

I think we should, as I don't think having golden tests in customer_testing will scale.

For example, it sounds like a recent case of skipping a test was motivated by problems with goldens. Should we just ban goldens from flutter/tests, the way we ban flaky tests?

I agree, we shouldn't be skipping tests this frequently to require infra functionality. Until we have better goldens support for customer tests, we should make it policy to not fail on goldens in the customer tests. We could just add --update-goldens to disable them for now.  \cc @Piinks

(If we go down that route we should reach out to the current tests' contacts to let them know of the policy change, and we should document the policy in the readme/template.)

For example, it sounds like a recent case of skipping a test was motivated by problems with goldens. Should we just ban goldens from flutter/tests, the way we ban flaky tests?

This was suggested in https://github.com/flutter/flutter/issues/71437#issuecomment-736812704 when imperceptible changes from the Skia roll broke the tree due to goldens in the svg package in flutter/tests. It appears to be happening with more frequency (https://github.com/flutter/flutter/issues/76629) across different customer tests, so I think disallowing goldens is the right move.
I do not know yet what we can do to support customer golden tests, they can be configured and managed in any way the customer sees fit, and it feels a bit outside of our control. If there were actually a regression in a golden file - that would be the test working as expected. The roll would stop and the offending change reverted. But these really tiny Skia changes cause failures that are intended to just pass through, which is why the roll keeps getting stuck.
I think we should definitely communicate with customers before deciding or implementing anything and provide ample documentation for any new test contributors. I know the svg package is mostly goldens for example, so we might want to see what customers think first.
cc @dnfield

PTAL again. I removed the proposed skip logic and kept the tests. There's still the previous skipOnFetchFailure logic.

Would you be willing to create a new set of commits that has those three kinds of changes done in different commits? That way it would be easy to review the actual refactoring steps separate from the mechanical code moves and code reformattings.

Done! PTAL again.


Why two code bases?

Why not stick w/ golang, compile it to webassembly for running in the browser using what's available in pion, and then create an event bus to wrap the whole thing?  Then the typescript wrapper can make calls via the event bus?

What we want to encourage is multiple implementations of IPFS in multiple languages targeting specific use-cases.
Having a modular, composable stack allows developers to pick and choose the components they want which enables new and interesting implementations like Elastic IPFS (built on JS).  Kubo targets different use cases and is not flexible like this so it's not a great fit.
It's also important to note that WASM is not a magic bullet, compiling go code to WASM typically results in a large binary which isn't great for browser users and for JS developers in general it's a completely black box which harms their ability to debug problems and otherwise be productive.  There's also no guarantee of performance since you'll be copying lots of data in and out of the runtime.
There are also about 7x the number of JS vs Go developers in the world - it's important to meet them where they are.  Saying "just use the go version" effectively excludes them from contributing to the IPFS projects and fails to leverage their massive amount of collective experience in deploying browser and Node.js apps at scale.

We're not attempting to maintain feature parity between the different implementations at the API level.  For example there are lots of Kubo APIs we don't want to carry forward, like the object API and specialised APIs like bootstrap, most of the config ones, etc.
Implementations should be compatible on the wire though, that's incredibly important, but each implementation should have the freedom to innovate at the API level as they see fit.


Not all R Process (or radian process) will be killed when vscode exited in ubuntu

Describe the bug
Not all R Process (or radian process) will be killed when vscode exited in ubuntu (22.04). See following picture where radian remains after vscode have been closed.

To Reproduce
Sorry, I cannot reproduce this steadily. This issue has been reported in windows too. I have experienced twice in both situations I have used BiocParallel to implement parallelly computations.
Can you fix this issue by yourself?  I end up with a lot of "radian" process still running at the end of the day.

For info, here is what is happening.

I see this every time I close VS Code on MacOS (13.3.1, M1). The R/radian process is killed if I close the (internal) terminal it's running in, but not if I close VS code altogether.


Update Core Install - Voyager

JIRA issue created by: rcook
Originally opened: 2012-07-09 03:03 PM
There is some Millennium and Dummy stuff http://code.google.com/p/xcncip2toolkit/wiki/CoreInstallation .
The “Millennium example here” needs to be replaced with actual, working Millennium examples. Also Symphony & Voyager examples should be added.

JIRA User: rcook
JIRA Timestamp: 2012-07-18 11:06 AM
Can someone articulate what should go here for each connector..... [~msuranofsky]<EMAIL_ADDRESS>[~pzurek] [~bodfishj]  The other drivers are issues 130 and 131.

JIRA User: Patrick Zurek (patrickzurek)
JIRA Timestamp: 2012-07-18 01:11 PM
Voyager configuration is documented on the wiki at http://code.google.com/p/xcncip2toolkit/wiki/VoyagerConfiguration


Include codecov token on pipeline

Codecov Report

:exclamation: No coverage uploaded for pull request base (main@f495f26). Click here to learn what that means.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main      #34   +/-   ##
=======================================
  Coverage        ?   22.81%
=======================================
  Files           ?       25
  Lines           ?      960
  Branches        ?      173
=======================================
  Hits            ?      219
  Misses          ?      723
  Partials        ?       18

Flag
Coverage Δ

unittesting
22.81% <0.00%> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.
Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


add Memoize support

I didn't see this as an existing issue when searching just now, but morelinq seems like a good place for a Memoize extension method.
The goal is to allow callers to iterate over a sequence multiple times, but caching the results so the inner/original sequence is still only iterated once.
The most common use case I've seen for this is when interacting with sql queries. If you use ToList/ToArray or the like (as many people do), you end up forcing your code to wait until all the results have been pulled into memory from the server.  Memoize improves this situation by allowing you to start pulling from the queryable immediately, but without having to incur the penalty if you end up needing to iterate over it multiple times (as the data gets cached as it's been pulled from the source).
An example gist can be found here to get across the idea:
https://gist.github.com/thomaslevesque/3345186

Originally reported on Google Code with ID 100
Reported by @jamesmanning on 2015-05-01 14:40:32

There is a fairly good implementation here:
http://community.bartdesmet.net/blogs/bart/archive/2009/09/12/taming-your-sequence-s-side-effects-through-ienumerable-let.aspx
Unfortunately the license for this code was not clarified :(

I also found an implementation in the interactive extensions:
http://rx.codeplex.com/SourceControl/latest#Ix.NET/Source/System.Interactive/EnumerableEx.Buffering.cs
Perhaps no need to integrate here?

Is there anything wrong with an implementation as simple as this?
public class MemoizedSequence<T> : IEnumerable<T> {

    private IEnumerable<T> source;
    private List<T> cache;

    public MemoizedSequence(IEnumerable<T> source) {
        if (source == null) throw new ArgumentNullException("source");
        this.source = source;
    }

    public IEnumerator<T> GetEnumerator() {
        //Cache will only be null on the first iteration
        //If there's no cache, create one; otherwise, iterate cache
        return (cache == null)
            ? CacheSource()
             : cache.GetEnumerator();
    }

    IEnumerator IEnumerable.GetEnumerator() { return GetEnumerator(); }

    private IEnumerator<T> CacheSource() {
        //Create cache
        this.cache = new List<T>();

        //Fill and yield cache
        foreach (var element in source) {
            this.cache.Add(element);
            yield return element;
        }

        //Dispose of source
        this.source = null;
    }
}

That implementation might use a partial list if the memo has not been fully
iterated when the second iteration is started.
On 23 Apr 2016 15:30, "JamesFaix"<EMAIL_ADDRESS>wrote:

Is there anything wrong with an implementation as simple as this?
public class MemoizedSequence : IEnumerable {
private IEnumerable<T> source;
private List<T> cache;

public MemoizedSequence(IEnumerable<T> source) {
    if (source == null) throw new ArgumentNullException("source");
    this.source = source;
}

public IEnumerator<T> GetEnumerator() {
    //Cache will only be null on the first iteration
    //If there's no cache, create one; otherwise, iterate cache
    return (cache == null)
        ? CacheSource()
         : cache.GetEnumerator();
}

IEnumerator IEnumerable.GetEnumerator() { return GetEnumerator(); }

private IEnumerator<T> CacheSource() {
    //Create cache
    this.cache = new List<T>();

    //Fill and yield cache
    foreach (var element in source) {
        this.cache.Add(element);
        yield return element;
    }

    //Dispose of source
    this.source = null;
}

}
—
You are receiving this because you commented.
Reply to this email directly or view it on GitHub
https://github.com/morelinq/MoreLINQ/issues/100#issuecomment-213801521

@JamesFaix yeah, unfortunately it's pretty important to only enumerate as far as you have to.  Thankfully, the examples linked seem to all do so, we'd just need to  grab one with compatible licensing (or author willing to allow relicensing or whatever)

@atifaziz it looks like Reactive Extensions uses the same Apache 2.0 license as MoreLINQ does (assuming the 'LICENSE' link from https://www.nuget.org/packages/morelinq/ is still accurate, I didn't see a license file in the project root here on github), so we should be ok adding their implementation to MoreLINQ AFAICT?  Would you be ok with that? Or would you feel better to leave Memoize out of MoreLINQ and just point people to using the Reactive Extensions NuGet package if they want Memoize?

It looks like there is an implementation in the F# core library.
SeqModule.Cache{T}(this IEnumerable{T})


Feature/plotting

What does this PR do?
Adding support to save fine tuning metrics to json. Adding script to plot saved metrics.
Tracks loss and perplexity, both at the step and epoch level and saves them to a json file. Tracks both train and validation metrics, for comparison after finetuning.
This requires matplotlib to be added as a requirement
Feature/Issue validation/testing

[x] Run finetuning on a single GPU with the default dataset to verify everything is working correctly

[x] Run finetuning on multiple GPUs with default dataset to verify it continues working

Running tests:

Command on a fully configured environment:

torchrun --nnodes 1 --nproc_per_node 4  examples/finetuning.py --enable_fsdp --use_peft --peft_method lora --mode
l_name ../Llama-2-7b-chat-hf/ --pure_bf16 --output_dir ../Llama-2-7b-peft-samsum-10 --batch_size_training 2 --gradient_accumulation_steps 2 --num_epochs 15 --save_metrics

Results:

A test was added to verify that when the save_metrics is used in train_config, the file gets generated.

Executing tests with full datasets to attach to the PR, but wanted to start the conversation on the proposed changes.

Added the --save_metrics parameter to configure if loss and perplexity are saved to a json file. Added comment in the readme and unit test to the corresponding file.


feat(icons): adds triangle-dashed icon

What is the purpose of this pull request?

[x] New Icon
[ ] Bug fix
[ ] New Feature
[ ] Documentation update
[ ] Other:

Description

adds triangle-dashed icon
Icon use case

I maintain an Obsidian drawing tool plugin, simple-sketch.
I'm going to allow users to draw dashed shapes, I can already add tool-buttons for circle and squares but not for triangles.
Alternative icon designs

Icon Design Checklist
Concept

[x] I have provided valid use cases for each icon.
[x] I have not added any a brand or logo icon.
[x] I have not used any hate symbols.
[x] I have not included any religious or political imagery.

Author, credits & license

[ ] The icons are solely my own creation.
[ ] The icons were originally created in # by @
[x] I've based them on the following Lucide icons:  triangle
[ ] I've based them on the following design:

Naming

[x] I've read and followed the naming conventions
[x] I've named icons by what they are rather than their use case.
[x] I've provided meta JSON files in icons/[iconName].json.

Design

[x] I've read and followed the icon design guidelines
[x] I've made sure that the icons look sharp on low DPI displays.
[x] I've made sure that the icons look consistent with the icon set in size, optical volume and density.
[x] I've made sure that the icons are visually centered.
[x] I've correctly optimized all icons to three points of precision.

Before Submitting

[x] I've read the Contribution Guidelines.
[x] I've checked if there was an existing PR that solves the same issue.

You should throw this into https://lucide-studio.vercel.app and press the tidy button.

You should throw this into https://lucide-studio.vercel.app and press the tidy button.

You should throw this into https://lucide-studio.vercel.app and press the tidy button.

nice, thank you! it's done


vcpkg_from_git does not work with SSH URL

Environment: Win 7 32 bit, VS17, vcpkg version:
Vcpkg package management program version 2018.11.23-nohash
Creating a header-only library ports\test\portfile.cmake
vcpkg_from_git(
    ...
    URL<EMAIL_ADDRESS>    ...
)

when running .\vcpkg build test I get this error message:
$ ./vcpkg.exe build test
-- Fetching<EMAIL_ADDRESS>CMake Error at scripts/cmake/vcpkg_execute_required_process.cmake:56 (message):
    Command failed: C:/Users/user/vcpkg/downloads/tools/git-2.20.0-windows/mingw32/bin/git.exe;fetch;ssh://git@example.org/repo/test.git;0;--depth;1;-n
    Working Directory: C:/Users/user/vcpkg/downloads/git-tmp
    Error code: 128
    See logs for more information:
      C:\Users\user\vcpkg\buildtrees\test\git-fetch-err.log

Call Stack (most recent call first):
  scripts/cmake/vcpkg_from_git.cmake:98 (vcpkg_execute_required_process)
  ports/pool-allocator/portfile.cmake:4 (vcpkg_from_git)
  scripts/ports.cmake:71 (include)

looking at git-fetch-err.log:
error: cannot spawn ssh: No such file or directory
fatal: unable to fork

The same repository can be cloned on the command-line without problem:
git clone<EMAIL_ADDRESS>
The HTTPS URL works fine

https://stackoverflow.com/questions/2643502/how-to-solve-permission-denied-publickey-error-when-using-git
Add your key to your account via the website.
https://github.com/settings/keys

I am not using github, the repository is hosted locally, git fails before starting the SSH connection.

local server ssh and git?
ssh -vT<EMAIL_ADDRESS>ssh -vT git@ localhost or <IP_ADDRESS>

the git repository in on a private LAN, I just changed the name to example.org in my report.
The crux is that I can clone the repository with the same URL on the command line but run with cmake it fails because git cannot spawn the ssh process.

https://github.com/Voskrese/vcpkg/blob/master/ports/labsound/portfile.cmake
example
set(GIT_URL "https://github.com/LabSound/LabSound.git")
set(GIT_REV "1567ec802d1525569ad3a46c97ef054679714fa7")
set(SOURCE_PATH ${CURRENT_BUILDTREES_DIR}/src/LabSound)
if(NOT EXISTS "${SOURCE_PATH}/.git")
	message(STATUS "Cloning and fetching submodules")
	vcpkg_execute_required_process(
	  COMMAND ${GIT} clone --recurse-submodules ${GIT_URL} ${SOURCE_PATH}
	  WORKING_DIRECTORY ${SOURCE_PATH}
	  LOGNAME clone
)

vcpkg_execute_required_process(
	  COMMAND ${GIT}

this does not use a SSH git URL, it uses HTTPS, I don't have that option in my environment

set(GIT_URL "https://github.com/LabSound/LabSound.git")
Is this a problem? it's just a link, replace
set(GIT_URL<EMAIL_ADDRESS>

OK I will try that thanks,
so I should not rely on vcpkg_from_git()?

Only one thing, there will be a password request via SSH, how to handle it ... I don’t know

sorry same problem, as soon as I replace git URL by<EMAIL_ADDRESS>I get the same error:
error: cannot spawn ssh: No such file or directory
fatal: unable to fork

set(GIT_URL<EMAIL_ADDRESS>

I have the correct URL, the problem is that git cannot use the ssh transport protocol when invoking from CMake hence the message

no problem with the protocol
edit https://github.com/Voskrese/vcpkg/blob/master/ports/labsound/portfile.cmake
replace
set(GIT_URL "https://github.com/LabSound/LabSound.git")
to
set(GIT_URL<EMAIL_ADDRESS>there is a problem as I said with access
error

Клонирование в «E:/tools/vcpkg/buildtrees/labsound/src/LabSound»…
<EMAIL_ADDRESS>Permission denied (publickey).

well it seems our environment is different

the fix seems to be setting the path to ssh.exe:
set(ENV{PATH} "C:/Users/user/vcpkg/downloads/tools/git-2.20.0-windows/usr/bin/"
vcpkg_from_git(
...)

so that git.exe knows how to spawn the SSH process

good, that all is well
closing?

I wouldn't think so, it took me while to figure it out, what would prevent
somebody else to run into the same problem?
On Wed, Apr 17, 2019 at 4:01 PM Voskrese<EMAIL_ADDRESS>wrote:

good, that all is well
closing?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/Microsoft/vcpkg/issues/6126#issuecomment-484292851,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AABYGFKX3CWTTCMQKW6GL3TPQ6T4HANCNFSM4HGV25CA
.

it's your business. ideology is as follows. time you closed. then the problem is solved, and having found a similar problem by searching, the user will know that these are solutions for his similar problem.

vcpkg filters the environment variable “PATH” from the system, so technically it’s different launching from the command line and from inside vcpkg. Or better: vcpkg filters everything from the environment apart whitelisted variables. And path is not one of them.
The choice was done to “clean up” messy user environment and being able to cleanly define new toolchains. Yours (like ninja+cuda not working because relying on path) is a problem that arise from this PATH loss...

Thanks for the information, just ran a test setting the GIT_SSH variable:
set(ENV{GIT_SSH} "C:/Users/user/vcpkg/downloads/tools/git-2.20.0-windows/usr/bin/ssh.exe")

and it works, would it make sense to whitelist this more specific variable?
On a separate note, setting the URL to a file:///... triggers a similar error:
error: cannot spawn sh: No such file or directory
fatal: unable to fork

but git does not use a matching environment variable (GIT_SH?): https://git-scm.com/book/en/v2/Git-Internals-Environment-Variables#_miscellaneous

Close this issue via #9446 merged.


chore(logo): add logo

What this PR does 📖
Trying to fix the broken logo at
https://warp.satellite.im/#/

was returning 404 at https://warp.satellite.im/_media/warp.png so ive added a logo there
note - not sure if works, added PR to see if would work 🔨

I think this would be fixed at https://github.com/Satellite-im/warp-docs

ohh thanks will close this one 🔨