[Bug]: Issue in getting the number of tokens used

Bug Description
When running the code from llama_index docs to get a count of tokens used, an issue is getting raised.
The issue is occurring at : /home/adidev/.local/lib/python3.8/site-packages/llama_index/callbacks/token_counting.py
The specific block of code is [line 40 to line 58 of token_counting.py] :
    elif EventPayload.MESSAGES in payload:
        messages = cast(List[ChatMessage], payload.get(EventPayload.MESSAGES, []))
        messages_str = "\n".join([str(x) for x in messages])

        response = payload.get(EventPayload.RESPONSE)
        response_str = str(response)

        # try getting attached token counts first
        try:
            messages_tokens = 0
            response_tokens = 0
            print("////////////////////// RESPONSE/////////", response.raw)
            if response is not None and response.raw is not None:
                usage = dict(response.raw.get("usage"))  # type: ignore
                print("//////////////////////USAGE/////////", usage)

                if usage is not None:
                    messages_tokens = usage.get("prompt_tokens", 0)
                    response_tokens = usage.get("completion_tokens", 0)

When I got the logs response.raw had normal content but response.raw was missing the field usage so it getting the error TypeError: 'NoneType' object is not iterable
This is the printed response.raw:
RESPONSE///////// {'id': 'chatcmpl-8i9UIzDAJGy8xdc0O3YU7xLs4NK83', 'choices': [Choice(delta=ChoiceDelta(content=None, function_call=None, role=None, tool_calls=None), finish_reason='stop', index=0, logprobs=None)], 'created':<PHONE_NUMBER>, 'model': 'gpt-3.5-turbo-0613', 'object': 'chat.completion.chunk', 'system_fingerprint': None}

It doesn't have a key by the name usage to an error is occuring usage is None.
Version
0.9.24
Steps to Reproduce

Make a directory listOfLesson and put some .txt files in that.
Run the following python code:

import os.path, tiktoken
from llama_index import (
    VectorStoreIndex,
    SimpleDirectoryReader,
    StorageContext,
    load_index_from_storage,
    set_global_service_context,
)
from llama_index.callbacks import CallbackManager, TokenCountingHandler
from llama_index import ServiceContext, set_global_tokenizer

# set_global_tokenizer(
#     tiktoken.encoding_for_model("gpt-3.5-turbo").encode
# )
# token_counter = TokenCountingHandler(verbose=True)
# callback_manager = CallbackManager([token_counter])
token_counter = TokenCountingHandler(
    tokenizer=tiktoken.encoding_for_model("gpt-3.5-turbo").encode
)
callback_manager = CallbackManager([token_counter])

from llama_index import ServiceContext
from llama_index.node_parser import SentenceWindowNodeParser
service_context = ServiceContext.from_defaults(chunk_size=1500, chunk_overlap=150, callback_manager=callback_manager)
set_global_service_context(service_context)

# check if storage already exists
PERSIST_DIR = "./storage"
if not os.path.exists(PERSIST_DIR):
    # load the documents and create the index
    documents = SimpleDirectoryReader("listOfLesson").load_data()
    index = VectorStoreIndex.from_documents(documents, service_context=service_context)
    # store it for later
    index.storage_context.persist(persist_dir=PERSIST_DIR)
else:
    # load the existing index
    storage_context = StorageContext.from_defaults(persist_dir=PERSIST_DIR)
    index = load_index_from_storage(storage_context)

# either way we can now query the index
query_engine = index.as_query_engine(similarity_top_k=5, response_mode="refine", streaming=True)
response = query_engine.query("Who is the enemy? Give a detailed answer")
# response.print_response_stream() # to print response in streaming manner
print(">>>>>>>>>>>>>>>>>>>>>>>",response)
# print(token_counter.total_llm_token_count)

Relevant Logs/Tracbacks
Traceback (most recent call last):
  File "starter.py", line 45, in <module>
    response = query_engine.query("Who is the enemy?Give a detailed answer")
  File "/home/adidev/.local/lib/python3.8/site-packages/llama_index/core/base_query_engine.py", line 30, in query
    return self._query(str_or_query_bundle)
  File "/home/adidev/.local/lib/python3.8/site-packages/llama_index/query_engine/retriever_query_engine.py", line 171, in _query
    response = self._response_synthesizer.synthesize(
  File "/home/adidev/.local/lib/python3.8/site-packages/llama_index/response_synthesizers/base.py", line 146, in synthesize
    response_str = self.get_response(
  File "/home/adidev/.local/lib/python3.8/site-packages/llama_index/response_synthesizers/refine.py", line 151, in get_response
    response = self._refine_response_single(
  File "/home/adidev/.local/lib/python3.8/site-packages/llama_index/response_synthesizers/refine.py", line 246, in _refine_response_single
    response = get_response_text(response)
  File "/home/adidev/.local/lib/python3.8/site-packages/llama_index/response/utils.py", line 9, in get_response_text
    for response in response_gen:
  File "/home/adidev/.local/lib/python3.8/site-packages/llama_index/llms/llm.py", line 58, in gen
    for response in chat_response_gen:
  File "/home/adidev/.local/lib/python3.8/site-packages/llama_index/llms/base.py", line 107, in wrapped_gen
    callback_manager.on_event_end(
  File "/home/adidev/.local/lib/python3.8/site-packages/llama_index/callbacks/base.py", line 122, in on_event_end
    handler.on_event_end(event_type, payload, event_id=event_id, **kwargs)
  File "/home/adidev/.local/lib/python3.8/site-packages/llama_index/callbacks/token_counting.py", line 156, in on_event_end
    get_llm_token_counts(
  File "/home/adidev/.local/lib/python3.8/site-packages/llama_index/callbacks/token_counting.py", line 53, in get_llm_token_counts
    usage = dict(response.raw.get("usage"))  # type: ignore
TypeError: 'NoneType' object is not iterable

This is fixed in the latest version of llama-index, please update
https://github.com/run-llama/llama_index/blob/e3e1de976d3aeb8914c370d030ee97a399c64767/llama_index/callbacks/token_counting.py#L55

This is fixed in the latest version of llama-index, please update
https://github.com/run-llama/llama_index/blob/e3e1de976d3aeb8914c370d030ee97a399c64767/llama_index/callbacks/token_counting.py#L55

Thanks a lot! That worked.


(Add) Methods to class node (Req.ID 7)

Same Bahavior, Action and Result like Issue #6

With implemented UML Class Model this feature is archieved


Thumbnail requests don't appear to be deduped

Unexpected error locating media: pq: duplicate key value violates unique constraint "media_index" implies they aren't, at least.

Fixed with pipeline rewrite


Adding new sensors to the Android sense agent

@lgobinath, could you please resolve the conflicts in the PR?


Warning about disconnecting a Sync Table no longer appearing

Not sure what happened here, but I expect that when a Sync Table is going to be added, there's a message about "are you sure? you won't be able to connect this table anymore!".
It does't appear now when you select "never" in the Sync Table options. Not sure if this is a design decision or if we missed something.

Steps:

Go to a Sync table
Click on "view options"
Select "never" and apply. The table is disconnected but the warning doesn't appear.

@xavijam

I don't think a warning is needed, tho...

Then we can close. It was appearing before, so I wondered if we removed it on purpose or not.

Closing then


Dev clark

This should do

So then the previous PR needs to be closed?
Please remove everything under outDir and pycache

Now I delete everything pycache, and the output_dir

Very nice. Thanks. Will merge and update when I have a bit of free time to test it.


feat(connector-besu): add get past logs method

Signed-off-by: Hana Awad<EMAIL_ADDRESS>

Codecov Report

:exclamation: No coverage uploaded for pull request base (main@d470540). Click here to learn what that means.
The diff coverage is n/a.

:exclamation: Current head 74a1240 differs from pull request most recent head 141bec2. Consider uploading reports for the commit 141bec2 to get more accurate results

@@           Coverage Diff           @@
##             main    #1042   +/-   ##
=======================================
  Coverage        ?   72.44%
=======================================
  Files           ?      238
  Lines           ?     8223
  Branches        ?      973
=======================================
  Hits            ?     5957
  Misses          ?     1749
  Partials        ?      517

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update d470540...141bec2. Read the comment docs.


Consume/Produce multiple kafka messages at once in git step / handlers

In certain situations, when message processing is slow, and relies heavily on network requests, it can be parallelized by grabbing multiple incoming messages from the source and processing them concurrently. This can provide better scalability than processing one message at a time, and leaving the process idle waiting for network responses.
Similarly, when messages are being inserted into the database, it might be better to perform batch inserts rather than inserting one message at a time.
For such usecases I would like to update kafka source definition like this:
sources:
- kafka:
    topic: input-topic
    maxMessages: 5 // Maximum number of messages to pick at once from the kafka source
    timeout: 1 // Maximum number of seconds to wait if there aren't {{maxMessages}} in the topic yet. Can be 0, which means kafka should not wait at all, and just return what is in the topic immediately.

And the handler function in git step or in handler:
package main

import "context"

func Handler(context context.Context, m [][]byte) ([][]byte, error) {
	responses := [][]byte{}
	for _, x := range m {
		responses = append(responses, []byte("hi "+string(x)))
	}
	return responses, nil
}

And similar changes for Java & Python environments.
I'm wondering if maybe there should be a way to tell handler/git step if it should expect one or more messages in the yaml, so that if user still expects just one message to come through, then they could use the previous handler function format?

This is kind of how it works today, except it is limited by partitions. Essentially the sidecar will send messages concurrently up to the number of partitions. I can see case where you might want to dispatch more messages that that in parallel.

Oh that's interesting, but that's not exactly the same thing I think. This doesn't allow me to define my own "process in batch" logic, of operating on multiple messages at once. I'm talking about cases of making network requests, running binaries, sending messages to a database etc.


eclipse 2022-03 compatibility

So that means that dbeaver plugin doesn't work with latest eclipse 2022-03? I'm using windows 10 I tried installing it from Marketplace and I get a
Cannot complete the install because one or more required items could not be found.
Software being installed: DBeaver IDE <IP_ADDRESS>203060510 (org.jkiss.dbeaver.ide.feature.feature.group <IP_ADDRESS>203060510)
Missing requirement: Bouncy Castle PKIX, CMS, EAC, TSP, PKCS, OCSP, CMP, and CRMF APIs 1.69.0.v20210713-1924 (org.bouncycastle.bcpkix 1.69.0.v20210713-1924) requires 'java.package; org.bouncycastle.asn1.bsi [1.69.0,1.70.0)' but it could not be found
Cannot satisfy dependency:
From: DBeaver IDE <IP_ADDRESS>203060510 (org.jkiss.dbeaver.ide.feature.feature.group <IP_ADDRESS>203060510)
To: org.eclipse.equinox.p2.iu; org.jkiss.dbeaver.runtime.feature.feature.group [<IP_ADDRESS>203060510,<IP_ADDRESS>203060510]
Cannot satisfy dependency:
From: DBeaver Runtime <IP_ADDRESS>203060510 (org.jkiss.dbeaver.runtime.feature.feature.group <IP_ADDRESS>203060510)
To: org.eclipse.equinox.p2.iu; org.bouncycastle.bcpkix [1.69.0.v20210713-1924,1.69.0.v20210713-1924]
. Trying to install the dbeaver bouncy castle package on its own doesn't help, gives the same error.
Originally posted by @CristiFS in https://github.com/dbeaver/dbeaver/issues/15880#issuecomment-1071079176

I have the exactly same issue with the latest eclipse release on a ubuntu 20.04 computer

Hi,
I have the same error with eclipse 2021.12 on windows 10

Same error here with Eclipse 2022-03 on Linux

Hello!
Can you please test the latest version of DBeaver? https://dbeaver.io/download/

Hi,
fix the problem for me.

Thanks for the answer and for the investigation @LBeaulaton

The plugin is working for me on windows 11.

Thanks @3rdey3

The problem can be reproduced with latest Eclipse release 2022-12:

fresh Eclipse JDT installation
try to install DBeaver 22.03 from the marketplace

It complains about missing Bouncycastle dependency


ubuntu-cx11-02: Am 23.06.21 um 10:01: Transport endpoint is not connected

●<EMAIL_ADDRESS>loaded failed failed Syncthing - Open Source Continuous File Synchronization for root

LOAD   = Reflects whether the unit definition was properly loaded.
ACTIVE = The high-level unit activation state, i.e. generalization of SUB.
SUB    = The low-level unit activation state, values depend on unit type.

1 loaded units listed. Pass --all to see loaded but inactive units, too.
To show all installed unit files use 'systemctl list-unit-files'.

RCA:
Jun 23 10:00:28 ubuntu-cx11-02 systemd[1]<EMAIL_ADDRESS>Main process exited, code=exited, status=1/FAILURE
Jun 23 10:00:28 ubuntu-cx11-02 systemd[1]<EMAIL_ADDRESS>Failed with result 'exit-code'.
Jun 23 10:00:29 ubuntu-cx11-02 systemd[1]<EMAIL_ADDRESS>Service hold-off time over, scheduling restart.
Jun 23 10:00:29 ubuntu-cx11-02 systemd[1]<EMAIL_ADDRESS>Scheduled restart job, restart counter is at 5.
Jun 23 10:00:29 ubuntu-cx11-02 systemd[1]: Stopped Syncthing - Open Source Continuous File Synchronization for root.
Jun 23 10:00:29 ubuntu-cx11-02 systemd[1]<EMAIL_ADDRESS>Start request repeated too quickly.
Jun 23 10:00:29 ubuntu-cx11-02 systemd[1]<EMAIL_ADDRESS>Failed with result 'exit-code'.
Jun 23 10:00:29 ubuntu-cx11-02 systemd[1]: Failed to start Syncthing - Open Source Continuous File Synchronization for root.
Jun 23 10:01:01 ubuntu-cx11-02 systemd[1]<EMAIL_ADDRESS>Start request repeated too quickly.
Jun 23 10:01:01 ubuntu-cx11-02 systemd[1]<EMAIL_ADDRESS>Failed with result 'exit-code'.
Jun 23 10:01:01 ubuntu-cx11-02 systemd[1]: Failed to start Syncthing - Open Source Continuous File Synchronization for root.

Fixes:
https://gitlab.com/thomasmerz_cloudserver/hetzner-root-dir/-/commit/25442b3e9ba8cf54a4101d59919047877851edb8
https://gitlab.com/thomasmerz_cloudserver/hetzner-root-dir/-/commit/521613de5c9d1b75ab197f3176a5de5a91876f3f


How to use CacheKeyFactory

Hi,
I have an old problem with the new version of Xamarin Forms and FFImageLoader on iOS. (using.Net Standard 2.0)
In a cell inside a listview, I used a stream of an image. I create a unique image based on a pricetag length.
So each ViewCell shall have unique images with round corners.
<forms:CachedImage
x:Name="PricePlate"
Aspect="AspectFill"
.../>
Code Behind:
...
PricePlate.Source = ImageSourc.FromStrem(....)
...
Works as a charm in UWP but in iOS all cells seem to share the absolute first Image I set.
And when I scroll the images disappears.
I also set a new image each time a quantity label increases in the cell.
The problem is that the image is increasing as intended on UWP but in iOS it always uses the absolute first image created on all cells.
We are not using the RecycleElement thing.
And I set the new image as soon my label got some changes.
PriceLabel.SizeChanged += PriceLabelOnSizeChanged;
..
PricePlate.Source = ...
..
I tried the solution of OnBindingContextChange but still same problem.
And I also tried to add a CustomKeyFasctory to give me a unique key for each item. But then there is no image showing at all, But if I return null from my custom factory. The image shows again but still the same problem as above.
 <forms:CachedImage
                x:Name="PricePlate"
                Aspect="AspectFill"
                AbsoluteLayout.LayoutBounds="0.5, 0.5, -1, -1"
                AbsoluteLayout.LayoutFlags="PositionProportional">
                <forms:CachedImage.CacheKeyFactory>
                    <images:CustomCacheKeyFactory/>
                </forms:CachedImage.CacheKeyFactory>

So a unique key value seems not work at all :/
Must I have missed something? Or why does not unique keys work? And why is the image still disappearing on scrolling?
Best, Johan

Here's the sample of using custom cache key factory + custom StreamImageSource subclass which has a Key property sample1 sample2. This will allow FFImageLoading to use memory cache properly, without it, no images would be reused.

yes tried that sample. That was my try with a customfactory.
First, try I did with a datetime.now.Tick value. But no images showed up.
second try with a hash value, same problem. When my factory returned a null key image show but the same problem as before,
Here is my subclass.
    public class KeyImageSource : StreamImageSource
    {
        public string Key { get; set; }

        public static ImageSource FromStream(Func<Stream> stream, string name)
        {
            var f = (ImageSource)new KeyImageSource()
            {
                Stream = (Func<CancellationToken, Task<Stream>>)(token => Task.Run<Stream>(stream, token)),
                Key = $"{DateTime.UtcNow.Ticks}-{name}".ToHash()
            };
            return f;
        }
    }

My factory:
 class CustomCacheKeyFactory : ICacheKeyFactory
    {
        public string GetKey(ImageSource imageSource, object bindingContext)
        {

            return null;
        }
}

And xaml:
   <forms:CachedImage
                    x:Name="PricePlate"
                    Aspect="AspectFill"
                    AbsoluteLayout.LayoutBounds="0.5, 0.5, -1, -1"
                    AbsoluteLayout.LayoutFlags="PositionProportional">
                    <forms:CachedImage.CacheKeyFactory>
                        <images:CustomCacheKeyFactory/>
                    </forms:CachedImage.CacheKeyFactory>
                    <forms:CachedImage.Transformations>
                        <transformations:TintTransformation
                        HexColor="{StaticResource BUTTON_BACKGROUND_COLOR_AS_STRING}" EnableSolidColor="True" />
                    </forms:CachedImage.Transformations>
                </forms:CachedImage>

With null in my factory same problem as without a factory on iOS still show up the image but all cells seem to share the same one. Alla shall have different sizes, but all got the same size as the first cell image. In UWP everything works as expected. BUT uwp also do not show an image at all if I return other value then Null from my factory.
Here is my method that creates the image for me.
`  public static ImageSource GenerateRoundedCornerImageSource(int width, int height, int radius,string cacheKey = null, bool isAntialias = false)
{
var bitmap = new SKBitmap(width, height, SKImageInfo.PlatformColorType, SKAlphaType.Premul);
        var canvas = new SKCanvas(bitmap);
        canvas.Clear(SKColors.Transparent);

        var paint = new SKPaint
        {
            IsAntialias = isAntialias,
            Color = SKColors.Black
        };

        canvas.DrawRoundRect(new SKRect(0, 0,width, height), radius, radius, paint);

        var image = SKImage.FromBitmap(bitmap);
        var data = image.Encode(SKEncodedImageFormat.Png, 100);

        var ms = new MemoryStream();
        data.SaveTo(ms);

        return KeyImageSource.FromStream(() => ms, cacheKey);
    }`

class CustomCacheKeyFactory : ICacheKeyFactory
{
    public string GetKey(ImageSource imageSource, object bindingContext)
    {
        var keySource = imageSource as KeyImageSource;
        return keySource?.Key;
    }
}

Still the same problem.
As soon there is a value from key beside null, no images are in the list :( And if I send null, or remove the factory the images are there. BUT then I have the issue that iOS seems to show me only the first created image in all cells added. And removed them when scrolling outside the scroll.
Not sure if you can access my dropbox. But I will try.
In the box image with the name as the problem.
https://www.dropbox.com/sh/8gnz8x8y1l3nxr0/AAClU8WDqB72F2QHZhuOM3iJa?dl=0
iOS
With null key

Images are shown. But all are the same size as first ever made image in the list.
At scolling images disapear

With key from my code above (and yours with key set)

Images are not there at all

UWP
With null key

Images are shown as expected. different size based on price length
At scroll, they are still there.
When price label expand so do the image as I want to (not on iOS though it seams to share first image
created

With key

No images are there

Android
Not tested yet.

Damn, should not close this issue... pressed the wrong button...

It should work fine, but I noticed another error in you code. You must always return a new stream:
Instead:
return KeyImageSource.FromStream(() => ms, cacheKey);
Do:
return KeyImageSource.FromStream(() => new MemoryStream(bytes), cacheKey);
That's why those methods require actions not stream reference.

Even if I have this?
var ms = new MemoryStream(); ///New stream
data.SaveTo(ms);
return KeyImageSource.FromStream(() => ms, cacheKey);

Here are my versions:

var bytes = ms.ToArray(); return KeyImageSource.FromStream(() => new MemoryStream(bytes), cacheKey); `
Cool works with key on UWP will try iOS now... have 8-10 build time till test.

Your code is a bad / non working version. You must always return a new stream, also in Xamarin.Forms too.

Actually, more optimised version is:
public static ImageSource GenerateRoundedCornerImageSource(int width, int height, int radius,string cacheKey = null, bool isAntialias = false)
{
        return KeyImageSource.FromStream(() =>
        {
            var bitmap = new SKBitmap(width, height, SKImageInfo.PlatformColorType, SKAlphaType.Premul);

            var canvas = new SKCanvas(bitmap);
            canvas.Clear(SKColors.Transparent);

            var paint = new SKPaint
            {
                IsAntialias = isAntialias,
                Color = SKColors.Black
            };

            canvas.DrawRoundRect(new SKRect(0, 0,width, height), radius, radius, paint);

            var image = SKImage.FromBitmap(bitmap);
            var data = image.Encode(SKEncodedImageFormat.Png, 100);

            var ms = new MemoryStream();
            data.SaveTo(ms);
            return ms;
        }, cacheKey);
    }

You are the king 👍 it works now... Thank you so much. Sad I didn't see that part from the beginning. Was so blind though UWP worked as intended for me.
Thanx so thankful for your help. have nice Christmass! And you gave me the best present :)

@jnormen Nice to hear that's working! :) Have a nice Christmas too :) Cheers!


Add an optional policy for modifications of a Tenant DB

A policy for auditing modifications to Tenant DBs should be added. This may log if a Tenant DB was started/stoped but also if additional tenants have been created or dropped.
For example:
-- optional: needed for system changelog
-- System DB
-- this policy should not cause many entries in the audit log
CREATE AUDIT POLICY "_SAPS4_Opt_13 TenantDB modifications"
  AUDITING ALL
    ALTER DATABASE,
    CREATE DATABASE,
    DROP DATABASE,
    RENAME DATABASE,
    START DATABASE,
    STOP DATABASE
  LEVEL ALERT TRAIL TYPE TABLE RETENTION 90;
ALTER AUDIT POLICY "_SAPS4_Opt_13 TenantDB modifications" ENABLE;

we need to add:
-- this policy is only for a tenant database relevant
thanks for the good suggestion

policy added in "optional" file


Reflecting renaming changes on EventFlow code base

needs to wait until this is in:
https://github.com/project-streamzi/cloudevent-flow/pull/68

@sjwoodman so... we should rename this too :-)
eventflow-apb ... Will do ! :-)


Service Catalog migration reconciler

It was decided that we should reimplement the logic from https://github.com/SAP/sap-btp-service-operator-migration as a reconciler. It's not trivial to import the code because the whole application is structured as CLI.
This PR imports what is importable and reimplements certain heavily CLI architectured parts of the application.
The most notable changes are:

using proper logger instead of fmt.Println
forward errors out of reconciliation loop instead of panic using cobra.CheckErr

there will be a follow-up PR containing similar logic for including https://github.com/kyma-incubator/sc-removal

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

todo: support execution on already migrated clusters (e.g. no svcat CRDs present)

/test pre-main-reconciler-integration-k3d


Memory usage grows exponentially of the esbuild process

When using serverless-offline and making changes to files the memory usage of the esbuild process seems to grow exponentially.
I start out with about 1 GB of ram usage and after 10 changes the esbuild process is using 8 GB of ram.

I can confrim this. I am running into stack overflows continuously - and my colleagues on the project too.
It is probably linked to the alchemy between chokidar and esbuild.

From what I can see this does the leak: https://github.com/floydspace/serverless-esbuild/blob/ad3e93e5452122c17f110648c4f2e2a2bd0463c3/src/index.ts#L160 true option here is using incremental bundling. Maybe a lead.

incremental build does keep things in memory to speed up subsequent bundling: https://esbuild.github.io/api/#incremental. Could it be a leak in esbuild itself? Should we call dispose to free up resources from time to time ?

@olup I think it's just used incorrectly. We need to call rebuild instead of initiating a new esbuild instance. That way rebuilding would be even faster aswell.

Yes true, otherwise the cache is a bit lost anyway. I'll flesh a pr tomorrow. Beyond this one subject, serverless offline, in watch mode, is terribly leaking so the rest of the process will end up eating the whole memory anyway. But we can improve what depends on us.

I rewrote it to use rebuild. Sadly this does not resolve the memory issue. https://github.com/floydspace/serverless-esbuild/pull/101 so I think it might actually be an esbuild issue.

I am reporting I've had similar issues, each build just linearly increases the amount of memory esbuild is using, if I was to hazard a guess, I'm thinking it has something to do with node_modules and this quote from the esbuild docs:

Files are stored in memory and are not re-read from the file system if the file metadata hasn't changed since the last build. This optimization only applies to file system paths. It does not apply to virtual modules created by plugins.

I have a feeling something is causing all the metadata change from ESBuilds perspective and it might not garbage collect old metadata (I imagine it doesn't watch for that). But I haven't looked at any of the code for serverless-esbuild so I might be completely wrong...

incremental build does keep things in memory to speed up subsequent bundling: https://esbuild.github.io/api/#incremental. Could it be a leak in esbuild itself? Should we call dispose to free up resources from time to time ?
Or we could leave the watching to esbuild itself : https://esbuild.github.io/api/#watch, and see if memory is better handled but I guess this was sub-optimal @floydspace ?

I'd be curious what this responds back with when logging is set to max
I might experiment a little tonight with this

I've been experiencing the same problem of exponential growth in memory usage.
As far as I can tell, rebuild seems to have better memory usage results than calling build every time.
With the changes in my PR, memory usage seems to cap out around 1 GB (for my current codebase), whereas it used to increase exponentially until crashing.
Let me know if the PR #123 solves your problem @olup or @thomaschaaf.

That PR partially fixed the issue for me (it still uses a lot of memory, but not as much), but serverless-offline still consumes a lot of memory unless allowCache is enabled and eventually exhausts itself (and dies) - this may be an issue with our particular code base though. Not sure if others are experiencing this particular pain point.
The problem of enabling allowCache is that when ESBuild recompiles, the running code does not change to the newly compiled files, so to see changes it requires resetting the server or having a large memory leak.
I put in a very blunt workaround in the compiled serverless-esbuild files after the build that does seem to work wonderfully which is just:
Object.keys(require.cache).forEach(function(key) { delete require.cache[key] })

This patched version + using serverless-offline in allowCache mode, has allowed us to have best of both worlds.  An "official" solution should only clear the cache of the compiled files, not everything like this...
Not sure if serverless-offline has an "official" way of bundlers to manage cache...

Indeed, I put the link somewhere, but the memory leak in serverless offline is well known and affecting everyone, and the relation with the caching option is discussed around, but the accepted answer seems to be "that's how it is". So official way to fix this.
A workaround in our codebase would be a very good idea, as it is a real pain, only we should probably put it behind some options and disabled by default, and document it.

Before a more official solution is in place, this is what we ended up using:
# serverless,yml
custom:
  serverless-offline:
    allowCache: true
    # ...
  esbuild:
    plugins : ./esbuild/plugins.js
    # ....

// esbuild/plugins.js
let refreshServer = {
  name: "refresh-server",
  setup(build) {
    build.onEnd((result) => {
      // Remove all items from the cache (this will force node to reload all of the built artifacts)
      Object.keys(require.cache).forEach(function (key) {
        delete require.cache[key];
      });
    });
  },
};
module.exports = [refreshServer];

By utilising the esbuild plugin system we just did the clearing there instead of in the serverless-esbuild side. We now have a watch that can run for a long time, that gets updated whenever we change code and our memory usage remains relatively static. Would strongly recommend for anyone running into any of these memory issues or having to restart serverless whenever code changes (because of attempts to resolve the memory issues).
Hope that helps someone else...

Brilliant ! And it's much better than having inside the lib, indeed.
But it such a central pb with serverless offline we should definitely link this in the doc!

Only small problem is the esbuild plugins don't get any serverless context, I'll continue playing around with this and see if I find any issues regarding that

@mattisdada your solution seems to work for use with require, is there a equivalent solution for when using ES Modules?

In addition to ameliorating memory eating-issues, I was also having issues where hot reloading wasn't working for me, and the solution from @mattisdada also fixed that. Thank you!

@mattisdada I'm trying to implement your solution on a TypeScript project with around 8 functions, but I'm getting a weird issue, after running serverless offline, make one code change and save, the 'refreshServer' plugin runs in an infinite loop incrementing the ram usage until exhaustion.
// serverless.ts
custom: {
  'serverless-offline': {
    apiKey: API_KEY,
    allowCache: true,
  },
  esbuild: {
    bundle: true,
    minify: false,
    sourcemap: true,
    exclude: ['aws-sdk', 'pg-native'],
    target: 'node14',
    define: { 'require.resolve': undefined },
    platform: 'node',
    concurrency: 10,
    plugins: './esbuild/plugins.js',
  },
},

Any idea why this could be happening?

@mattisdada I'm trying to implement your solution on a TypeScript project with around 8 functions, but I'm getting a weird issue, after running serverless offline, make one code change and save, the 'refreshServer' plugin runs in an infinite loop incrementing the ram usage until exhaustion.
// serverless.ts
custom: {
  'serverless-offline': {
    apiKey: API_KEY,
    allowCache: true,
  },
  esbuild: {
    bundle: true,
    minify: false,
    sourcemap: true,
    exclude: ['aws-sdk', 'pg-native'],
    target: 'node14',
    define: { 'require.resolve': undefined },
    platform: 'node',
    concurrency: 10,
    plugins: './esbuild/plugins.js',
  },
},

Any idea why this could be happening?

Hmm, it's a pretty simple and dumb plugin, so I have to guess the events is being mangled somehow, none of the actions it's doing should be triggering a new esbuild build. Out of curiosity when it is removed (but nothing else has been changed) does the infinite loop still occur? I have to guess it's a file system related issue (esbuild is generating something that is then being picked up by esbuild, and repeats; or something similiar)

@mattisdada I'm trying to implement your solution on a TypeScript project with around 8 functions, but I'm getting a weird issue, after running serverless offline, make one code change and save, the 'refreshServer' plugin runs in an infinite loop incrementing the ram usage until exhaustion.
// serverless.ts
custom: {
  'serverless-offline': {
    apiKey: API_KEY,
    allowCache: true,
  },
  esbuild: {
    bundle: true,
    minify: false,
    sourcemap: true,
    exclude: ['aws-sdk', 'pg-native'],
    target: 'node14',
    define: { 'require.resolve': undefined },
    platform: 'node',
    concurrency: 10,
    plugins: './esbuild/plugins.js',
  },
},

Any idea why this could be happening?

Hmm, it's a pretty simple and dumb plugin, so I have to guess the events is being mangled somehow, none of the actions it's doing should be triggering a new esbuild build. Out of curiosity when it is removed (but nothing else has been changed) does the infinite loop still occur? I have to guess it's a file system related issue (esbuild is generating something that is then being picked up by esbuild, and repeats; or something similiar)
I'm also not sure why this was added, I can only expect it to break things 🤔 :
define: { 'require.resolve': undefined },, it will def break that plugin but it might break everything

When the plugin is removed, and after a single save the memory usage keeps incrementing, I have stopped the process when it reaches to 14 GB
I removed the line you mentioned define: { 'require.resolve': undefined },, and ran serverless offline again, made a dummy code change and saved, the ram usage keeps incrementing but somehow stabilizes between the 5-9 GB, in the meanwhile, the plugin is in the infinite loop.

@mattisdada I'm trying to implement your solution on a TypeScript project with around 8 functions, but I'm getting a weird issue, after running serverless offline, make one code change and save, the 'refreshServer' plugin runs in an infinite loop incrementing the ram usage until exhaustion.
// serverless.ts
custom: {
  'serverless-offline': {
    apiKey: API_KEY,
    allowCache: true,
  },
  esbuild: {
    bundle: true,
    minify: false,
    sourcemap: true,
    exclude: ['aws-sdk', 'pg-native'],
    target: 'node14',
    define: { 'require.resolve': undefined },
    platform: 'node',
    concurrency: 10,
    plugins: './esbuild/plugins.js',
  },
},

Any idea why this could be happening?

Hmm, it's a pretty simple and dumb plugin, so I have to guess the events is being mangled somehow, none of the actions it's doing should be triggering a new esbuild build. Out of curiosity when it is removed (but nothing else has been changed) does the infinite loop still occur? I have to guess it's a file system related issue (esbuild is generating something that is then being picked up by esbuild, and repeats; or something similiar)
I'm also not sure why this was added, I can only expect it to break things 🤔 :
define: { 'require.resolve': undefined },, it will def break that plugin but it might break everything

When the plugin is removed, and after a single save the memory usage keeps incrementing, I have stopped the process when it reaches to 14 GB or so.
I removed the line you mentioned define: { 'require.resolve': undefined },, and ran serverless offline again, made a dummy code change and saved, the ram usage keeps incrementing but somehow stabilizes between the 5-9 GB, in the meanwhile, the plugin is in the infinite loop.

I think you've got something else going wrong that's triggering the builds to re-trigger unrelated to the plugin:
Try just logging that esbuild build is being triggered:
// esbuild/plugins.js
let refreshServer = {
  name: "refresh-server",
  setup(build) {
    build.onEnd((result) => {
      if (build.initialOptions.incremental) {
        console.log(`refresh-server: Clearing Cache for ${build.initialOptions.entryPoints.join(", ")}...`);
      }
    });
  },
};
module.exports = [refreshServer];

Do you have anything that would be writing to your src directory?

@mattisdada I'm trying to implement your solution on a TypeScript project with around 8 functions, but I'm getting a weird issue, after running serverless offline, make one code change and save, the 'refreshServer' plugin runs in an infinite loop incrementing the ram usage until exhaustion.
// serverless.ts
custom: {
  'serverless-offline': {
    apiKey: API_KEY,
    allowCache: true,
  },
  esbuild: {
    bundle: true,
    minify: false,
    sourcemap: true,
    exclude: ['aws-sdk', 'pg-native'],
    target: 'node14',
    define: { 'require.resolve': undefined },
    platform: 'node',
    concurrency: 10,
    plugins: './esbuild/plugins.js',
  },
},

Any idea why this could be happening?

Hmm, it's a pretty simple and dumb plugin, so I have to guess the events is being mangled somehow, none of the actions it's doing should be triggering a new esbuild build. Out of curiosity when it is removed (but nothing else has been changed) does the infinite loop still occur? I have to guess it's a file system related issue (esbuild is generating something that is then being picked up by esbuild, and repeats; or something similiar)
I'm also not sure why this was added, I can only expect it to break things 🤔 :
define: { 'require.resolve': undefined },, it will def break that plugin but it might break everything

When the plugin is removed, and after a single save the memory usage keeps incrementing, I have stopped the process when it reaches to 14 GB or so.
I removed the line you mentioned define: { 'require.resolve': undefined },, and ran serverless offline again, made a dummy code change and saved, the ram usage keeps incrementing but somehow stabilizes between the 5-9 GB, in the meanwhile, the plugin is in the infinite loop.

I think you've got something else going wrong that's triggering the builds to re-trigger unrelated to the plugin:
Try just logging that esbuild build is being triggered:
// esbuild/plugins.js
let refreshServer = {
  name: "refresh-server",
  setup(build) {
    build.onEnd((result) => {
      if (build.initialOptions.incremental) {
        console.log(`refresh-server: Clearing Cache for ${build.initialOptions.entryPoints.join(", ")}...`);
      }
    });
  },
};
module.exports = [refreshServer];

Do you have anything that would be writing to your src directory? And what other plugins do you have installed?

I don't think there is anything writing to the src dir. We have the following plugins: serverless-esbuild, serverless-offline, serverless-openapi-documentation-v2 and serverless-hooks.
This is a small sample of the logs (the plugin is just logging):
refresh-server: Clearing Cache for src/functions/internal/status/handler.ts...
refresh-server: Clearing Cache for src/functions/merchant/handler.ts...
refresh-server: Clearing Cache for src/functions/webhooks/handler.ts...
refresh-server: Clearing Cache for src/functions/hello/handler.ts...
refresh-server: Clearing Cache for src/functions/loanRequests/handler.ts...
refresh-server: Clearing Cache for src/functions/webhooks/handler.ts...
refresh-server: Clearing Cache for src/functions/webhooks/handler.ts...
refresh-server: Clearing Cache for src/functions/internal/status/handler.ts...
refresh-server: Clearing Cache for src/functions/hello/handler.ts...
refresh-server: Clearing Cache for src/functions/hello/handler.ts...

The ram usage never stops incrementing.

The revised plugin only does logging, and does nothing else, your problem is outside the plugin. I recommend copying the project elsewhere and just keep removing things until it works as expected. (plugins, functions, config, etc)
I suspect serverless-hooks might be the problem depending on what they are configured to do, but I cannot really say without looking at the complete project sorry. But you have something going on that is triggering esbuild to run continuously. I'd also make sure that the api doc generation is outside the directory that esbuild is looking at as well.

The revised plugin only does logging, and does nothing else, your problem is outside the plugin. I recommend copying the project elsewhere and just keep removing things until it works as expected. (plugins, functions, config, etc)
I suspect serverless-hooks might be the problem depending on what they are configured to do, but I cannot really say without looking at the complete project sorry. But you have something going on that is triggering esbuild to run continuously (almost certainly something writing to disk). I'd also make sure that the api doc generation is outside the directory that esbuild is looking at as well or ignore it for compilation.
Once you've discovered the source, modify the watch pattern and ignore, example: https://github.com/floydspace/serverless-esbuild#serverless-offline

Thank very much for the guidance, I'll look into it and get back with the fix.

In my cause I had the same issue before I refactored packages import. When I have import like this:
import * as firebaseAdmin from 'firebase-admin' - memory increases exponentially on rebuild.
Once I rewrote import into following approach
import { initializeApp, getApp, getApps, cert } from 'firebase-admin/app'; - memory leaks fixed.

The revised plugin only does logging, and does nothing else, your problem is outside the plugin. I recommend copying the project elsewhere and just keep removing things until it works as expected. (plugins, functions, config, etc)
I suspect serverless-hooks might be the problem depending on what they are configured to do, but I cannot really say without looking at the complete project sorry. But you have something going on that is triggering esbuild to run continuously (almost certainly something writing to disk). I'd also make sure that the api doc generation is outside the directory that esbuild is looking at as well or ignore it for compilation.
Once you've discovered the source, modify the watch pattern and ignore, example: https://github.com/floydspace/serverless-esbuild#serverless-offline

Thank very much for the guidance, I'll look into it and get back with the fix.

@mrjavi91 - Did you ever find a fix?  I'm having the exact same issue

The revised plugin only does logging, and does nothing else, your problem is outside the plugin. I recommend copying the project elsewhere and just keep removing things until it works as expected. (plugins, functions, config, etc)
I suspect serverless-hooks might be the problem depending on what they are configured to do, but I cannot really say without looking at the complete project sorry. But you have something going on that is triggering esbuild to run continuously (almost certainly something writing to disk). I'd also make sure that the api doc generation is outside the directory that esbuild is looking at as well or ignore it for compilation.
Once you've discovered the source, modify the watch pattern and ignore, example: https://github.com/floydspace/serverless-esbuild#serverless-offline

Thank very much for the guidance, I'll look into it and get back with the fix.

@mrjavi91 Did you ever find a fix? I'm having the exact same issue

happens while trying to bundle with @aws-sdk v3

Anyone still experiencing this with Node20 or Node21? I'm using this pattern which seems to cause the memory to grow until it runs the executor out of resources. Removing the plugins does prevent the memory issue but I bump into other problems with the build regarding node internals and external dependencies.

We are also experiencing this issue on mac os with apple chips, not seeing on the intel based mac

I have this on Intel based Mac

Follow up to my post above, we found our issue to be a layer was not excluded in serverless.ts for esbuild.  Once we added it to exclude list, the issue got resolved for us.

Before a more official solution is in place, this is what we ended up using:
# serverless.yml
custom:
  serverless-offline:
    allowCache: true # Important: This will prevent serverless-offline from eating all of your memory
    # ...
  esbuild:
    plugins : ./esbuild/plugins.js
    # ....

// esbuild/plugins.js
let refreshServer = {
  name: "refresh-server",
  setup(build) {
    build.onEnd((result) => {
      if (build.initialOptions.incremental) {
        console.log(`refresh-server: Clearing Cache for ${build.initialOptions.entryPoints.join(", ")}...`);
        // Remove all items from the cache (this will force node to reload all of the built artifacts)
        Object.keys(require.cache).forEach(function (key) {
          const resolvedPath = require.resolve(key);
          if (resolvedPath.includes(build.initialOptions.outdir)) {
            delete require.cache[key];
          }
        });
      }
    });
  },
};
module.exports = [refreshServer];

By utilising the esbuild plugin system we just did the clearing there instead of in the serverless-esbuild side. We now have a watch that can run for a long time, that gets updated whenever we change code and our memory usage remains relatively static. Would strongly recommend for anyone running into any of these memory issues or having to restart serverless whenever code changes (because of attempts to resolve the memory issues).
Hope that helps someone else...

this SEEM to work for me, thank you so much <3


Radio regulatory region  (CON-504)

If I write a country code into the Location field on the Basic Info cluster will the Espressif radio code pick that up and set the correct regulatory region?  Boris just told me that's what that field is supposed to do.

The ConfigurationManagerImpl in ESP32 platform does not override the functions GenericConfigurationManagerImpl<ConfigClass>::GetCountryCode() and GenericConfigurationManagerImpl<ConfigClass>::StoreCountryCode() in generic implement, so our platform should read and store the location in the flash.

https://issuetracker.google.com/issues/283470659
Google says the Google Home app is setting this, so Espressif code needs to respect it.
They are setting it from Google Home, not the GPS commissioning library. I'm trying to get them to fix that.

@jonsmirl Raised the PR here: https://github.com/project-chip/connectedhomeip/pull/27365

There is also problem in Matter core. You should be getting this from the SetRegulatoryConfig command, not the attribute.
https://github.com/project-chip/connectedhomeip/issues/27445

Okay, I fixed the function on platform/ESP32 which sets the country code, StoreCountryCode().
Now, this functions is called in two flows: 1. Write on Location attribute and 2. Invoke on SetRegulatoryConfig command.
Where is the problem here, I do not see one, if you have more details please share.

It is a problem with the CHIP spec. There should not have been two ways to set this. What happened was Google and I picked each picked a different way to do it. Google picked SetRegulatoryConfig and I picked Location.   We each did not know about the other way to set it so we did not account for the other method.
The correct fix is for Matter core to make that Location attribute ReadOnly and add a note saying it is set via the SetRegulatoryConfig command.

@jonsmirl This is a problem with Specification right? And Implementation is in place for what is there in specification right now, so, can we close this issue which fixes setting the country in PHY layer?

I'll put up an issue in specification repo


VS 2017 crashes if there are build errors

Fresh VS2017 with VSColorOutput installation without any other extensions.
Open any project and remove any ";" at the end of any statement and press build. A few dependencies are build and when it starts building the offending project, VS freezes and moves to "Not responding". Crashes with any of the following project types I've been working on: Winform / ASP.NET / Azure stuff.
Don't know what error/debug info I can give you to help out with this issue. Do let me know.
For the last few 2 to 3 months I've been disappointed because if there is a project with any build errors, VS 2017 would freeze, not responding, and I'd have to build it in VS 2015 to find out what the problem was.
Recently I reinstalled it once again and decided to keep it without any additional extensions and it has been working great for the past 1,5 / 2 weeks. Today I remembered that I was missing this extension. I installed it and did a quick sanity check just to be sure if the extension was the culprit and it crashed following the above example.
BTW I love your extension!
Thanks for your work/help!

It has to be something unique to your environment. If VSColorOutput regularly crashed on build errors I would be skewered and BBQ'ed by irate users already. 😄

Isn't there a log somewhere? I know there's a general VS has crashed log file with xml but it's kinda big and a mess and I don't know what to look for.


About language

When I speake Chinese，it recognize and response English.

The default language is English. There are some options to change the language and most of the systems we use already support Chinese, so it should be doable. But we still haven't worked on a good way to select a language. I'll get to it, but if someone wants to work on it first, I'd be happy to assist :)

We are integrating a chinese STT, so after that the rest of the integration should be easier: https://github.com/huggingface/speech-to-speech/pull/53

Thanks for this awesome project. Based on the similar pipeline, we have released a Chinese Speech-to-Speech project named CleanS2S, supporting more interesting and streaming interactions.
Here is a snapshot of this project:

Looking forward to more advices and feedbacks!


Add ONNX export for phi models

What does this PR do?
As title says :)
Proof of concept export: https://huggingface.co/Xenova/tiny-random-PhiForCausalLM, which produces same output as python version (tested in transformers.js).

Fixes # (issue)
Before submitting

[ ] This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
[x] Did you make sure to update the documentation with your changes?
[x] Did you write any new necessary tests?

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.


Upgrade grafana

Description
This change upgrades Grafana from v9.5.5 to v10.4.0

New installation and data flow is tested
Upgrading from the current UMH version is tested and was successful. Data flow was tested and also, visualization on Grafana using our data visualization guide was successful. Our guide should be updated accordingly.

Breaking changes (they should be added into our change log)

Angular plugin turned off by default, but one can still enable it
When you upgrade to Grafana v10, Grafana will automatically migrate all API keys to service accounts and hide the API keys screen that was under the Admin section
Some data source permission endpoints are removed, so one should use another endpoint if needed
Some transformation by table visualization and transformation with time fields might break, so we should give information how to resolve it (navigate to the Grafana's change log https://grafana.com/docs/grafana/latest/breaking-changes/breaking-changes-v10-3/).

Can you write the notes that one needs to do when upgrading from an old UMH version? Can you also check if the old datasource plugins work?

Can you write the notes that one needs to do when upgrading from an old UMH version? Can you also check if the old datasource plugins work?

umh-datasource works also after upgrading. umh-datasource-v2 has a bug on the current version (0.13.6) and reported in this issue.
I created another issue for writing notes task: https://github.com/united-manufacturing-hub/MgmtIssues/issues/1816


Themes not fully compatible

The post pages generated from the .adoc files are not really compatible with the Ghost themes.
The uno theme in particular is completely broken: I only get a full screen cover image with the title, with no links to the posts (Chrome 40).
I guess this comes from using themes from Ghost that expect markdown-generated html ?
Not sure if this is really an issue for hubpress to fix, but if it could somehow be completely compatible with the Ghost themes, that would be awesome
Related: Would it be possible to have a theme that renders post just like the editor preview? It looks great !

Hi @guillaumevidal !
Not sure Uno is broken, i use in on my personal blog : http://anthonnyquerouil.fr
You have a link blog, you click on this link and the cover slide on the left.

This doesn't work for me: [http://guillaumevidal.github.io/blog/](my blog on uno.
Probably because i'm not using hubpress on my base xxx.github.io repo, maybe something to do in the conf of the theme?

:+1: but it's clearly a bug :cry:
You can edit partials/side-panel.hbs and change /blog by<EMAIL_ADDRESS>

I tried that, it doesn't seem to work...
Also, i'm not so sure that it works for you either, clicking the button shows the post list, but clicking on a post title to see it in full is a 404 for me :stuck_out_tongue:

You must relog to reload theme files.
M'y blog seems to be a dev sandbox :)
Le mer. 11 févr. 2015 16:39, Guillaume Vidal<EMAIL_ADDRESS>a
écrit :

I tried that, it doesn't seem to work...
Also, i'm not so sure that it works for you either, clicking the button
shows the post list, but clicking on a post title to see it in full is a
404 http://anthonnyquerouil.fr/2015/02/03/test-wo-CNAME.html for me [image:
:stuck_out_tongue:]
—
Reply to this email directly or view it on GitHub
https://github.com/HubPress/hubpress.io/issues/56#issuecomment-73901957.

Logged out and back in, same thing

Ok i'll have look tonight
Le mer. 11 févr. 2015 16:58, Guillaume Vidal<EMAIL_ADDRESS>a
écrit :

Logged out and back in, same thing
—
Reply to this email directly or view it on GitHub
https://github.com/HubPress/hubpress.io/issues/56#issuecomment-73905743.

Worked for me, with my demo-hubpress account :
http://demo-hubpress.github.io/blog
Can you try to clear your cache, then login ?

Figured it out, I forgot the @ and placed the handlebar inside the quotes (I know nothing about javascript. Thanks for the help!

Thanks to you,  i know there is à bug in this theme

:beers:
Thanks to you i know there is a bug in the theme

@guillaumevidal this bug is now fixed, can i close the issue?

Sure.


[BUG] pyprland getting syntax errors and doesn't start

Pyprland version
Which version did you use? (copy & paste the string returned by pypr version)
pypr version
2.2.14
Describe the bug
pypr and scratchpads aren't opening
getting syntax errors
raceback (most recent call last):
File "/usr/lib/python3.12/site-packages/pyprland/command.py", line 486, in main
asyncio.run(run_daemon() if invoke_daemon else run_client())
File "/usr/lib/python3.12/asyncio/runners.py", line 194, in run
return runner.run(main)
^^^^^^^^^^^^^^^^
File "/usr/lib/python3.12/asyncio/runners.py", line 118, in run
return self._loop.run_until_complete(task)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.12/asyncio/base_events.py", line 687, in run_until_complete
return future.result()
^^^^^^^^^^^^^^^
File "/usr/lib/python3.12/site-packages/pyprland/command.py", line 327, in run_daemon
manager.server = await asyncio.start_unix_server(manager.read_command, CONTROL)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.12/asyncio/streams.py", line 113, in start_unix_server
return await loop.create_unix_server(factory, path, **kwds)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.12/asyncio/unix_events.py", line 319, in create_unix_server
sock.bind(path)
FileNotFoundError: [Errno 2] No such file or directory
Traceback (most recent call last):
File "/usr/bin/pypr", line 8, in
sys.exit(main())
^^^^^^
File "/usr/lib/python3.12/site-packages/pyprland/command.py", line 497, in main
os.unlink(CONTROL)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/hypr/a5a648091760ac002120fab18247e5292b6482de_1714343446_1624847588/.pyprland.sock'
To Reproduce
Steps to reproduce the behavior:

Go to '...'
Click on '....'
Scroll down to '....'
See error

Expected behavior
A clear and concise description of what you expected to happen.
Configuration (provide following files/samples when relevant):

pyprland.toml
hyprland.conf

Additional context
Add any other context about the problem here.

Don't know if it's related, after updating hyprland and pyprland I get this output trying to start pyprland.
Traceback (most recent call last):
  File "/usr/lib/python3.11/site-packages/pyprland/command.py", line 482, in main
    asyncio.run(run_daemon() if invoke_daemon else run_client())
  File "/usr/lib/python3.11/asyncio/runners.py", line 190, in run
    return runner.run(main)
           ^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/asyncio/runners.py", line 118, in run
    return self._loop.run_until_complete(task)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/asyncio/base_events.py", line 654, in run_until_complete
    return future.result()
           ^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/site-packages/pyprland/command.py", line 323, in run_daemon
    manager.server = await asyncio.start_unix_server(manager.read_command, CONTROL)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/asyncio/streams.py", line 113, in start_unix_server
    return await loop.create_unix_server(factory, path, **kwds)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/asyncio/unix_events.py", line 317, in create_unix_server
    sock.bind(path)
FileNotFoundError: [Errno 2] No such file or directory
Traceback (most recent call last):
  File "/usr/bin/pypr", line 8, in <module>
    sys.exit(main())
             ^^^^^^
  File "/usr/lib/python3.11/site-packages/pyprland/command.py", line 493, in main
    os.unlink(CONTROL)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/hypr/33e0bb14786dc22a0c82eaaf097b469d3fdeceea_1714376788_9614021/.pyprland.sock'

pyprland 2.2.14-10
hyprland 0.39.1.r100.33e0bb14-1
Let me know if some log or more informations are needed

yes,the socket thing    also effects waybar which has a workaround https://github.com/Alexays/Waybar/issues/3179 which i have verified but still needs to be fixed

This seems to relate to #95 - you have a "git version" of Hyprland ?

Yes sorry, I was not so updated on stuff going on.
I tested the PR you mentioned and all is working fine.

Closing after pushing some code to git that should address this issue.


[Component Implementation: Layout] Divider

Description
Helper layout component used to render a divider between components.
Implementation checklist

[ ] The component was tested and is fully working in web environments, without any observable bugs and/or unexpected behavior.
[ ] The component was tested and is fully working in native environments, without any observable bugs and/or unexpected behavior.
[ ] The component API is fully documented in both the internal Storybook documentation and in-code.

@ernestoresende Divider ou Spacer?

@tryvin Divider mesmo. Equivalente a um elemento <hr> da web. O componente Spacer está no #47


AWS explorer doesn't reflect the refreshed security token credentials via AWSCLI until I close and re-open the VS

Refreshed security token credentials via AWSCLI will not reflect in visual studio until I close and re-open the visual studio.

security credentials are expired

refresh the security credentials from AWS cli command prompt
open AWS Explorer in VS2022
ERROR: The Security Token included in the request is Expired.
close and re-open the VS and then navigate to AWS Explorer
now it is able to retrieve the information of my account.....

Hi, thank you for bringing this issue to our attention.  Please provide details for this profile from your ~/.aws/config file (redact any confidential information if needed) and any pertinent messages in the toolkit logs.  To access the toolkit logs, click Extensions / AWS Toolkit / View Toolkit Logs.  If the issue just occurred, you will typically find it towards the end of the last log (filenames are timestamped) in the logs folder.

as toolkit logs are having lot of confidential information traces hence cannot provide them
here is the config file:

Can you also redact and post the contents of the ~/.aws/credentials file that are pertinent to the profile in question?  The posted contents of the config file alone are insufficient to be used as a credential.  It's unclear how you have your credential that isn't working properly defined.

here is the /credentials file details

but I would request to read the steps mentioned above again...
all the aws stuffs seems fine
I'm guessing Visual Studio is caching the creds hence it is not able to load the new refreshed creds after previous creds expiry until I close and re-open Visual Studio...

Hello @AshokAndani, a couple questions:

Can you confirm if you are using the latest version of the toolkit <IP_ADDRESS>?
 Does switching between credentials selected lead to the same failed connection state?


Send a pty resize on client connection

When a client connects, send a resize of the terminal.
This will cause interactive applications to re-render for the correct terminal size.

Resolved by #142
Also, the Terminal Cursor state is reset.  It is shown, and blinking is disabled


Distribution packaging document is missing the workloads details

Issue description
https://docs.microsoft.com/en-us/dotnet/core/distribution-packaging needs to be updated for Optional Workloads. At a minimum, the sdk-manifests folder needs to be added as that's included with a default SDk install.
Additionally, workloads will create a library-packs folder, a metadata folder, and a template-packs folder which might be worth documenting if a customer wants to install a workload and distribute the SDK with the workload included.
Is there a point at which we would remove things like NuGetFallbackFolder which is a <3.0 feature so only for out of support SDKs?
net6.0+

[x] .NET Core
[ ] .NET Framework
[ ] .NET Standard

@tdykstra @dsplaisted for visibility.


HDFS-17405. [FGL] Using different metric name to trace performance for FGL and Global lock

HDFS-17405. [FGL] Using different metric name to trace performance for FGL and Global lock

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
7m 16s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  0s

detect-secrets was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 1 new or modified test files.

_ HDFS-17384 Compile Tests _

+1 :green_heart:
mvninstall
33m  4s

HDFS-17384 passed

+1 :green_heart:
compile
0m 44s

HDFS-17384 passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1

+1 :green_heart:
compile
0m 43s

HDFS-17384 passed with JDK Private Build-1.8.0_392-8u392-ga-1~20.04-b08

+1 :green_heart:
checkstyle
0m 38s

HDFS-17384 passed

+1 :green_heart:
mvnsite
0m 44s

HDFS-17384 passed

+1 :green_heart:
javadoc
0m 43s

HDFS-17384 passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1

+1 :green_heart:
javadoc
1m  8s

HDFS-17384 passed with JDK Private Build-1.8.0_392-8u392-ga-1~20.04-b08

+1 :green_heart:
spotbugs
1m 48s

HDFS-17384 passed

+1 :green_heart:
shadedclient
20m 31s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
0m 37s

the patch passed

+1 :green_heart:
compile
0m 36s

the patch passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1

+1 :green_heart:
javac
0m 36s

the patch passed

+1 :green_heart:
compile
0m 32s

the patch passed with JDK Private Build-1.8.0_392-8u392-ga-1~20.04-b08

+1 :green_heart:
javac
0m 32s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

+1 :green_heart:
checkstyle
0m 30s

the patch passed

+1 :green_heart:
mvnsite
0m 38s

the patch passed

+1 :green_heart:
javadoc
0m 31s

the patch passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1

+1 :green_heart:
javadoc
1m  2s

the patch passed with JDK Private Build-1.8.0_392-8u392-ga-1~20.04-b08

+1 :green_heart:
spotbugs
1m 42s

the patch passed

+1 :green_heart:
shadedclient
20m 22s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

-1 :x:
unit
199m 35s
/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
hadoop-hdfs in the patch passed.

+1 :green_heart:
asflicense
0m 31s

The patch does not generate ASF License warnings.

295m 15s

Reason
Tests

Failed junit tests
hadoop.hdfs.protocol.TestBlockListAsLongs

hadoop.hdfs.tools.TestDFSAdmin

hadoop.hdfs.server.datanode.TestLargeBlockReport

Subsystem
Report/Notes

Docker
ClientAPI=1.44 ServerAPI=1.44 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6600/2/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/6600

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets

uname
Linux fda160309c15 5.15.0-94-generic #104-Ubuntu SMP Tue Jan 9 15:25:40 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
HDFS-17384 / 1c72a0e6530880d2ac5871e4e1c33f0987830f42

Default Java
Private Build-1.8.0_392-8u392-ga-1~20.04-b08

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_392-8u392-ga-1~20.04-b08

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6600/2/testReport/

Max. process+thread count
4448 (vs. ulimit of 5500)

modules
C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6600/2/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

Thanks for the patch. Merged.


fix(behavior_velocity): visualization and interpolation

Related Issue(required)
Description(required)

fix last point of angle at spline interpolation at below modules (bug fix)
added marker to confirm this fix

intersection
blindspot
occlusion spot
no stopping area

fix duplicated polygon of sidewalk slice(just visualization problem)

Review Procedure(required)
launch Psim
and see debug markers using  Map in Private Area tag
Related PR(optional)
autoware_launch
Pre-Review Checklist for the PR Author
PR Author should check the checkboxes below when creating the PR.

[x] Read commit-guidelines
[x] Assign PR to reviewer

If you are adding new package following items are required:

[ ] Documentation with description of the package is available
[ ] A sample launch file and parameter file are available if the package contains executable nodes

Checklist for the PR Reviewer
Reviewers should check the checkboxes below before approval.

[ ] Commits are properly organized and messages are according to the guideline
[ ] PR title describes the changes

Post-Review Checklist for the PR Author
PR Author should check the checkboxes below before merging.

[ ] All open points are addressed and tracked via issues or tickets

CI Checks

Build and test for PR / build-and-test-pr: Required to pass before the merge.
Build and test for PR / clang-tidy-pr: NOT required to pass before the merge. It is up to the reviewer(s). Found false positives? See the [guidelines][clang-tidy-guidelines].
Check spelling: NOT required to pass before the merge. It is up to the reviewer(s). See here if you want to add some words to the spell check dictionary.

@yukkysaito
Sorry, I merged this PR by mistake by auto-merge setting before your check.


Rails/Blank cop: undefined method `type' for nil:NilClass

The following file crashes rubocop with enabled Rails linters:
class Something
  def meth
    something || blub
  end
end

rubocop -R bla.rb

An error occurred while Rails/Blank cop was inspecting /Users/markus/svn/bla.rb:3:4.
undefined method `type' for nil:NilClass
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/lib/rubocop/cop/rails/blank.rb:45:in `nil_or_empty?'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/lib/rubocop/cop/rails/blank.rb:79:in `on_or'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/lib/rubocop/cop/commissioner.rb:43:in `block (2 levels) in on_or'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/lib/rubocop/cop/commissioner.rb:106:in `with_cop_error_handling'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/lib/rubocop/cop/commissioner.rb:42:in `block in on_or'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/lib/rubocop/cop/commissioner.rb:41:in `each'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/lib/rubocop/cop/commissioner.rb:41:in `on_or'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/lib/rubocop/ast/traversal.rb:95:in `on_def'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/lib/rubocop/cop/commissioner.rb:47:in `on_def'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/lib/rubocop/ast/traversal.rb:88:in `on_class'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/lib/rubocop/cop/commissioner.rb:47:in `on_class'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/lib/rubocop/ast/traversal.rb:12:in `walk'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/lib/rubocop/cop/commissioner.rb:60:in `investigate'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/lib/rubocop/cop/team.rb:124:in `investigate'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/lib/rubocop/cop/team.rb:112:in `offenses'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/lib/rubocop/cop/team.rb:54:in `inspect_file'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/lib/rubocop/runner.rb:248:in `inspect_file'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/lib/rubocop/runner.rb:195:in `block in do_inspection_loop'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/lib/rubocop/runner.rb:227:in `block in iterate_until_no_changes'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/lib/rubocop/runner.rb:220:in `loop'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/lib/rubocop/runner.rb:220:in `iterate_until_no_changes'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/lib/rubocop/runner.rb:191:in `do_inspection_loop'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/lib/rubocop/runner.rb:101:in `block in file_offenses'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/lib/rubocop/runner.rb:111:in `file_offense_cache'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/lib/rubocop/runner.rb:99:in `file_offenses'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/lib/rubocop/runner.rb:90:in `process_file'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/lib/rubocop/runner.rb:68:in `block in each_inspected_file'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/lib/rubocop/runner.rb:65:in `each'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/lib/rubocop/runner.rb:65:in `reduce'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/lib/rubocop/runner.rb:65:in `each_inspected_file'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/lib/rubocop/runner.rb:57:in `inspect_files'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/lib/rubocop/runner.rb:36:in `run'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/lib/rubocop/cli.rb:72:in `execute_runner'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/lib/rubocop/cli.rb:27:in `run'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/bin/rubocop:13:in `block in <top (required)>'
/usr/local/Cellar/ruby/2.4.0/lib/ruby/2.4.0/benchmark.rb:308:in `realtime'
/usr/local/lib/ruby/gems/2.4.0/gems/rubocop-0.48.0/bin/rubocop:12:in `<top (required)>'
/usr/local/bin/rubocop:22:in `load'
/usr/local/bin/rubocop:22:in `<main>'

RuboCop version
0.48.0 (using Parser <IP_ADDRESS>, running on ruby 2.4.0 x86_64-darwin16)

@Drenmi Same error occurs on this code after your commits.
class Something
  def meth
    something || !blub
  end
end


request for new release

Hi, @mattn
I want to use the serialize/deserialize feature https://github.com/mattn/go-sqlite3/pull/1089 , which is not included in the latest release. Any plan to publish a new release?

I want to use the inbuilt json support of sqlite as well.

@mattn what do you think? I am not familiar with the release process.

Closing because the feature in question was included in v1.14.17.


Table columns should be represented everywhere by "DisplayName", not "name"

Affected module
UI
Describe the bug
On the tables page, in the "Profile & Data Quality" tab in the "Column Profiler" section, "name", and not "DisplayName" are given in the table with the profile as the name for the columns. It would be more convenient if "DisplayName" were specified as the name, as well as on the "Schema" tab.

Also, the search bar for the filter of the desired column searches by "name", not "DisplayName". Since the display name is "DisplayName", then the search must be performed on it.
This is true for the search bar on the "Schema" tab, but taking into account the correction of the problem described above, this will also be true for the line in the "Column Profiler" section on the "Profiler & Data Quality" tab.

Version:

OpenMetadata version: 1.1.7

the issue is already fixed in PR #14542


execution engine: condense and extend expression variable detection

expressions containing multiple items with subscripts or nested
subscripts previously failed during sympy.simplify

Looks good @kmantel. Is there any example included here that uses this form for variables? I assume it's something like:
a = 1
b = 2
c = [a, b]

test_inception https://github.com/ModECI/MDF/blob/a264aabf7ac4808215f35eff0c6d7944ea555f48/tests/interfaces/pytorch/test_import.py#L54
does use these, but otherwise I'm not aware of any current examples in this repo that use it. I have a drift diffusion example almost ready in psyneulink pending another change in this repo, and that could be added to our examples.


Ug update

Codecov Report

Merging #177 (8b40b53) into master (6b6924b) will not change coverage.
The diff coverage is n/a.

@@            Coverage Diff            @@
##             master     #177   +/-   ##
=========================================
  Coverage     72.60%   72.60%
  Complexity      806      806
=========================================
  Files           121      121
  Lines          2610     2610
  Branches        371      371
=========================================
  Hits           1895     1895
  Misses          581      581
  Partials        134      134

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 6b6924b...8b40b53. Read the comment docs.


Directory up should be on the top

If you jump inside a directory with a lot of files by accident, going back can only be achieved by scrolling completely to the bottom. Workaround at the moment: turn on menu wrap

Ok, I had it that way in the past, but I can't remember why I changed it. I'll make it first again.

Any idea for a better symbol,  or is ^ ok?

I changed the symbols to < and >. Seems to make more sense to me.
Back up folder is now sorted to the beginning of the list.

Great stuff!
—
Dirk
www.essl.de | www.lenstagger.com | www.caffenol.org

On 23. Dec 2020, at 22:10, MartinNohr<EMAIL_ADDRESS>wrote:

I changed the symbols to < and >. Seems to make more sense to me.
Back up folder is now sorted to the beginning of the list.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or unsubscribe.

Thanks to your comments this thing is getting better and better. I'm very happy to have others involved in improving it. :-)


[Getting Started with Sass] update doc pages Email Sass for Node.js version

https://get.foundation/emails/docs/sass-guide.html#installing
while following the docs the steps outline how to install foundation emails using npm.
there is no mention of required versions of Node.js however after install i receive error when trying to create new project
I expected that a new project would be created in the folder the command was executed.
the following is the error:
usr-MacBook-Pro-:ui usr$ foundation new --framework email
fs.js:35
} = primordials;
    ^

ReferenceError: primordials is not defined
    at fs.js:35:5
    at req_ (/usr/local/lib/node_modules/foundation-cli/node_modules/natives/index.js:143:24)
    at Object.req [as require] (/usr/local/lib/node_modules/foundation-cli/node_modules/natives/index.js:55:10)
    at Object.<anonymous> (/usr/local/lib/node_modules/foundation-cli/node_modules/graceful-fs/fs.js:1:37)
    at Module._compile (internal/modules/cjs/loader.js:1138:30)
    at Object.Module._extensions..js (internal/modules/cjs/loader.js:1158:10)
    at Module.load (internal/modules/cjs/loader.js:986:32)
    at Function.Module._load (internal/modules/cjs/loader.js:879:14)
    at Module.require (internal/modules/cjs/loader.js:1026:19)
    at require (internal/modules/cjs/helpers.js:72:18)

Running Node.js v12.18.0.
as per stack exchange:
https://stackoverflow.com/questions/56245622/foundation-referenceerror-primordials-is-not-defined-when-starting-a-foundat
NodeJS 12 is not supported by the current CLI. Please use NodeJS 10.
The docs should be updated to indicate the version of Node.js that is supported. Make it easier for people to get started 💯

opened incorrect place

ReferenceError: primordials is not defined

This is a known issue with gulp and too new Node versions. It should work on Node 10.

ReferenceError: primordials is not defined

This is a known issue with gulp and too new Node versions. It should work on Node 10.

This isn't really a fix for the issue though. We won't bump down to Node 10 just because Foundation can't handle the current LTS. Yous can't expect ppl to downgrade? Perhaps it's time to move from Gulp v3 to v4?

Perhaps it's time to move from Gulp v3 to v4?

Correct. But gulp 4 has some breaking changes.
You can use different Node versions with nvm, nodenv or n.


Suspicious Spike in Star Count

Hey,
Just wanted to point out something odd I've noticed. Your project has suddenly gotten a huge number of new stars, but a lot of them seem to be from fake or bot accounts with junk content. This looks like artificial star boosting, which isn't really fair play.
Stuff like this skews the perception of genuine interest and kinda undermines the trust in our community. As a fellow researcher and long-time GitHub user, it's pretty disappointing to see this happening. It's a bummer when tactics like these are used, makes it tough for everyone working hard on their projects.
I've reported this to GitHub support and the community for review. Hope you can address this and keep things legit.
Cheers,

Hi there,
First of all, we are surprised to hear those information from you. Recently, we do notice there are some stars increased, but we did not notice that those stars are suspicious person.
Plus, could you point out which stars are the stars you mentioned.
We are positive to work with you to figure it out what’s happening here. We do want to collaborate with you guys to avoid unfair stuff in our community.
Also, we are happy to jump in call with you guys for this explanation.
Regards,
Sam Chen
Alimail------------------------------------------------------------------
@.>
Date:2024/10/11 14:43:08
@.>
@.***>
Theme:[OpenCSGs/csghub] Suspicious Spike in Star Count (Issue #709)
Hey,
Just wanted to point out something odd I've noticed. Your project has suddenly gotten a huge number of new stars, but a lot of them seem to be from fake or bot accounts with junk content. This looks like artificial star boosting, which isn't really fair play.
Stuff like this skews the perception of genuine interest and kinda undermines the trust in our community. As a fellow researcher and long-time GitHub user, it's pretty disappointing to see this happening. It's a bummer when tactics like these are used, makes it tough for everyone working hard on their projects.
I've reported this to GitHub support and the community for review. Hope you can address this and keep things legit.
Cheers,
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you are subscribed to this thread.Message ID: @.***>


Make metrics config more flexible

Let's divide all metrics to groups(classes) and make it possible to select which metrics turned on. Also if no any settings was set simply turn on default metrics groups(classes). Groups could be configurable with set_export() or Cartridge Role config.
Reason: each metric occupy some space in Prometheus or InfluxDB and for example not every application uses http, in that case don't need to collect tnt_http_* metrics.

Btw, if you don't use HTTP metrics in your app (i.e. do not set any HTTP middleware on any endpoints) there isn't any http_ metrics in Tarantool default metrics.


Switch statement

A switch statement can be used to improve readability and/or to avoid repetition:
...
choose "$position mod 2" {
	when "'0'" {
		println "' (even)'"
	}
	when "'1'" {
		println "' (odd)'"
	}
}

In a switch, string evaluations of the expressions following choose and when are compared, rather than the Boolean values.

Not a bad idea, but maybe actually call it switch (or even case) to prevent mistaking it for a regular choose:

switch "$position mod 2" {
	when "'0'" {
		println "' (even)'"
	}
	when "'1'" {
		println "' (odd)'"
	}
}

Will put this on wait, because one can avoid repeating repetition using a variable, like so:
variable "mod" { select "$position mod 2" }
choose  {
when "'$mod = 0'" {
println "' (even)'"
}
when "'mod = 1'" {
println "' (odd)'"
}
}


[cache-then-network] For first minute or so of being disconnected, network requests still appear to succeed

Reported by @wfwalker via the #apps IRC channel.
This occurs in Chrome and Firefox.
Some extra logging shows that the responses are status 200 even though there is no network connection present.

Filed a bugzilla bug at https://bugzilla.mozilla.org/show_bug.cgi?id=1216373
It turns out that the caching options for the Fetch API are not yet implemented in Firefox or Chrome so we need to use a cache busting url param.


Security scan and fix vulnerabilities if any

CVE-2022-4065

Basic acceptance and automation smoke performed, fixed


🐛  (menu)-fix bug on theme not getting applied to submenu

#203
Status :
Ready

Description :

Fix issue on theme where styles are not applied to submenus.

Related Issues :
#203
Todos

[ ] Tests
[x] Documentation

Failed tests are fixed in #200 commit 7129ef9


Async load Sentry script

I mostly wanted to get your thoughts around this.
I know Sentry recommends not loading their library async, but oftentimes their CDN is super slow and slows down our pages.
Would you be opposed to something like this? What if it were behind a config flag defaulted to false?

Hi @briangonzalez,
At the time being, I think this may lead to weird behaviors.
If the CDN takes more time to respond than the Ember application boot, the application won't find Raven, only considering one thing: there is no spoon raven library available.
There is no mechanism to wait for an async library load in thi ember-cli add-on, and I do not plan on adding one since it only concerns users loading from the ravenjs CDN.
I think relying on your own CDN or bundling ravenjs with the application using bower_components (this is the default add-on behavior) are acceptable workarounds.
Are there any blockers on your side?


Device not appearing in Home app

I've installed the plugin for use with a WB-250-IPW-2 and believe I've set it up correctly, as I receive the following log output in Homebridge admin:
[1/2/2023, 8:39:49 PM] [WattBox IP] Initializing WattBox IP platform...
[1/2/2023, 8:39:49 PM] [WattBox IP] [WattBox] Loading accessory from cache…
[1/2/2023, 8:39:51 PM] [WattBox IP] [WattBox] [ 1] Creating outlet with name "Outlet 1"
[1/2/2023, 8:39:51 PM] [WattBox IP] [WattBox] [ 2] Creating outlet with name "Outlet 2"

The outlets appear in the Accessories tab in Homebridge admin and are controllable there, however they do not appear in the Apple Home app on my phone. Is there something else that needs to be done to surface them in the app?

Never mind, the device needed a firmware update, after the update it's working perfectly.


The property 'AvailableTeams' cannot be found on this object.

I copied the PowerCommander folder to Modules folder for all users.  When I try to sign in, I get the below error.
The property 'AvailableTeams' cannot be found on this object. Verify that the property exists and can be
set.
At C:\Program Files\WindowsPowerShell\Modules\PowerCommander\AuthCommands.ps1:483 char:5
+     $Script:Context.AvailableTeams = $null
+     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : InvalidOperation: (:) [], RuntimeException
    + FullyQualifiedErrorId : PropertyNotFound

That is exactly what I am doing.  Windows 10.  PowerShell 5.1.19041.2364

Any update?  This module isn't working for me at all even on fresh installation.

It looks like PowerCommander folder is not loaded as a module. Module initialization code was not called.
To list installed modules:
https://learn.microsoft.com/en-us/powershell/module/powershellget/get-installedmodule?view=powershell-5.1
To import module
https://learn.microsoft.com/en-us/powershell/module/Microsoft.PowerShell.Core/Import-Module?view=powershell-5.1

Now that the module is published in the PSGallery installation should be much simpler.
A simple Install-Module PowerCommander (or Install-Module PowerCommander -AllowClobber) should suffice.


Create checklist for all IBP species-specific ontologies to be merged into multi-species merged ontology

Format: TD5-TSV
All IBP-traits should have a TSV as well as .xls
My script only takes .tsv in TD5 layout.
Any xls to be included in the merged TO must have the tsv. Later we can explore an automated job to convert but for now should be manual
Note: when saving from excel, must use the correct line delimiters
fixes in place:
perl -pie 's@\15@\n@g' FILENAME
suffix must be .tsv
TD5 file must have mapping to TO IDs
(SEE NEXT CHECK - this may not be necessary)
TBD: which column is this?
in lentil it is col9, called TO_ref
in lentil it is col16, and called "Trait Xref"
What is the format? Are we using '(u)'?
Ontology file must be included
This will be a deterministic translation of the TD5 file
Note: it seems in some cases an xref is included, which obviates the need for the previous check?
However, xref does not distinguish between exact and subclass
Ideally the ontology would be in OWL with the correct logical axiom, avoiding the need for a bridge file
The ontology MUST be parseable by the canonical parser for that format (obo or owl)
Each ontology should have a travis job
This should check each commit to make sure the resulting files are still parseable
Each ontology should have a PURL
This can be within the to PURL space, e.g. /to/ext/ibp-lentil-traits/lentil.owl

Note: when saving from excel, must use the correct line delimiters
fixes in place:
perl -pie 's@\15@\n@g' FILENAME

suffix must be .tsv

There are three things in the CO
Trait
Method
Variable
We can map to TO via their Trait, but method and variable connects to their trait. Shall we define the relationships we propose to create a tree
TO
--isa--CO_trait
----isa_method_of--CO_method
-----isa_variable_of_method--CO_variable
Since adding CO from multiple species would create redundancy, we suggested appending a prefix 'species common name' to each of the following
CO_trait
CO_method
CO_variable

On Tue, Jan 5, 2016 at 1:50 PM, Common Reference Ontologies for Plants <
<EMAIL_ADDRESS>wrote:

There are three things in the CO
Trait
Method
Variable
We can map to TO via their Trait, but method and variable connects to
their trait. Shall we define the relationships we propose to create a tree
TO
--isa--CO_trait
----isa_method_of--CO_method
-----isa_variable_of_method--CO_variable

Can you provide specific examples for each of these three is_a relations?
BS

Since adding CO from multiple species would create redundancy, we
suggested appending a prefix 'species common name' to each of the following
CO_trait
CO_method
CO_variable
—
Reply to this email directly or view it on GitHub
https://github.com/Planteome/plant-trait-ontology/issues/374#issuecomment-169094847
.

Current status:

Rice is blocked by a syntax error, but I have made a fix https://github.com/Planteome/ibp-rice-traits/pull/4
Cassava is blocked on: https://github.com/Planteome/ibp-cassava-traits/issues/3
Lentil is OK
We still need to normalize practice across the ontologies to make this scalable

Barry, can you open a new ticket for this, in one of the IBP repositories? is-a may be problematic here but it's not really relevant to this ticket

In fact the actual relationships used are method-of and scale-of; this was all discussed at the meeting and I think is fine for now

we are using 3 relationships:
method_of: domain: method ; range: trait
scale_of: domain: scale ; range: method
variable_of: domain: variable ; range: trait or method or scale (note that for each variable, you will find a link to a trait, a method and a scale using the property variable_of)

On Tue, Jan 5, 2016 at 2:16 PM, Marie-Angélique<EMAIL_ADDRESS>wrote:

we are using 3 relationships:
method_of: domain: method ; range: trait
scale_of: domain: scale ; range: method
variable_of: domain: variable ; range: trait or method or scale (note that
for each variable, you will find a link to a trait, a method and a scale
using the property variable_of)

I think I understand the above more or less. What I would like to see is
specific examples of how these relations are used in order to check
whether my understanding is correct. (Remember one role of the ontology
work is to provide a doorway into your data for outsiders who do not have
your initimate knowledge of what you are doing.)
BS
Reply to this email directly or view it on GitHub
https://github.com/Planteome/plant-trait-ontology/issues/374#issuecomment-169101750
.

Barry
TO: leaf weight
CO_Trait: leaf weight
--CO_method: dry weight of leaf
----CO_variable: scale-1 --> if the weight is 1-3g
----CO_variable: scale-2--> if the weight is 4-6g
----CO_variable: scale-3--> if the weight is 7-10g
----CO_variable: scale-4--> if the weight is 10-12g
----CO_variable: scale-5--> if the weight is 12-15g
I was thinking that we have an option to limit the mapping to
TO <--> CO_trait
but in the interest of buy in from the community we may have to bring in all the associated methods and their scorable variables of phenotypes.
When the CO terms from lentils are merged to TO it may look like this. That's why we need to define the relationship_types. Following  example of relationship types is meant to start the discussion. They can be renamed. But we need it fast to show at the PAG meeting.
TO: leaf weight
--isa--CO_Trait: leaf weight
-----isa_method_of-- CO_method: dry weight of leaf
-------isa_variable_of_method- CO_variable: scale-1 --> if the weight is 1-3g
-------isa_variable_of_method- CO_variable: scale-2--> if the weight is 4-6g
-------isa_variable_of_method- CO_variable: scale-3--> if the weight is 7-10g
-------isa_variable_of_method- CO_variable: scale-4--> if the weight is 10-12g
-------isa_variable_of_method- CO_variable: scale-5--> if the weight is 12-15g

I forgot each of the CO imports would have species name (common name) as prefix to avoid conflicts.

Modifications to requirements coming out of meeting:
we don't want the CO groupings in the merged file. The obo/owl generation script should take the TD5 file plus the separate mapping file (these can be combined into one for TD6) and make a bridge file similar to the one @marieALaporte just created for cassava, but lacking groupings.
For now, planteome-new brings in the version of cassava and lentil that includes the groupings, this is what we will load for the demo

that's fine
-pankaj
On 1/5/2016 11:03 AM, Chris Mungall wrote:

In fact the actual relationships used are method-of and scale-of; this
was all discussed at the meeting and I think is fine for now
—
Reply to this email directly or view it on GitHub
https://github.com/Planteome/plant-trait-ontology/issues/374#issuecomment-169098683.


Smarty lexer issue

(Original issue 1039 created by None on 2014-10-06T05:31:57.070566+00:00)
The Smarty template lexer doesn't recognize nested braces:
#!smarty

{templateFunction param={anotherFunction} param2=$something}

is valid syntax, but anything beyond the first (inner) closing brace will escape from Smarty. So the Smarty lexer should duplicate the code for entering Smarty state within this state.

(Original issue 1039 last updated on 2014-10-07T03:13:58.083214+00:00)
(Issue automaticaly closed due to status in Bitbucket: resolved)

(Original comment by tshatch on 2014-10-07T03:13:58.079677+00:00)
SmartyLexer: Support nested curly braces.
Fixes #1039
→ <<cset 0101e6d60d1b>>


[YouTube] Unable to download alive and playable video - HTTP Error 404: Not Found

Checklist

[x] I'm reporting a broken site support
[x] I've verified that I'm running youtube-dl version 2020.11.26
[x] I've checked that all provided URLs are alive and playable in a browser
[x] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[x] I've searched the bugtracker for similar issues including closed ones

Verbose log

C:\Users\user>youtube-dl --verbose https://www.youtube.com/watch?v=SmGUAoJ-XAM
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--verbose', 'https://www.youtube.com/watch?v=SmGUAoJ-XAM']
[debug] Encodings: locale cp1252, fs mbcs, out cp437, pref cp1252
[debug] youtube-dl version 2020.11.26
[debug] Python version 3.4.4 (CPython) - Windows-10-10.0.19041
[debug] exe versions: ffmpeg 2020-11-25-git-3de3d2f5e2, ffprobe 2020-11-25-git-3de3d2f5e2
[debug] Proxy map: {}
[youtube] SmGUAoJ-XAM: Downloading webpage
[youtube] SmGUAoJ-XAM: Downloading MPD manifest
[debug] Default format spec: bestvideo+bestaudio/best
WARNING: Requested formats are incompatible for merge and will be merged into mkv.
[debug] Invoking downloader on 'https://r4---sn-uxaxovg-vnae7.googlevideo.com/videoplayback?expire=1606378874&ei=GhG_X6SwKsG67ATtrqpQ&ip=<IP_ADDRESS>&id=o-AAOslEIR_zmYmIJ_QiZZSIjxoSp6_uIusTE4xGbl0iS1&itag=248&aitags=133%2C134%2C135%2C136%2C137%2C160%2C242%2C243%2C244%2C247%2C248%2C278&source=yt_otf&requiressl=yes&mh=8P&mm=31%2C29&mn=sn-uxaxovg-vnae7%2Csn-5goeen7d&ms=au%2Crdu&mv=m&mvi=4&pcm2cms=yes&pl=16&initcwndbps=1648750&vprv=1&mime=video%2Fwebm&ns=aHZenQVnnOxMxcHgFvsXy-gF&otf=1&otfp=1&dur=879.111&lmt=1489552536986074&mt=1606357005&fvip=4&keepalive=yes&c=WEB&n=zWvngvvEmFe3JNo8q2Z&sparams=expire%2Cei%2Cip%2Cid%2Caitags%2Csource%2Crequiressl%2Cvprv%2Cmime%2Cns%2Cotf%2Cotfp%2Cdur%2Clmt&sig=AOq0QJ8wRQIhAJkxXYJeuyFESEzx_styYCUa_cMFJjzoXTYu88mON8wJAiBisZwIBf6AioXZZPe1C3c7ASdlqOhOottHSFtCbHdzIg%3D%3D&lsparams=mh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpcm2cms%2Cpl%2Cinitcwndbps&lsig=AG3C_xAwRgIhAOUAMIpTNHoqGlLxBXUOf85Vpl5I4RZ8C1J_-YJjZzovAiEA85sfCHmvhS7H-tOm8wHQX5_Oc2crN46WbrkrPd9juWI%3D&ratebypass=yes'
ERROR: unable to download video data: HTTP Error 404: Not Found
Traceback (most recent call last):
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmp8xa81xl2\build\youtube_dl\YoutubeDL.py", line 1930, in process_info
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmp8xa81xl2\build\youtube_dl\YoutubeDL.py", line 1875, in dl
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmp8xa81xl2\build\youtube_dl\downloader\common.py", line 366, in download
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmp8xa81xl2\build\youtube_dl\downloader\http.py", line 351, in real_download
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmp8xa81xl2\build\youtube_dl\downloader\http.py", line 116, in establish_connection
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmp8xa81xl2\build\youtube_dl\downloader\http.py", line 110, in establish_connection
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmp8xa81xl2\build\youtube_dl\YoutubeDL.py", line 2248, in urlopen
  File "C:\Python\Python34\lib\urllib\request.py", line 470, in open
  File "C:\Python\Python34\lib\urllib\request.py", line 580, in http_response
  File "C:\Python\Python34\lib\urllib\request.py", line 508, in error
  File "C:\Python\Python34\lib\urllib\request.py", line 442, in _call_chain
  File "C:\Python\Python34\lib\urllib\request.py", line 588, in http_error_default
urllib.error.HTTPError: HTTP Error 404: Not Found

C:\Users\user>

Description

Video is alive and playable on the browser but youtube-dl gives: ERROR: unable to download video data: HTTP Error 404: Not Found
Here is the video

try youtube-dl https://www.youtube.com/watch?v=SmGUAoJ-XAM -f 22

try youtube-dl https://www.youtube.com/watch?v=SmGUAoJ-XAM -f 22

Works, but only 720p not sure why?
How can i proceed with this if i want to download a channel? (i always go for the default quality which is best+best)

try youtube-dl https://www.youtube.com/watch?v=SmGUAoJ-XAM -f 22

Works, but only 720p not sure why?
How can i proceed with this if i want to download a channel? (i always go for the default quality which is best+best)

you can you youtube-dl https://www.youtube.com/watch?v=SmGUAoJ-XAM  -F
to see available formats for the video

But i'm downloading the whole channel

webm formats for this video are not available at Youtube side.

@dstftw is it possibe to skip to the next best format? when downloading a channel this causes the download to stop if, you use --skip-errors the video will not be downloaded.

try youtube-dl https://www.youtube.com/watch?v=SmGUAoJ-XAM -f 22

Works, but only 720p not sure why?
How can i proceed with this if i want to download a channel? (i always go for the default quality which is best+best)

you can you youtube-dl https://www.youtube.com/watch?v=SmGUAoJ-XAM -F to see available formats for the video

after the -F option, could change another format, it may be works!