add shellcheck workflow

Description
closes #1143

Screenshots

Additional Context

Checklist
Are your changes backwards compatible? Please answer below:

Did you QA this? Could we deploy this straight to production? Please answer below:

For frontend changes: Tested on mobile? Please answer below:

Did you introduce any new environment variables? If so, call them out explicitly here:

Nice!
got a question about how we can fix the shellcheck failures
./sndev:42:16: note: Double quote to prevent globbing and word splitting. [SC2086]
./sndev:53:16: note: Double quote to prevent globbing and word splitting. [SC2086]
./sndev:64:16: note: Double quote to prevent globbing and word splitting. [SC2086]

for these three they are all pointing to this repeated code block
  t=$1
  if [ "$t" = "-t" ]; then
    shift
  else
    t=""
  fi

but i can't immediately see where there isn't a double quote

Yeah I also got caught by this when I tried to do a test fix. Can ./sndev pass all the tests after the fixes?

Go ahead and push up the changes recommended by the tests and we'll see!

I think we want to ignore shellcheck warnings, ie this workflow should only "fail" when shellcheck reports an error.
Some of the warnings are not real issues and fixing them leads to problems.

Shellcheck now fails with error severites

@hkarani do you have a lightning address I can send the award to?

lnbc200u1pnyf7kjpp57lwjtgud6qaruwpa82zp83uply2rtdtacgee5pkch8cjadd8kvfsdpcge6kuerfdenjqsrpwd6x2unfwd4nxv3qdahzqum5v93kketj9ehx2amncqzzsxqrrsssp5uevwget85sjmw9s5p93394luu79sdj540shsvt8xvqu0a59nh2pq9qyyssqpakdznxs9undftme227q2g89cvmp2lv908r96saeg8yggh9wq5p9u08u4nuful83gasmjnjrell7hxwjf9fjlaagfwraukzhr9v9jcsq4s67d8
On Wed, May 15, 2024 at 8:53 PM Keyan @.***> wrote:

@hkarani https://github.com/hkarani do you have a lightning address I
can send the award to?
—
Reply to this email directly, view it on GitHub
https://github.com/stackernews/stacker.news/pull/1147#issuecomment-2113123725,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AN7TITIFEFA7FX3M7PMPYDTZCOOLFAVCNFSM6AAAAABHHOU7H2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMJTGEZDGNZSGU
.
You are receiving this because you were mentioned.Message ID:
@.***>

@huumn my stackernews username https://stacker.news/asterisk32
lnbc200u1pnyfl8zpp5qfxqg3fy7e9t087eh94qgz4qpzh97djdpkvmdkryd80tfrrmkhwqdpcge6kuerfdenjqsrpwd6x2unfwd4nxv3qdahzqum5v93kketj9ehx2amncqzzsxqrrsssp5vk25dhfj30scv60vuqtp8cusdpl0gl4lr6hjlm5aj22vm9rs3njs9qyyssq4yg27eutep99qdmnzx9kvtftw5qk6ehm94pal2th22qvk6vzvk75zt898fmc4exttr5pvhh99pfjmlhu8epg3vqadzptk9stdqmseuqpykm88q


fixes in NMEA help

Fixed the NMEA outfile name in help according to the implementation:
static void init_values(void)
{
...
strftime(timestring1, TIMESTRING_LEN, "%Y%m%d%H%M%S", localtime(&tspecakt.tv_sec));
...

Noticed this while looking at my .nmea files. For example this was generated ~20 mins ago:
20230501123258.nmea

Fixed an other small typo also (_gpx).

Ugly copy and paste error. Thanks. Merged.


V2 Auto Multiline Detection - Implement tokenizer

What does this PR do?
This PR introduces the log tokenizer for auto multiline detection V2. This PR only includes the implementation and tests. Usage will be added in a future PR.
The tokenizer is designed to process a log line as a byte slice and return a slice of tokens that represent the log structure. The tokenizer is also implemented as a Heuristic interface implementation and enriches the labeler messageContext with tokens. This tokenizer will work on any generic log format however it's worth noting that it is mostly designed with tokens used to represent different datetime formats.
This implementation also includes several debug functions that are currently used to assist with testing, but will also be used for diagnostics and telemetry.
NOTE: While I expect the general algorithm to remain unchanged, implementation details may be adjusted with time as we test this on more real data. All of the rules for the tokenizer today have been implemented based on testing with various data sets.
Technical details

Tokens are stored as bytes.
Operates in a single pass
len(output) <= len(input)
Single allocation per input tokenization (just the output buffer)
Debug and diagnostics functions included to convert tokens to strings for easy debugging.

The tokenizer follows a few simple rules for generating token slices:

digit runs ex: numbers (up to 10) are converted to unique tokens
character runs ex: words (up to 10) are converted to unique tokens
Spaces and special characters are truncated and represented by unique tokens
special keywords have special tokens
a token is only added to the output when the next input is a different token than the previous one.

Benchmarks
The benchmarks are extremely simple and not extensive. However they allowed me to make a few optimizations to limit the number of allocations, and improve overall runtime during development.
goos: darwin
goarch: arm64
pkg: github.com/DataDog/datadog-agent/pkg/logs/internal/decoder/auto_multiline_detection
BenchmarkTokenizerLong
BenchmarkTokenizerLong-10     	   35056	     33605 ns/op	     160 B/op	       1 allocs/op
BenchmarkTokenizerShort
BenchmarkTokenizerShort-10    	 1000000	      1124 ns/op	      16 B/op	       1 allocs/op

Motivation

Additional Notes

Possible Drawbacks / Trade-offs

Describe how to test/QA your changes
Will be fully tested when integrated in future changes.
Unit test coverage is 99+%

/merge


fix: Mesh crash in canvasRenderer

fix: #6491
before: https://jsfiddle.net/JetLu/tz2bnmu7/
fixed: https://jsfiddle.net/JetLu/L6dzc74o/

Done.


Fixups in preparation for switching from nose to pytest

Motivation and Context
I had found a strange behavior in nose where it would sometimes (but deterministically) fail to run some tests when the testsuite was split into chunks for parallelization. I traced the problem to a bug in nose. The bug was not simple to fix and I noticed that nose has gotten no updates in the last 5 years, so it seems quite deprecated. pytest seems to be today's golden standard and it seems capable to run tests written for nose.
Approach
I installed pytest locally and ran pytest --collect-only which runs the test discovery step, and it came back with a small number of warnings. This PR makes the necessary changes to fix those warnings.
How Has This Been Tested?
TravisCI is happy and pytest --collect-only gives no warnings (or errors)
This is ready to merge as soon as the tests pass

Ready for review @braxtonmckee


Chess: Move D8 to E7

Please do not change the title. Just click "Submit new issue". You don't need to do anything else :D

@tmchuynh done! Successfully played move d8e7 for current game.
Thanks for playing!


Removing MSBuild-integrated NuGet restores / Remove .nuget folder / deprecation

Hi there,
Is there any special reason to have the sdk/.nuget folder?
If not, I'm proposing to remove the https://github.com/aws/aws-sdk-net/tree/master/sdk/.nuget folder from this repository.
Reason: MSBuild-integrated restores are deprecated and should not be used anymore. Instead: automatic restore capabilities of NuGet 2.7 and above.
See http://docs.nuget.org/ndocs/consume-packages/package-restore#migrating-to-automatic-restore
Removing the .nuget folder should not bring up any problems - A central/system wide NuGet installation or Visual Studio should be used instead - see also http://docs.nuget.org/ndocs/consume-packages/package-restore.
References to the .nuget folder in .csproj will have to be removed as well of course:
<Import Project="$(SolutionDir)\.nuget\NuGet.targets" Condition="Exists('$(SolutionDir)\.nuget\NuGet.targets')" />
This can be automated by using these scripts: https://github.com/owen2/AutomaticPackageRestoreMigrationScript

Thanks for the info. Is our current system blocking you? I'm waiting for the new tooling updates for .NET Core before doing anymore updates to our project system.

It's not blocking me, it just may confuse people like myself, because the integrated NuGet version 3.4.x contains some bugs for netcore which are mostly all fixed in the current 3.5 RC.
I'm also not quite 100% sure how VS 2015 Upd. 3 is handling these .nuget references - not sure if the binary gets used here or not. It seems the the tooling currently is a bit messy.

The tooling is pretty messy now. It has been a challenge for us to get our legacy .NET 3.5 support, Xamarin, Unity, .NET 4.5 and .NET Core to play nice with each other. Which is why I want to avoid messing with it till the tooling gets a bit less messy :)

Closing for now. Once .NET Core moves to msbuild we can revisit how we use NuGet


Mark experimental samples

[] append [experimental] to example name in overview page
[] inject src/templates/experiment.html into example template if experimental flag is set (see #32)

@sebastianbenz PTAL?

[] inject src/templates/experiment.html into example template if experimental flag is set (see #32)
fixed by https://github.com/ampproject/amp-by-example/pull/73.
We need to work on:
[] append [experimental] to example name in overview page


[{read,write}-fonts] Allow DeltaSetIndexMap repeated trailing entries to be omitted

Fixes #667

In addition to fixing #667, I believe that skrifa right now would apply HVAR's advance width deltas incorrectly (falling back to 0) whenever the requested glyphID >= DeltaSetIndexMap.map_count, as DeltaSetIndexMap::get would return OutOfBounds error instead of getting the last deltaset index.

I believe that skrifa right now would apply HVAR's advance width deltas incorrectly (falling back to 0) whenever the requested glyphID >= DeltaSetIndexMap.map_count, as DeltaSetIndexMap::get would return OutOfBounds error instead of getting the last deltaset index.

Good find, would be great to have a test for that if possible?


lxd init first intalation vdevs refer to the same device

The template below is mostly useful for bug reports and support questions.
Feel free to remove anything which doesn't apply to you and add more information where it makes sense.
Required information

Distribution: Linux Ubuntu
Distribution version: 16.10  (Yakkety Yak)
The output of "lxc info" or if that fails:

Kernel version: #63-Ubuntu SMP Mon Jun 26 17:08:21 UTC 2017 (4.8.0-58-generic)
LXC version: 2.4.1
LXD version: 2.4.1
Storage backend in use: zfs

Issue description
I have problem with lxd. This is compliantly new installation of Ubuntu 16.10, I try to run lxd init but when I answer:
Would you like to use an existing block device (yes/no) [default=no]? yes
Path to the existing block device: /dev/sda1
I get this error: Failed to create the ZFS pool: cannot open '/dev/sda1': Device or resource busy cannot create 'lxdpool': one or more vdevs refer to the same device, or one of the devices is part of an active md or lvm device
and this is fdisk -l
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disklabel type: dos
Disk identifier: 0xf350b45a
Device     Boot     Start       End   Sectors   Size Id Type
/dev/sda1  *         2048 909619199 909617152 433.8G 83 Linux
/dev/sda2       909621246 976705535  67084290    32G  5 Extended
/dev/sda5       909621248 976705535  67084288    32G 82 Linux swap / Solaris

Looking at what you pasted, you're telling ZFS to wipe the partition that currently holds your entire system. It's a really good thing that it gave you that error and didn't just do what you asked because otherwise you'd be left with a completely broken system.
The block device you provide LXD has to be unused so that it can be formatted for ZFS' use. If you just want to have ZFS use a file on your existing partition, use the default answer of "no" which will then let you setup a loop based ZFS using a file on your existing filesystem.
PS: Ubuntu 16.10 is going to reach its end of life in a week or so, you should really upgrade to 17.04.

All of our storage backends will refuse to overwrite existing partitions iff the tools the tools for the relevant storage driver are smart enough to not do this without setting a force option!

So what will the best way to set up a loop based ZFS or to add new partition and use ZFS filesystem?
How many space I should assign to this partition? I understand that it is keeping images and containers. So if I want to have only 34 containers in this server and nothing more and I have 500 Gb I should assign for ZFS partition  420Gb and the rest for the system around 80 Gb, yes?
Should I create storage pool and the one big volume?
Thank you for all information.

If you just go with the default values in "lxd init", it will setup a loop based ZFS for you and let you specify how big you want to allow for it to be (it pre-selects a reasonable size based on available space).
You can technically grow it later or move it to physical drives/partitions, but note that a ZFS pool can never shrink, so you'll always have to move to something bigger.


Let editor configure the quick links title

For this moment, the quick link title will be read from resource bundle and that will be applied for all quick links used in the website.
This PR will create a title field which allow editor configure title for each quick link.

@smanivasag Thank you for the remarks. Can you do an other reviews ?


JSR computability

What is the problem this feature would solve?
added to jsr
What is the feature you are proposing to solve the problem?
added to jsr
What alternatives have you considered?
No response

https://discord.com/channels/795981131316985866/795983589644304396/1214523530721366046
This has been discussed before at multiple occasions and so far the consensus is that we don't intend to publish to jsr.io in the foreseeable future.


speed up selector for multi select2

In case the select2 component is a multi select field, select2_container.has_selector?(".select2-choice") takes Capybara.default_wait_time seconds to complete. We should use non-waiting finders like #first instead.

:+1:


Redo docs

Description
I feel the docs are not very consumable / approachable and we should improve the examples and usages.
Also remove the V2 stuff about ANTLR (maybe have a v2 section?)

Hello. I recently discovered this library and am glad I did. Concerning the docs—they aren't bad, but there is at least one place that doesn't make sense to me. In the following code block, getComposedField is imported but then never used. And then later, parseWhereClause() is called, but I'm not seeing this method on the composer object returned from the Compose constructor. I'm actually wanting to use almost this exact functionality (build just a where clause), but I can't get this example to work.
import { Compose, getComposedField, parseQuery } from 'soql-parser-js';

const soql = `SELECT Id FROM Account WHERE Name = 'Foo'`;
const parsedQuery = parseQuery(soql);

// Results of Parsed Query:
  // const parsedQuery = {
  //   fields: [
  //     {
  //       type: 'Field',
  //       field: 'Id',
  //     },
  //   ],
  //   sObject: 'Account',
  //   where: {
  //     left: {
  //       field: 'Name',
  //       operator: '=',
  //       value: "'Foo'",
  //       literalType: 'STRING',
  //     },
  //   },
  // };

  // Create a new instance of the compose class and set the autoCompose to false to avoid composing the entire query
  const composer = new Compose(parsedQuery, { autoCompose: false });

  const whereClause = composer.parseWhereClause(parsedQuery.where);

  console.log(whereClause);
  // Name = 'Foo'
}

I decided to leave this comment here because it seemed to pertain to this issue, but let me know if you would prefer that I create a separate issue instead.

@zac-prodly  - Hey, sorry about the docs being incorrect - I can confirm that parseWhereClause does not seem to exist in the codebase except for the docs 🤔
I think what you want to use is parseWhereOrHavingClause() - see unit test here with example https://github.com/paustint/soql-parser-js/blob/54253988f20a5acd88156522a3623d5892ac336e/test/test.spec.ts#L175
I will review the docs and get that section updated to be accurate - must have missed it on a refactor :D

@paustint - Wondering if this method of building just a part of the query such as the where clause still supports formatting with indentation? I can't seem to get it to work. Again, please let me know if this is not the appropriate forum for this question. Thanks

This is fine for support here, but feel free to open a new issue as well in the future.
I just tested and was able to get formatting to work without any issues. The only thing you might run into is that the formatter does assume that it is combined with the WHERE clause, so the indentation may not be perfect.
You need to explicitly set format: true and then you can optionally adjust any of the formatter options as you see fit.
import { Compose, parseQuery } from "soql-parser-js";

const query = parseQuery(
  `SELECT Id FROM Account WHERE (Id IN ('1', '2', '3') OR (NOT Id = '2') OR (Name LIKE '%FOO%' OR (Name LIKE '%ARM%' AND FOO = 'bar')))`
);
const compose = new Compose(query, {
  autoCompose: false,
  format: true,
  formatOptions: {
    newLineAfterKeywords: false,
    whereClauseOperatorsIndented: true,
  },
});

console.log(compose.parseWhereOrHavingClause(query.where));

@zac-prodly - I wanted to let you know that I just released a new version resolving #182 which adds support for both parsing and composing queries that are not fully formed.
Example - you can parse a query that is missing a SELECT or FROM clause as long as you pass allowPartialQuery=true and composeQuery now works with parts of the query object missing (fields and sobject).
const soql = `WHERE (Id IN ('1', '2', '3') OR (NOT Id = '2') OR (Name LIKE '%FOO%' OR (Name LIKE '%ARM%' AND FOO = 'bar'))`;

const parsedQuery = parseQuery(soql, { allowPartialQuery: true });

const composedQuery = composeQuery(parsedQuery, { format: true }); // returns original WHERE clause

isQueryValid(soql, { allowPartialQuery: true }); // true

Awesome, thanks for letting me know!
Cheers,
Zac
On Fri, Mar 11, 2022 at 2:32 PM Austin Turner @.***>
wrote:

@zac-prodly https://github.com/zac-prodly - I wanted to let you know
that I just released a new version resolving #182
https://github.com/paustint/soql-parser-js/issues/182 which adds
support for both parsing and composing queries that are not fully formed.
Example - you can parse a query that is missing a SELECT or FROM clause as
long as you pass allowPartialQuery=true and composeQuery now works with
parts of the query object missing (fields and sobject).
const soql = WHERE (Id IN ('1', '2', '3') OR (NOT Id = '2') OR (Name LIKE '%FOO%' OR (Name LIKE '%ARM%' AND FOO = 'bar'));
const parsedQuery = parseQuery(soql, { allowPartialQuery: true });
const composedQuery = composeQuery(parsedQuery, { format: true }); // returns original WHERE clause
isQueryValid(soql, { allowPartialQuery: true }); // true
—
Reply to this email directly, view it on GitHub
https://github.com/paustint/soql-parser-js/issues/172#issuecomment-1065495945,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ASEKVM54TZRVIYL4T5WZ3J3U7OUWLANCNFSM5JRZICQA
.
You are receiving this because you were mentioned.Message ID:
@.***>


Feature Request: Bluetooth headset input controls

It would be nice to be able to use the controls that are on my bluetooth headset similar to the way the media keys work.

This is currently not physically possible as far as I am aware.  Unless there is an actual key event being fired when you push the bluetooth headset buttons

I've heard it will fire keyboard codes, but it's very OS dependant if I'm not mistaken.

On windows I can pick up ANY keyboard code if it fires one.  Not sure what I would do about linux/OS X

understood. I think there will be more options with new os x libraries that are coming out. I think it sucks
that apple has not unified this between iOS and OS X.

On Windows, it seems possible.
WinAmp is somewhat responsive to my Sony headset bluetooth media button. The "play/pause" seems sadly mapped as "stop", but I can change track.
I have not fully looked into what's going on.

I don't have a bluetooth headset peoples so if someone that does could check this out and see if it fires any key events. :+1:

If anyone does want to pick this up the best place to start is checking if MediaPlayPause is fired in the app-command channel when pushing the buttons on your headset
https://github.com/atom/electron/blob/master/docs/api/browser-window.md

I'll give this a go today all going to plan with the time and schedule.

In Linux, these are the informations for each of those buttons I got from xev: keycode 208 (XF86AudioPlay), keycode 209 (XF86AudioPause), keycode 171 (XF86AudioNext), keycode 173 (XF86AudioPrev)... So it seems like they should be the same as other kinds of media keys but for me only previous and next actually works...

Are those the keycodes from a bluetooth device?

Yes. Specifically the Phillips SHB5500.

Can't get any information from OS X :( tried with KitSound KSMHDTBK.
On Tue, Mar 22, 2016 at 7:06 AM, MCManuelLP<EMAIL_ADDRESS>wrote:

Yes. Specifically the Phillips SHB5500.
—
You are receiving this because you authored the thread.
Reply to this email directly or view it on GitHub
https://github.com/MarshallOfSound/Google-Play-Music-Desktop-Player-UNOFFICIAL-/issues/626#issuecomment-199758730

So there is a tool that exists for OSX that servers to retransmit keydown from bluetooth devices into media keydown's, see: https://github.com/jguice/mac-bt-headset-fix/blob/master/Spotify Bluetooth Headset Listener/KDMAppDelegate.m#L40-L65
I'll have to go hunting and figure out if Electron has a way of listening to events from a addGlobalMonitorForEventsMatchingMask call.

@bagedevimo It'll probably end up being a native module in cpp.  I doubt electron has bluetooth functionality

@bagedevimo wouldn't running the software you linked allow you to map your bluetooth keys to your keyboard media keys for any application?

Yeah, it runs fine & works fine with Google Play Music Desktop Player. :) -
I just thought first class support would be nice. That utility i linked
above has the downside in that is is sometimes very slow, 3-5s between
pressing pause and the music pausing, sometimes.
On Sun, Mar 27, 2016 at 1:56 PM Jesse Ostrander<EMAIL_ADDRESS>wrote:

@bagedevimo https://github.com/bagedevimo wouldn't running the software
you linked allow you to map your bluetooth keys to your keyboard media keys
for any application?
—
You are receiving this because you were mentioned.
Reply to this email directly or view it on GitHub
https://github.com/MarshallOfSound/Google-Play-Music-Desktop-Player-UNOFFICIAL-/issues/626#issuecomment-201964913

For me on Linux it the keys from the headset work only if I focus the "Desktop settings" window. I've tried with Play, Next and previous.
It is possible to make them global? I know that nuvola player has this functionality and it's really great.(For normal key at least)
The headset is PHILIPS SHB3060BK/00
OS:14.04.1-Ubuntu

I want to add in Windows, Bluetooh controls should be converted to keyboard media controls automatically. At least it all my other apps in Windows (VLC, Winamp, etc) will respond to the bluetooth headset controls when keyboard control hotkeys are enabled. This worked for me in XP, 7, and 8.1

Just as a recap:
Windows
Bluetooth headsets should work on windows when they send the correct media keyboard events as key presses, without the help of extra software.
OS X
Not Possible without third party software or writing a custom node module on OS X that will re-transmit the events to our electron app.
Linux
As long as the media keyboard events are fired from the headset it should be picked up in gnome and mate based window managers via dbus media key listener. If there are others that work similarly but have a different name that needs to be added, it can be added here:
https://github.com/MarshallOfSound/Google-Play-Music-Desktop-Player-UNOFFICIAL-/blob/master/src/main/features/linux/mediaKeysDBus.js

Thanks for the run down @jostrander
From what you've said and my research
Windows = Fine
Linux = Fine
OS X = Impossible (OS X is hardcoded to send bluetooth keys to itunes and quicktime)
For those using OS X you can change this behaviour with third party tools like.
https://github.com/JamesFator/BTHSControl

BTHSControl didn't work for me (on OSX 10.11 with Sony MDR100-abn), but https://github.com/jguice/mac-bt-headset-fix did

Cheers ben-edgar! Confirmed working with Sony MDR 1000X as well.

Another datapoint: I was able to get playback controls working with my Sony 100ABN on Windows only after I enabled the "Windows 10 System Media Service" and restarted the application.


iframe refresh BUG when using Vue Router API beforeRouteLeave to prevent browser's native back behavior

Version
4.1.6
Reproduction link
codesandbox.io
Steps to reproduce
In Xiaomi/Samsung browsers, when a webpage with an Iframe uses "VUE - beforerouterleave", it can only prevent the webpage from refreshing, but the Iframe will automatically refresh
Example, click "Demo page2" in "Demo page1" and enter into "Demo page2", then click "back button" in xiaomi/Samsung browser, you will find that the “countdown” refresh to 999 seconds
What is expected?
Both the website and iframe content in the website can remain the previous status when we use VUE -- beforerouterleave
What is actually happening?
When we test in Samsung/XiaoMi browsers, only website remain the previous status and Iframe content in the website will refresh when we use VUE -- beforerouterleave

Unfortunately, this is a browser limitation: an iframe influences its parent history by also pushing/removing entries so you end up having two router instances but only one single history track. You need to find a way that matches your use case and allows you to control them independently


Event consumption using BlobCheckpointStore results in 'Invalid link' error after several hours.

Describe the bug
As in title. After consuming for several hours (indeterminate, I've seen 8 and 13 for eg) service starts consistently failing with:
azure.eventhub._pyamqp.aio._session_async ERROR    Unable to attach new link: ValueError('Invalid link')

Our code is based on example here: https://learn.microsoft.com/en-us/python/api/overview/azure/eventhub-checkpointstoreblob-aio-readme?view=azure-python in the section ""
I'm hitting the breakpoint below in _link_async.py:
170  	        if not frame[5] or not frame[6]:
171  	            import pdb; pdb.set_trace()
172  ->	            _LOGGER.info("Cannot get source or target. Detaching link", extra=self.network_trace_params)
173  	            await self._set_state(LinkState.DETACHED)
174  	            raise ValueError("Invalid link")

To Reproduce
Issue has come about after updating from our previously pinned requirements:
    azure-common==1.1.25
    azure-core==1.26.1
    azure-eventhub==5.3.1
    azure-eventhub-checkpointstoreblob-aio==1.1.2
    azure-graphrbac==0.61.1
    azure-identity==1.6.1
    azure-keyvault-keys==4.7.0
    azure-keyvault-secrets==4.6.0
    azure-mgmt-compute==29.0.0
    azure-mgmt-containerservice==20.7.0
    azure-mgmt-core==1.3.2
    azure-mgmt-keyvault==10.1.0
    azure-mgmt-monitor==5.0.1
    azure-mgmt-resource==21.2.1
    azure-mgmt-storage==21.0.0
    azure-storage-blob==12.5.0

to the latest (unpinned) which are:
    azure-common==1.1.28
    azure-core==1.26.3
    azure-eventhub==5.11.1
    azure-eventhub-checkpointstoreblob-aio==1.1.4
    azure-graphrbac==0.61.1
    azure-identity==1.12.0
    azure-keyvault-keys==4.7.0
    azure-keyvault-secrets==4.6.0
    azure-mgmt-compute==29.1.0
    azure-mgmt-containerservice==21.2.0
    azure-mgmt-core==1.3.2
    azure-mgmt-keyvault==10.1.0
    azure-mgmt-monitor==5.0.1
    azure-mgmt-resource==22.0.0
    azure-mgmt-storage==21.0.0
    azure-storage-blob==12.15.0

Run for several hours with the latest azure package versions. Error appears.
I can provide more details on request.
The error is handled internally, so I can't catch easily and restart the service, although I think it's coming from a worker thread.
Seems somewhat similar to the issue here: https://github.com/Azure/azure-sdk-for-python/issues/28498 although I'm not directly specifying a credential.
Expected behavior

Consumption should run without interruption.
Errors should have enough information attached to allow customer resolution.
Method to restart service if fails.

Thank you for the feedback @petersbingham . This issue looks to be similar to the one created here #28996. We are currently investigating it and trying to get a reliable repro. If you can provide me with certain information such as number of partitions, debug logs ( esp with information before the failures start ) it would be very helpful

It might take a while to get the logs. I need to test if there are any intermediate versions of your python libraries which don't have this issue which will satisfy our urgent requirements.

@petersbingham, we have this issue as well and we have switched back to uamqp on our projects (while staying with the latest version of azure-eventhub: 5.11.1). To make the switch we had to do the following:

pip install uamqp
Add uamqp_transport=True, to kwargs for EventHubConsumerClient.from_connection_string(...

I think you can also try version 5.10.1?

@petersbingham, we have this issue as well and we have switched back to uamqp on our projects (while staying with the latest version of azure-eventhub: 5.11.1). To make the switch we had to do the following:
1. `pip install uamqp`

2. Add `uamqp_transport=True,` to kwargs for `EventHubConsumerClient.from_connection_string(...`

So far, we've switched 3 of our consumers and these are looking stable over the last 24 hours.
I think you can also try version 5.10.1?

I was running into this as well, reverted back to 5.10.1 and that worked. Now I'm testing out 5.11.1 with the uamqp_transport=True option, which seems to be working fine for the past few days.

I'll be testing uamqp over the weekend. Thanks guys.

Hi @petersbingham, we have closed the other issue as we have a fix for the bug that was causing this. We will be releasing a new version of the client library soon

Hi @petersbingham , we have just released a new version of the library and its available on pypi with the fix for this issue 😀

Thanks a lot!😀
Sent from Outlook for Androidhttps://aka.ms/AAb9ysg

From: Kashif Khan @.>
Sent: Tuesday, March 21, 2023 8:16:59 PM
To: Azure/azure-sdk-for-python @.>
Cc: Peter Bingham @.>; Mention @.>
Subject: Re: [Azure/azure-sdk-for-python] Event consumption using BlobCheckpointStore results in 'Invalid link' error after several hours. (Issue #29081)
Closed #29081https://github.com/Azure/azure-sdk-for-python/issues/29081 as completed.
—
Reply to this email directly, view it on GitHubhttps://github.com/Azure/azure-sdk-for-python/issues/29081#event-8809891720, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ADE4G6GVHOB74MNHNKRAHILW5IEDXANCNFSM6AAAAAAVL5XM7I.
You are receiving this because you were mentioned.Message ID: @.***>

I will let you know if this fixes our issue. Might be a week or two.
Sent from Outlook for Androidhttps://aka.ms/AAb9ysg

From: Peter Bingham @.>
Sent: Tuesday, March 21, 2023 8:26:38 PM
To: Azure/azure-sdk-for-python @.>; Azure/azure-sdk-for-python @.>
Cc: Mention @.>
Subject: Re: [Azure/azure-sdk-for-python] Event consumption using BlobCheckpointStore results in 'Invalid link' error after several hours. (Issue #29081)
Thanks a lot!😀
Sent from Outlook for Androidhttps://aka.ms/AAb9ysg

From: Kashif Khan @.>
Sent: Tuesday, March 21, 2023 8:16:59 PM
To: Azure/azure-sdk-for-python @.>
Cc: Peter Bingham @.>; Mention @.>
Subject: Re: [Azure/azure-sdk-for-python] Event consumption using BlobCheckpointStore results in 'Invalid link' error after several hours. (Issue #29081)
Closed #29081https://github.com/Azure/azure-sdk-for-python/issues/29081 as completed.
—
Reply to this email directly, view it on GitHubhttps://github.com/Azure/azure-sdk-for-python/issues/29081#event-8809891720, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ADE4G6GVHOB74MNHNKRAHILW5IEDXANCNFSM6AAAAAAVL5XM7I.
You are receiving this because you were mentioned.Message ID: @.***>


FileDialog is not translated in game

Godot version:

3.2.4 rc4 / bf309b8
Issue description:

Only title is translated. Everything else, including tooltips, is not. In editor it's translated properly.

Duplicate of https://github.com/godotengine/godot/issues/45887?

I've seen that issue and it's weird. It says that dialog is translated at startup (you can even see that on the video), but for me it's not translated at all. Also it's about changing the translation in-game.

@KoBeWi should be fixed by #46735

I actually opened this issue, because that PR doesn't fix it.

@KoBeWi I can't reproduce the issue in the PR, here is what I have: I can set a langage other than EN on startup and change the language in runtime:
https://user-images.githubusercontent.com/6397893/111068736-5177d480-84ca-11eb-8219-00e904d38b7d.mp4

The translation is complete, as I said the localized text shows fine in the editor, but not when running.
Something is wrong here. Here's some test code:
func _ready() -> void:
	TranslationServer.set_locale("es")
	var fd = FileDialog.new()
	add_child(fd)
	fd.popup_centered()

Maybe the dialogs are supposed to only use custom translations, but that doesn't explain why their titles are translated (see the screenshot in OP)

After some discussion on the chat, I realized this is not a bug. The title was translated because of #39258. Seems like translated strings are only available in the editor, so it's expected that they won't work in the game and "fixing" this is a proposal material. Closing.


Form Dropdown Option for Mysql Null

Builder doesn't seem to allow the creation of a backend dropdown menu element that can set a database setting to null. When editing a dropdown element in the module form, the 'Key' part of an item can't be blank. But writing anything like null for the key places a string 'null' in the Yaml file.
I would think this could be easily avoided by editing the Yaml file to remove the quotes around 'null', e.g.,
fields:
    alt_zone:
        label: 'Alternate Time Zone'
        options:
            null: (none)
            America/New_York: 'US Eastern Time'

However, this just produces an empty string in the database. Other variations of Null, NULL, or ~ also produce '' in the database rather than true nulls.
The column is set as nullable in the table configuration.

Try setting the placeholder option with a value.

Committing the form with the placeholder option also results in '' as the
database value. But that would be a good way to have it work. It looks like
October is respecting the relevant yaml syntax in that ~ and null aren't just
recognized as strings. But in respecting them, it puts '' as the database
value instead of null.
On Mon, Jul 4, 2016 at 2:18 AM, Samuel Georges<EMAIL_ADDRESS>wrote:

Try setting the placeholder option with a value.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/rainlab/builder-plugin/issues/98#issuecomment-230178834,
or mute the thread
https://github.com/notifications/unsubscribe/APwE0dGLuRBHxUJRSSVbttz_fEZZYTQzks5qSDVIgaJpZM4JD89i
.

Committing the form with the placeholder option also results in '' as the database value. But that would be a good way to have it work. It looks like October is respecting the relevant yaml syntax in that ~ and null aren't just recognized as strings. But in respecting them, it puts '' as the database value instead of null.

Support for null keys should be first implemented in the October core. Builder can't provide features which are not supported by October itself. Please reopen this issue (if it's still needed) when/if we have the corresponding functionality in October.

@daftspunk suggested that there's a workaround. You can use the emptyOption property to define a dropdown option which corresponds to the empty value. You should also use the Nullable trait and declare the column as nullable in the model class. 332f85c6b7b7109e3a8dae7b62d3ca0aab71893f adds emptyOption property to the dropdown control, so you can manage it with Builder.
Model code example:
class MyTestModel extends Model
{
    ...
    use \October\Rain\Database\Traits\Nullable;

    protected $nullable = ['some_nullable_field'];


Improve documentation

[x] Create CONTRIBUTING.md
[x] Update README.md with supported applications
[x] Create docs directory
[x] Create instructions on creating soc-modules

@Matt-Gleich Can you add issue templates? I don't have access to the repository settings.

Don't you just put them in the .github folder? There isn't any setting in the settings.

Nevermind, I found the button. Adding them directly is a legacy feature and not recommended.


Change id insertion sound

About the PR

resolve #22540
Id card / cartrige  insert sound changing
Why / Balance

Change previous usage of weapon mag  / UX
Technical details

Media

[X] I have added screenshots/videos to this PR showcasing its changes ingame, or this PR does not require an ingame showcase

Breaking changes

Changelog

tweak: new id insert sound added

https://github.com/space-wizards/space-station-14/assets/52600490/8b8b4187-614d-443d-ad5e-964173c02bee

based

so long batrfile_magin.ogg


ffi (Object): make class dict visible in instances

In Python, generic objects (i.e. non-types/classes) inherit the __dir__ elements from their class.
This enable tab completion in interactive environments like Jupyter notebooks.
Reference for this behaviour is Python's __dir__ for objects:
https://github.com/python/cpython/blob/8f192d12af82c4dc40730bf59814f6a68f68f950/Objects/typeobject.c#L4854-L4899
I'll readily admit that I don't know whether the location for the test I offer is a good one. It seemed to be a place where low-level stuff is tested and where this can blend in.

@tqchen / @zhiics  I think you're closest to this code.

Thanks @t-vi !


Blockstack core not working on localhost after installing gaia.

My Auth Login was working with simple Blockstack core installation.
But as soon as i install gaia with python install. I am unable to Login / storedata, it jsut get stuck on choose your data storage part.
Guide ASAP i am working on production blockstack.
Bear in mind that the error in console is following.
i am working in localhost envirement.
TypeError: NetworkError when attempting to fetch resource

@jcnelson  Need your help, as i am stuck this issue i am stuck with gaia i don't even know how to uninstall it so atleast i could use localstorage.
Currently unable to move forward from this link.

http://localhost:8888/account/storage#gaiahub

please help me to resolve this issue i am looking to build a dapp over blockstack. using gaia storage dropbox.

This is a duplicate of https://github.com/blockstack/blockstack-core/issues/653. Closing in favor of that issue.


Feature browser

I'll proceed to merge this branch since it's almost complete. The rest of the work toward the 0.4 can be completed in the trunk.


[Core] implement disaggregated prefilling via KV cache transfer

This is a follow-up PR for #5557 .
Goal: implement disaggregated prefilling by launching 2 vllm instances (one for prefilling, one for decoding), and forward the KV cache from prefilling instance to decoding instance.
A rough roadmap:

[x] Benchmark the idealized version of disaggregated prefilling (idealized in terms of the KV cache transfer can be done immediately).
[x] Implement API calls in vllm to import / export KV cache
[x] Implement an agent that can transfer KV cache between prefilling and decoding instance
[x] Implement end-to-end prototype
[ ] Benchmark and improve the performance

BEFORE SUBMITTING, PLEASE READ THE CHECKLIST BELOW AND FILL IN THE DESCRIPTION ABOVE

 PR Checklist (Click to Expand)
Thank you for your contribution to vLLM! Before submitting the pull request, please ensure the PR meets the following criteria. This helps vLLM maintain the code quality and improve the efficiency of the review process.
PR Title and Classification
Only specific types of PRs will be reviewed. The PR title is prefixed appropriately to indicate the type of change. Please use one of the following:

[Bugfix] for bug fixes.
[CI/Build] for build or continuous integration improvements.
[Doc] for documentation fixes and improvements.
[Model] for adding a new model or improving an existing model. Model name should appear in the title.
[Frontend] For changes on the vLLM frontend (e.g., OpenAI API server, LLM class, etc.)
[Kernel] for changes affecting CUDA kernels or other compute kernels.
[Core] for changes in the core vLLM logic (e.g., LLMEngine, AsyncLLMEngine, Scheduler, etc.)
[Hardware][Vendor] for hardware-specific changes. Vendor name should appear in the prefix (e.g., [Hardware][AMD]).
[Misc] for PRs that do not fit the above categories. Please use this sparingly.

Note: If the PR spans more than one category, please include all relevant prefixes.
Code Quality
The PR need to meet the following code quality standards:

We adhere to Google Python style guide and Google C++ style guide.
Pass all linter checks. Please use format.sh to format your code.
The code need to be well-documented to ensure future contributors can easily understand the code.
Include sufficient tests to ensure the project to stay correct and robust. This includes both unit tests and integration tests.
Please add documentation to docs/source/ if the PR modifies the user-facing behaviors of vLLM. It helps vLLM user understand and utilize the new features or changes.

Notes for Large Changes
Please keep the changes as concise as possible. For major architectural changes (>500 LOC excluding kernel/data/config/test), we would expect a GitHub issue (RFC) discussing the technical design and justification. Otherwise, we will tag it with rfc-required and might not go through the PR.
What to Expect for the Reviews
The goal of the vLLM team is to be a transparent reviewing machine. We would like to make the review process transparent and efficient and make sure no contributor feel confused or frustrated. However, the vLLM team is small, so we need to prioritize some PRs over others. Here is what you can expect from the review process:

 After the PR is submitted, the PR will be assigned to a reviewer. Every reviewer will pick up the PRs based on their expertise and availability.
 After the PR is assigned, the reviewer will provide status update every 2-3 days. If the PR is not reviewed within 7 days, please feel free to ping the reviewer or the vLLM team.
 After the review, the reviewer will put an  action-required label on the PR if there are changes required. The contributor should address the comments and ping the reviewer to re-review the PR.
 Please respond to all comments within a reasonable time frame. If a comment isn't clear or you disagree with a suggestion, feel free to ask for clarification or discuss the suggestion.

Thank You
 Finally, thank you for taking the time to read these guidelines and for your interest in contributing to vLLM. Your contributions make vLLM a great tool for everyone!

An example of disaggregated prefill can be much better than chunked prefill:

model: llama70B fp8
device: 8xH100
workload: QPS 4, input tokens 2048, output tokens 11
3 approaches

chunked prefill — tp8
chunked prefill — 2x tp4
disaggregated prefill — 1x tp4 prefill, 1x tp4 decode

I updated the measurements and now let me summarize the insight.

For long context (long: #input token >=1k when #output token=128), we should use disaggregated prefilling instead of chunked prefill.
The maximum overhead of disaggregated prefilling (caused by KV cache transfer) is 40ms. An ideal implementation should have less than 10 ms overhead.

Hi Kuntai，我看了您目前对代码的改动，想跟您确认一下目前是没有实际进行KV Cache传输的对吗，也就是roadmap 1所说的KV cache transfer can be done immediately。通过调整输出长度=1、跳过prefill，直接起两个server各自模拟分离后各自的耗时？
另外似乎您是想通过模型并行来达到PD分离的目的，但是我理解这会给PD使用不同并行设置的情况带来麻烦，还是我理解错误了呢？ 感谢您的答复！

regarding the implementation, in the long term, we expect having multiple vLLM prefill instances and multiple decode instances, do you see the current design will naturally supports it?

regarding the implementation, in the long term, we expect having multiple vLLM prefill instances and multiple decode instances, do you see the current design will naturally supports it?

The current architecture can be naturally extended to multiple vLLM instances. The current plan is to support 1 prefill - 1 decode with same tp and pp first.

Now my implementation works with TP, and now it is the time to do a quick overhead measurement.

Model: Llama 70B, with tp=4
Hardware: 8xH100, 4 for prefill, 4 for decode
Input length: 2048
Num prompts: 50
Output length: 1
QPS: 1
Overhead: mean 30.91 ms, median 30.30 ms, P99 40.97 ms

Here is how I measure this overhead:
The workflow of my code is:
(1) Send a request to prefill instance --> (2) receive first token and then immediately send the request again to decode instance --> (3) receive first token again from decode instance --> (4) receive remaining tokens
And the overhead I am measuring is the time gap between (2) and (3)
This overhead can be further optimized. Currently, I send the request to the decode instance after receiving the first token. The request can be sent much earlier --- ideally right after the prefill instance finishes prefilling, which can reduce the overhead by the time of sampling and detokenizing the first token.

A back-to-back comparison between chunked prefill and disaggregated prefill:

Input length: 2048
Output length: 150
Dataset: sonnet
Num of prompts: 400
QPS: 2,4,6,8
Methods:

chunked prefill: 2 vllm instances, tp4, with chunked prefill enabled, 2 instances share the workload in a round-robin manner
disagg prefill: 2 vllm instances, tp4, one for prefill and one for decode

My current implementation can let us get the first token before implementation overheads (like KV transfer and waiting until decode instance is ready to receive generated KV cache) happen by fetching the first token from the prefill instance, but for benchmarking’s sake I count these overheads into TTFT by fetching the first token from decode instance.

Results:

lower median TTFT and median ITL when QPS<=6 (at QPS=8 the decode instance is backlogging)
worse p99 ITL ---- Sometimes the KV cache transfer may fail (this appears rarely and I am not sure why for now), forcing the decoding instance to redo the prefill by itself, which makes ITL worse.

A back-to-back comparison between chunked prefill and disaggregated prefill:

Input length: 2048

Output length: 150

Dataset: sonnet

Num of prompts: 400

QPS: 2,4,6,8

Methods:

chunked prefill: 2 vllm instances, tp4, with chunked prefill enabled, 2 instances share the workload in a round-robin manner

disagg prefill: 2 vllm instances, tp4, one for prefill and one for decode

My current implementation can let us get the first token before implementation overheads (like KV transfer and waiting until decode instance is ready to receive generated KV cache) happen by fetching the first token from the prefill instance, but for benchmarking’s sake I count these overheads into TTFT by fetching the first token from decode instance.

Results:

lower median TTFT and median ITL when QPS<=6 (at QPS=8 the decode instance is backlogging)
worse p99 ITL ---- Sometimes the KV cache transfer may fail (this appears rarely and I am not sure why for now), forcing the decoding instance to redo the prefill by itself, which makes ITL worse.

@KuntaiDu Why are some concurrency TTFT indicators reaching 5000-10000ms? Is it pending?
But I feel that under 70b tp4, the qps on the H100 card should not be so low

A back-to-back comparison between chunked prefill and disaggregated prefill:

Input length: 2048

Output length: 150

Dataset: sonnet

Num of prompts: 400

QPS: 2,4,6,8

Methods:

chunked prefill: 2 vllm instances, tp4, with chunked prefill enabled, 2 instances share the workload in a round-robin manner

disagg prefill: 2 vllm instances, tp4, one for prefill and one for decode

My current implementation can let us get the first token before implementation overheads (like KV transfer and waiting until decode instance is ready to receive generated KV cache) happen by fetching the first token from the prefill instance, but for benchmarking’s sake I count these overheads into TTFT by fetching the first token from decode instance.

Results:

lower median TTFT and median ITL when QPS<=6 (at QPS=8 the decode instance is backlogging)
worse p99 ITL ---- Sometimes the KV cache transfer may fail (this appears rarely and I am not sure why for now), forcing the decoding instance to redo the prefill by itself, which makes ITL worse.

@KuntaiDu Why are some concurrency TTFT indicators reaching 5000-10000ms? Is it pending?
But I feel that under 70b tp4, the qps on the H100 card should not be so low

Yes, the requests are pending and that's why the TTFT is high. As for the QPS, let me double check.

It is a nice work! However, I meet some problems in actual use.
In this PR, chunked prefill with tp4 used round_robin_proxy.sh to forward polling requests for port 8000 to ports 8100 and 8200. However, when I used it, once the socat process is started and starts listening on port 8000, it will continue to receive all subsequent connections without calling the get_next_port function again to select another port.
Looking forward to your reply！

A friendly reminder here: chunked prefill feature needs a parameter --max-num-batched-tokens. In the original post of chunked prefill, the author found a fact that instead of the default 512, using 2048 on A100 gave a better result.
For Disaggregated prefill, it might be interesting to set this parameter differently on prefill and decode instances. Since prefill  stage is compute bound and decode stage is memory bound, my intuition is to set a small max batched tokens to prefill and a large max batched tokens to decode
For instance, when I was benchmarking llama3-8B with prefilll tp2 A100 and decode tp2 A100, I have set prefill instance to --max-num-batched-tokens 4096 and set decode instance to --max-num-batched-tokens 32768. With these settings, I have achieved a slightly better result.

@KuntaiDu @MazarineGlacier Have you ever tested Disaggregated prefill vs normal version (without chunk prefill)? I tested P2D2 vs tp4 and found no benefit. Is this normal?

I tested P2D2 vs tp4 and found no benefit. Is this normal?

In your case, disaggregate prefill will behave worse in TTFT. This is because default VLLM prioritizes prefill and tp4 has (less than) twice the compute capability during prefill than P2D2.
I am not certain about TPOT/ITL though, that depends on the real batched tokens.
After all, it is possible that no benefit is found.

I tested P2D2 vs tp4 and found no benefit. Is this normal?

In your case, disaggregate prefill will behave worse in TTFT. This is because default VLLM prioritizes prefill and tp4 has (less than) twice the compute capability during prefill than P2D2.
I am not certain about TPOT/ITL though, that depends on the real batched tokens.
After all, it is possible that no benefit is found.

In our scenario, disaggregate prefill on TTFT/TPOP/ITL is much worse than TP4. I don’t know where the problem is, so I wonder in which scenarios disaggregate prefill will be beneficial.

In our scenario, disaggregate prefill on TTFT/TPOP/ITL is much worse than TP4. I don’t know where the problem is, so I wonder in which scenarios disaggregate prefill will be beneficial.

This paper might answer your question: https://arxiv.org/html/2401.11181v1. In this paper, when workload is too large on both prefill and decode, disaggregate prefill failed.

I tested P2D2 vs tp4 and found no benefit. Is this normal?

In your case, disaggregate prefill will behave worse in TTFT. This is because default VLLM prioritizes prefill and tp4 has (less than) twice the compute capability during prefill than P2D2.
I am not certain about TPOT/ITL though, that depends on the real batched tokens.
After all, it is possible that no benefit is found.

In our scenario, disaggregate prefill on TTFT/TPOP/ITL is much worse than TP4. I don’t know where the problem is, so I wonder in which scenarios disaggregate prefill will be beneficial.

Me too. But I did it on 4090. Maybe the overhead is too high without nvlink.

I tested P2D2 vs tp4 and found no benefit. Is this normal?

In your case, disaggregate prefill will behave worse in TTFT. This is because default VLLM prioritizes prefill and tp4 has (less than) twice the compute capability during prefill than P2D2.
I am not certain about TPOT/ITL though, that depends on the real batched tokens.
After all, it is possible that no benefit is found.

In our scenario, disaggregate prefill on TTFT/TPOP/ITL is much worse than TP4. I don’t know where the problem is, so I wonder in which scenarios disaggregate prefill will be beneficial.

Me too. But I did it on 4090. Maybe the overhead is too high without nvlink.

Yes, I am studying the kv cache transmission overhead here. I see the author said it is about 30ms, which is definitely unacceptable.

I tested P2D2 vs tp4 and found no benefit. Is this normal?

In your case, disaggregate prefill will behave worse in TTFT. This is because default VLLM prioritizes prefill and tp4 has (less than) twice the compute capability during prefill than P2D2.
I am not certain about TPOT/ITL though, that depends on the real batched tokens.
After all, it is possible that no benefit is found.

In our scenario, disaggregate prefill on TTFT/TPOP/ITL is much worse than TP4. I don’t know where the problem is, so I wonder in which scenarios disaggregate prefill will be beneficial.

Me too. But I did it on 4090. Maybe the overhead is too high without nvlink.

Yes, I am studying the kv cache transmission overhead here. I see the author said it is about 30ms, which is definitely unacceptable.

In our scenario, there is a barrier in the KV Cache transmission, which makes TTFT and ITL (which includes TTFT) increase.

@KuntaiDu In fact, I don't think it is necessary to do tolist operation for hash calculation, as follows:
input_tokens_tuple = tuple(model_input.input_tokens.tolist())
This will cause the d2h copy to be time-consuming. Do you have any other recommended methods for calculating hash? Thanks~

I tested P2D2 vs tp4 and found no benefit. Is this normal?

In your case, disaggregate prefill will behave worse in TTFT. This is because default VLLM prioritizes prefill and tp4 has (less than) twice the compute capability during prefill than P2D2.
I am not certain about TPOT/ITL though, that depends on the real batched tokens.
After all, it is possible that no benefit is found.

In our scenario, disaggregate prefill on TTFT/TPOP/ITL is much worse than TP4. I don’t know where the problem is, so I wonder in which scenarios disaggregate prefill will be beneficial.

Me too. But I did it on 4090. Maybe the overhead is too high without nvlink.

The NVLink or Infinityband is a must for disaggregated prefilling in order for it to be better than chunked prefill. The time delta allowed for data transfer is less than 50ms.

I tested P2D2 vs tp4 and found no benefit. Is this normal?

In your case, disaggregate prefill will behave worse in TTFT. This is because default VLLM prioritizes prefill and tp4 has (less than) twice the compute capability during prefill than P2D2.
I am not certain about TPOT/ITL though, that depends on the real batched tokens.
After all, it is possible that no benefit is found.

In our scenario, disaggregate prefill on TTFT/TPOP/ITL is much worse than TP4. I don’t know where the problem is, so I wonder in which scenarios disaggregate prefill will be beneficial.

Me too. But I did it on 4090. Maybe the overhead is too high without nvlink.

Yes, I am studying the kv cache transmission overhead here. I see the author said it is about 30ms, which is definitely unacceptable.

There are several performance optimization opportunities I am not exploring yet. In the current implementation, the first token has been sampled twice, and the model input data is constructed twice. These overheads can be bypassed by engineering. and will be optimized after the implementation is stable.
I am now working on an upcoming vllm performance post, will circle back to this right after that.

It is a nice work! However, I meet some problems in actual use. In this PR, chunked prefill with tp4 used round_robin_proxy.sh to forward polling requests for port 8000 to ports 8100 and 8200. However, when I used it, once the socat process is started and starts listening on port 8000, it will continue to receive all subsequent connections without calling the get_next_port function again to select another port. Looking forward to your reply！

Oh let me double check and fix it.

ut I did it on 4090. Maybe the overhead is to

I'm interested to build upon this implementation for faster kv cache transfer

What is the current method of kv cache transfer is you are not using nvlink?
Why can't we simply use torch.distributed.isend and torch.distributed.irecv to do the transfer using nccl?

thans for your work, I got a question, can I start like 6 prefill instances and 2 decode instances on 8 GPUs and how ?

hi, i just want to know what's the relationship between your work and the pr#2809 . it seems  you both want to implement something like "disaggregated prefilling" to separate profile and generation phases.
I wonder what the difference.
Looking forward to your reply！
Thanks！

I meet a problem when I concat k and v tensor together for each layer to send and recv, Llama-2-7B output results will be random and uncorrect. Why does concating k and v lead to this result?

Close this PR now (I did a large-scale refactor and it is now in #8498 )

Thanks for your work, I got a question, can I start like 6 prefill instances and 2 decode instances on 8 GPUs and how ?

Not implemented directly in the new PR but yeah, it is on the roadmap and will soon be implemented.

@KuntaiDu hi, i just want to know what's the relationship between your work and the pr#2809 . it seems you both want to implement something like "disaggregated prefilling" to separate profile and generation phases.
I wonder what the difference.
Looking forward to your reply！ Thanks！

Not sure about that thread. I skimmed their code and my implementation is lighter weighted and overhead is tolerable (though definitely will be larger).


Athena env setup

Added tutorial to setup Athena env on Windows and Linux. Requirements.txt changed to reflect needed versions.

should push to your own repo.


clamtk: crashes due to missing icon files

Describe the bug
When executing clamtk with nix run, it complains that Icon 'preferences-system' not present in theme breeze.
Maybe the package needs to be wrapped with some environment variables set or patched against hard-coding or something.
Steps To Reproduce
Steps to reproduce the behavior:
❯ nix run github:NixOS/nixpkgs/nixos-unstable#clamtk
Gtk-Message: 08:37:15.170: Failed to load module "window-decorations-gtk-module"
Gtk-Message: 08:37:15.170: Failed to load module "colorreload-gtk-module"
Unable to read preferences! No such file or directory
Icon 'preferences-system' not present in theme breeze at /nix/store/wby9hkm3zllmlkqsxvn8fxszflx05wsa-perl5.38.0-Glib-Object-Introspection-0.049/lib/perl5/site_perl/5.38.0/x86_64-linux-thread-multi/Glib/Object/Introspection.pm line 67.

Expected behavior
ClamTk runs with nix run.
Screenshots

Additional context
Add any other context about the problem here.
Notify maintainers
@jgarcia

Metadata
Please run nix-shell -p nix-info --run "nix-info -m" and paste the result.
[user@system:~]$ nix-shell -p nix-info --run "nix-info -m"
output here

I can't seem to reproduce this. Have run both on nixos and nix on another linux. Can you give me some more info? Does the program work and run correctly? Is it missing any icons (screenshot?). What desktop are you running? Many thanks.

It exists with exit status 2 right after the command clamtk being invoked inside the terminal emulator and the error message printed out. No window is shown.
The desktop environment I use is LxQt, which inherently doesn't come with the KDE breeze icons.

I switched my DE over to LxQt and everything worked for me.
Basically the error is between the program logic (it shouldn't crash if it can't find icon files) and your DE set-up (it should provide the correct icon files). It's not a packaging error as far as I can tell. So you could try either: 1. messing around with your DE settings, 2. trying another DE and / or 3. filing a bug report upstream to clamtk.

p.s. I wonder if this could just be fixed by installing some icons?
You could try installing breeze-icons and / or gnome-icon-theme on your system and see if that helps.


[Bug][Manager] class org.datanucles.api.jdo.JDOPersistenceManagerFactory was not found

What happened

What you expected to happen
no error
How to reproduce
@GanfengTan The next error was generated by changing the latest source code, but it didn't. Is there a requirement for the hive version now? This is the error reported in "inlong-manager/logs/error.log" when I approve it.
Environment
centos7
InLong version
master
InLong Component
InLong Manager, InLong Dashboard
Are you willing to submit PR?

[X] Yes, I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

This bug seems already fixed by another pr, close it.


Cannot connect to database via SSL - old and new clients

Hello, I'm unable to connect to secured a RavenDB Cloud instance with both the old and new clients.
I'm initializing the old client like so (version <IP_ADDRESS>); cert has no password:
from pyravendb.store.document_store import DocumentStore
with DocumentStore(urls=DB_URLS, database=DB_NAME, certificate={'pfx': DB_CERT_PATH, 'password': ''}) as store:
    store.initialize()

and I get the following error (i.e. the topology shows as null in the topology_files, which causes it to be read in as Python type None):
File "/Users/trenslow/anaconda3/envs/phonetics/lib/python3.9/site-packages/pyravendb/connection/requests_helpers.py", line 63, in convert_json_topology_to_entity
    topology.etag = json_topology["Etag"]
TypeError: 'NoneType' object is not subscriptable

With the new client (version 5.2.0b1) I'm initializing DocumentStore in this way (I can't find where I'd even provide a cert password in this API):
from ravendb.documents.store.definition import DocumentStore
with DocumentStore(urls=DB_URLS, database=DB_NAME) as store:
    store.certificate_path = DB_CERT_PATH
    store.initialize()

and I get the following error, (i.e. the store actually initializes successfully, but when I run the first query, it returns this response):
  File "/Users/trenslow/anaconda3/envs/phonetics/lib/python3.9/site-packages/ravendb/http/request_executor.py", line 754, in __throw_failed_to_contact_all_nodes
    raise RuntimeError(
RuntimeError: Received unsuccessful response and couldn't recover from it. Also, no record of exceptions per failed nodes. This is weird and should not happen.

Could you please advise what I'm missing here? Thanks.

Hello @trenslow,
Thank you for creating this issue.
We're currently working it out, and we'll inform you of the updates :)

Hello @trenslow,
the .pfx format is not supported, please use the .pem.
We're working on parameter validation for a better user experience 🙂.
If you're using RavenDB Cloud, you can find .pem certificates inside the cloud setup package (Download Certificate).
Let me know if that worked 😊

Hi @poissoncorp,
In the setup package I only have the .pfx, .crt and .key files. Which one should I use?
Also, which client doesn't support the .pfx? The old one? Or will .pfx also not be supported in the new client?
Cheers

PEM = concat of crt and key file.
Example:
-----BEGIN CERTIFICATE-----
MIIFDTCCAvWgAwIBAgIUT37ZJsYZ/WvEagagyHFFmObBaYswDQYJKoZIhvcNAQEN
...
-----END CERTIFICATE-----
-----BEGIN RSA PRIVATE KEY-----
MIIJJwIBAAKCAgEAhfvmQb+WKT4QL1YvaxHC2KwwdJXQLjm+oB7+ahwfbgzx2Z17
...
-----END RSA PRIVATE KEY-----

Under the hood we are using Requests library so it should be possible to use cert and key as tuple, like in the following example:
https://requests.readthedocs.io/en/latest/user/advanced/#client-side-certificates
requests.get('https://kennethreitz.org', cert=('/path/client.cert', '/path/client.key'))
<Response [200]>

If I use the .pem file (concatenation of .crt and .key files) I get the following error:
File "/Users/trenslow/anaconda3/envs/***/lib/python3.9/site-packages/cryptography/hazmat/backends/openssl/backend.py", line 2151, in load_pkcs12
    raise ValueError("Could not deserialize PKCS12 data")
ValueError: Could not deserialize PKCS12 data

PKCS12 when providing pem looks weird. I admit.
This is an example of minimal setup:
with DocumentStore(urls=["https://a.free.gracjan-t3st.cloudtest.ravendb.org/"]) as store:
    store.certificate_path="C:\\Users\\gracj\\certcloud\\PEM\\free.gracjan-t3st.client.certificate.pem"
    store.initialize()
    store.maintenance.server.send(CreateDatabaseOperation(DatabaseRecord("Test-Database")))

@trenslow Could you also paste stacktrace when your code access load_key_and_certificates from pkcs12?
Trying this locally and it newer hits this line.

Ok sorry I didn't specify, the PKCS12 error was coming from the old client. So it looks like the old client supports .pfx after all.
If I use the new client, I'm able to initialize the store. However, when I perform a query, I get the following warning:
/Users/trenslow/anaconda3/envs/***/lib/python3.9/site-packages/urllib3/connectionpool.py:1043: InsecureRequestWarning: Unverified HTTPS request is being made to host '***'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings
  warnings.warn(

Still it seems like I'm able to talk to the database, but I thought I'd inform you guys of my experience.

@trenslow I reported this warning here: https://issues.hibernatingrhinos.com/issue/RDBC-577#focus=Comments-67-355048.0-0
We will fix that and make sure target host is validated.
I really appreciate your feedback. Happy coding with RavenDB :)

Sure thing, no prob :)

@trenslow Could you also paste stacktrace when your code access load_key_and_certificates from pkcs12?
Trying this locally and it newer hits this line.

Could not deserialize PKCS12 data
  File "/Users/trenslow/anaconda3/envs/***/lib/python3.9/site-packages/cryptography/hazmat/backends/openssl/backend.py", line 2151, in load_pkcs12
    raise ValueError("Could not deserialize PKCS12 data")
  File "/Users/trenslow/anaconda3/envs/***/lib/python3.9/site-packages/cryptography/hazmat/backends/openssl/backend.py", line 2134, in load_key_and_certificates_from_pkcs12
    pkcs12 = self.load_pkcs12(data, password)
  File "/Users/trenslow/anaconda3/envs/***/lib/python3.9/site-packages/cryptography/hazmat/primitives/serialization/pkcs12.py", line 147, in load_key_and_certificates
    return ossl.load_key_and_certificates_from_pkcs12(data, password)
  File "/Users/trenslow/anaconda3/envs/***/lib/python3.9/site-packages/requests_pkcs12.py", line 43, in create_pyopenssl_sslcontext
    private_key, cert, ca_certs = cryptography.hazmat.primitives.serialization.pkcs12.load_key_and_certificates(
  File "/Users/trenslow/anaconda3/envs/***/lib/python3.9/site-packages/requests_pkcs12.py", line 106, in __init__
    self.ssl_context = create_pyopenssl_sslcontext(pkcs12_data, pkcs12_password_bytes, ssl_protocol)
  File "/Users/trenslow/anaconda3/envs/***/lib/python3.9/site-packages/pyravendb/connection/requests_executor.py", line 43, in initialize_certificate
    Pkcs12Adapter(pkcs12_filename=pfx, pkcs12_password=password)
  File "/Users/trenslow/anaconda3/envs/***/lib/python3.9/site-packages/pyravendb/connection/requests_executor.py", line 51, in __init__
    (self._certificate, self._adapter) = self.initialize_certificate(certificate)
  File "/Users/trenslow/anaconda3/envs/***/lib/python3.9/site-packages/pyravendb/connection/requests_executor.py", line 80, in create
    executor = RequestsExecutor(database_name, certificate, conventions)
  File "/Users/trenslow/anaconda3/envs/***/lib/python3.9/site-packages/pyravendb/store/document_store.py", line 118, in get_request_executor
    RequestsExecutor.create(self.urls, db_name, self._certificate,
  File "/Users/trenslow/anaconda3/envs/***/lib/python3.9/site-packages/pyravendb/store/document_store.py", line 140, in open_session
    requests_executor = request_executor if request_executor is not None else self.get_request_executor(database)

Here's the stacktrace. After the last line it goes into my own code where I'm opening a session with the old client.
Another question for you: How do I initialize the DocumentStore properly with the new client? I would like to only initialize it once and reuse it throughout the rest of my code.
Thanks for the help so far.

Regarding DocumentStore initialization:
https://github.com/ravendb/ravendb-python-client/issues/134#issuecomment-1139590627
Something like here (w/o with to avoid dispose after leaving code block) - you can do that once and store inside your application.
@trenslow You don't have to wait for anything after you call DocumentStore.initialize. You can issue query, play with documents  right after that. Things like database topology will be fetch during before first request automatically.
Since new client is under development and we didn't release new documentation, feel free to ask in case of questions - we will try to help you.

@ml054 The code block you presented above is a little curious, as it seems like you're creating a new database each time you initialize the document store. This is where I got the idea to 'health check' the database after initialization; in this case I mean to check and see if the database exists. If the database doesn't exist, I would attempt to create it using the code you provided above.
Is this the best place to ask questions? Or do you have some sort of discussion board? I wasn't sure where to ask since there's no new documentation for the new client.

Hi,
In example I'm creating database. Of course you can't do that more then 1 time - this was an example of 'some' operation.
You can get list of database names which was created via GetDatabaseNamesOperation command.
def poc():
    with DocumentStore(urls=["http://live-test.ravendb.net/"]) as store:
        store.initialize()
        names = store.maintenance.server.send(GetDatabaseNamesOperation(0, 20))

        print(names)

if __name__ == '__main__':
    poc()

About missing documentation: You can use c#, java or node.js documentation as API tries to mimic as much as possible original client (which is c#). Another great source of information are tests: you can find usages of functions in tests - which is sometimes even more preferred way of learning then reading docs. ;)
For discussions I think it would be best to use: https://github.com/ravendb/ravendb/discussions


Create binary release for this URCap

For our other URCaps we use binary releases (e.g. see here).
See the custom action and workflow used for CI. I usually download the binary from the CI artifacts and add them to the release.

Created a release: https://github.com/UniversalRobots/Universal_Robots_ToolComm_Forwarder_URCap/releases/tag/v1.0


I2C GPS + RTC are not compatible

Check why there is a problem: same address? power problem? pull up resistor?

The only problem is when RTC is used (ON) and GPS is OFF but connected.
Simple solution: leave GPS ON during LOG even if not used (RTC is used instead)


Code for Section 4.4. Quantitative Evaluation of Interpretability

Hi again!
I am trying to run some experiments on my own and was looking for the code that was used in Section 4.4 to create Figure 6. Can I find this somewhere in the repo?
Best regards
Verena

Yes, the code for calculating the concept AUC is the plot_auc_cw function in plot_functions.py. The function will calculate the concept purity (test AUC) for the concept axes in CW module when it's applied to different layers in CNN. It'll print and save the mean and std of the concept purity scores. Before running this, you'll need to make sure you have saved multiple CNN weights with CW applied to different layer, because it will load these different model weights and calculate the score for each of them.
You can also compare it with other baselines by running plot_auc_lm and plot_auc_filter, i.e. the baselines we compared with in our paper. Then you can run the plot_auc function to show these results on the same plot, as shown in Figure 6.
Our code calling these functions are line 522-535 in train_places.py. You may want to just uncomment them, and modify the inputs to run your case.


Replaced throw() with BOOST_NOEXCEPT_OR_NOTHROW

With throw(), Visual Studio 2017 emitted a warning "C26439 SPECIAL_NOEXCEPT". Reproducible at least if code analysis was set to level: "Microsoft Native Recommended Rules".
https://docs.microsoft.com/en-us/visualstudio/code-quality/c26439?view=vs-2017

Even worse - IIRC throw() is going to be removed completely from the standard in c++20

Thank you!


RequestFullScreen for Youtube Videos on Mobile

Hi, is there  a way to play youtube videos on fullscreen when using mobile devices?
Any ideas aside from CSS Hacks? What I want here is if I can connect to the Lity js to fetch the youtube instance to request a fullscreen playback.
Thanks in advance.

This is just the youtube website running inside an iframe and i have no idea if you can control the fullscreen mode. You maybe find something in the youtube docs.

Is there a way that Lity js can get the iframe instance, so we can call the request fullscreen?

You can listen to the lity:ready event and select the iframe from the content via jquery.


Update download.html

Updated the path to the Windows GPG installation to reflect the latest version of Gpg4win: "C:\Program Files (x86)\GnuPG\bin\gpg.exe"

ACK, i've checked this with "gpg4win-4.0.2.exe" (the latest version at this point, see https://gpg4win.org/download.html) in WINE and it installed the gpg.exe in the same path.


Consider bumping the TypeScript target to ES2018 or later

Work Item
Describe the outcome you expect
The TypeScript compiler transpiles some newer syntax depending on the value of target in the tsconfig. Today, this is set to ES2017 for the Fluid Framework repo. Bumping this version to ES2018 would result in features like object spread/rest to no longer be transpiled. If we were able to bump all the way to ES2020, more verbose features like ?. and ?? to no longer be transpiled. In experiments in the internal Loop repo, moving to ES2020 would enable us to ship ~175KB of less JavaScript. Having similar changes in the FF repo would drive that even smaller. Note that we are not ready to move to ES2020 on the Loop side yet, since we need to revisit our supported browser story first.
Approach

Open questions

What is the official supported browser matrix for Fluid Framework?
Should FF ship ES2020 and rely on consumers to use babel to transpile if necessary (it isn't possible to "un"-transpile)?
Additional context

The Loop team has bumped from ES2017 to ES2018 since that's compatible with our existing browser support matrix. This only had modest ~15KB decrease, but it is expected to have no negative impact on our users. We added eslint rules to ensure that no one uses regex features not supported in Safari or older versions of FF: https://eslint-plugin-es.mysticatea.dev/
Acceptance criteria

Fluid Framework publishes a

This should not be closed, @vladsud is this the right issue for tracking this work?

@vladsud any update on this one?

The next major release targets ES2020 due to #15941.


Read this Solution.

For termux users
Replace Last command to ./ighack.sh.
go in ighack.sh file change line no. 43 to ./auto.sh
go in ighack.sh file change line no. 46 to ./manual.sh
go in ighack.sh file change line no. 49 to ./about.sh
go in ighack.sh file change line no. 52 to ./update.sh
go in ighack.sh file change line no. 55 to ./info.sh

I have committed the changes. Do check it


Sample code bug - Use cookie authentication without ASP.NET Core Identity

[EDIT by guardrex to add the metadata]
When running the sample code for "Use cookie authentication without ASP.NET Core Identity" which can be found at AspNetCore.Docs/aspnetcore/security/authentication/cookie/samples/3.x/CookieSample/ a bug has been found.
Once signed in, select the browser's back button and attempt to log in again. The post request isn't handled and  HTTP 400 status code is returned.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: d2229fc6-f8c8-952e-e567-b1d5a463055a
Version Independent ID: b18a015b-914d-f014-f711-120d208904d9
Content: Use cookie authentication without ASP.NET Core Identity
Content Source: aspnetcore/security/authentication/cookie.md
Product: aspnet-core
Technology: aspnetcore-security
GitHub Login: @Rick-Anderson
Microsoft Alias: riande

Hello @eddlilley ... It's best to open an issue using the This Page feedback button+form at the bottom of the English topic. It will add metadata that cross-links the topic and automatically pings the author.

No worries on this one. I'll add the metadata manually to the issue.

Ping @HaoK to say if this is a real 🐞 or just a bad artifact of the back button.

I think this is a case of "The provided anti-forgery token was meant for a different claims-based user". Using the back button means the CSRF tokens for the unauthenticated user are cached, so they no longer match when you go back.
I found a comment where @javiercn confirms this: https://github.com/dotnet/aspnetcore/issues/2882#issuecomment-425253252, for context.

Thank you for contacting us. Due to a lack of activity on this discussion issue we're closing it in an effort to keep our backlog clean. If you believe there is a concern related to the ASP.NET Core which hasn't been addressed, please file a new issue.


CLEWS-33186 conf_interval was not converted into requested unit

Issue is reported as https://grointelligence.atlassian.net/browse/CLEWS-33186
Added unit conversion for confidence interval if exists

Will it be practical to have a unit id in the metadata dictionary as well? Although, when this is merged it will be redundant; it would have been more enlightening before this PR.

Will it be practical to have a unit id in the metadata dictionary as well? Although, when this is merged it will be redundant; it would have been more enlightening before this PR.

@joysaikat I think that is overall a good practice going forward. But to deal with existing entries in fact tables, we have to assume that the unit_id, if applicable, is the same as the one specified in column input_unit_id

@tolothy @joysaikat
When converting the value of conf_interval, we do assume that both data point and its confidence interval are reported in the same unit(input_unit_id). Besides the api client code, this assumptions applies to webapp(balance sheet) as well. So, if this is desired, we can add unit_id to metadata(or should we call it conf_interval_unit_id since metadata may contain other attributes that are irrelevant to conf interval?).

by the way, do we need to keep both conf_interval and confInterval? confInterval is used by webapp, not sure if it's necessary for api client requests


Fix minor bugs with date type custom profile field.

Fixes #11453
Testing Plan:
Tested with both user settings and org settings -> edit user settings.
GIFs or Screenshots:

This is great, merged, thanks @YJDave!


HLS output playing problems

Running live i am seeing problems with VLC.
The command line is the standard '-O hls -l 5 -d 12 --playlist 1000.m3u8 1000-.ts'
Now the problem is the m3u8 contains the 5 segments, but it contains the segment being created.
so 1000.m3u8
#EXTINF:11.90
1000-000000.ts
#EXTINF:11.90
1000-000001.ts
#EXTINF:11.90
1000-000002.ts
#EXTINF:11.90
1000-000003.ts
#EXTINF:11.90
1000-000004.ts
Files sizes
1501231 1000-000000.ts
1563232 1000-000001.ts
1812342 1000-000002.ts
1672623 1000-000003.ts
89000 1000-000004.ts
So can something be done to only use "complete" segments in the list.

Hi @joolzg
I cannot make tests this week since I am traveling. However, looking at the code, it seems that:

A segment is added to the playlist only after closing it (this is the intended behaviour).
If a segment contains PCR's, its duration in the playlist (EXTINF) is based on the PCR values.
If there is no or not enough PCR's in a segment, its duration in the playlist (EXTINF) is always set to the target duration.

See here
In your case, based on the ratio between file sizes, the duration of the last segment is approximately 0.6 second. So, there is probably not enough PCR inside it.
In that case, if there is a previous segment with a known bitrate, I should probably use the previous bitrate to extrapolate the duration of the short segment.

When you could look at this, but as you see from my debug output the last segment in the m3u8 is still being written.

I do not see debug output. I see the content of the playlist and the file sizes. There is an inconsistency in the fact that the playlist says that segment 4 has the same duration as other segments while its file size is 10 times smaller. From the code (to be confirmed by tests), I would say that

the process is complete,
the last segment is complete and closed,
its size is incorrect in the playlist

If you have debug log which shows something different, please post it here.
I will test next week-end if necessary.

Sorry the times are copied by me and the last is a mistake
I can try running again and see of i can replicate.
Question, do you write the M3U8 before the TS?


Feature/mx 1556 extract grippe web data

PR Context

Added

grippeweb extract

Changes

move MSSQL Server authentication to general settings

Deprecated

Removed

Fixed

Security

Nicely done, nothing major to fix just few clarifications.
Tests are all clear, but I get ..Documents\\workspace\\mex-assets\\mappings\\__final__\\test_mapping\\access-platform.yaml when I run grippeweb. I have already merged your mex-assets grippeweb branch and decrypted fresh envs. Am I missing some mapping files somehow in my mex-assets?

I couldn't reproduce this error. But actually, the mex-assets settings still needed to be changed to _final folder. Can you try that out? And if your error persists, maybe we can have a look at it together?
https://bitbucket.rki.local/projects/MF4/repos/mex-assets/pull-requests/152/overview

I couldn't reproduce this error. But actually, the mex-assets settings still needed to be changed to _final folder. Can you try that out? And if your error persists, maybe we can have a look at it together? https://bitbucket.rki.local/projects/MF4/repos/mex-assets/pull-requests/152/overview

so if I run pdm run grippeweb and put a breakpoint at this line: https://github.com/robert-koch-institut/mex-extractors/blob/5924b502f347138598c8d8aaffab591d34992c9f/mex/mapping/extract.py#L21
I get WindowsPath('C:/Users/alik/Documents/workspace/mex-assets/mappings/__draft__/grippeweb/access-platform.yaml')
__draft__ is there instead of final, where is it coming from? and why isnt it going to final by default?

I couldn't reproduce this error. But actually, the mex-assets settings still needed to be changed to _final folder. Can you try that out? And if your error persists, maybe we can have a look at it together? https://bitbucket.rki.local/projects/MF4/repos/mex-assets/pull-requests/152/overview

so if I run pdm run grippeweb and put a breakpoint at this line: https://github.com/robert-koch-institut/mex-extractors/blob/5924b502f347138598c8d8aaffab591d34992c9f/mex/mapping/extract.py#L21
I get WindowsPath('C:/Users/alik/Documents/workspace/mex-assets/mappings/__draft__/grippeweb/access-platform.yaml')
__draft__ is there instead of __final__, where is it coming from? and why isnt it going to __final__ by default?

it comes from the .env, we should merge https://bitbucket.rki.local/projects/MF4/repos/mex-assets/pull-requests/152/overview
then pull and decrypt again


rsync: rename "/.git/objects/" -> ".git/objects/*": Permission denied

I cannot reproduce it at the moment and i dont know exactly in with situations this error appears. But during my work with my code and after severals runs of gitlab-ci-local i am not able to start the pipeline again:
rsync: rename "/mnt/c/Users/UserName/Code/.gitlab-ci-local/builds/.docker/.git/objects/d6/.b7ef32c8478a48c3994dcadc86837f4371184d.0UT1kg" -> ".git/objects/d6/b7ef32c8478a48c3994dcadc86837f4371184d": Permission denied (13)
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1207) [sender=3.1.3]

Workaround for me is to delete the whole .gitlab-ci-local/ folder. After that is works again. Have to do that about 3-5 times a day.

How your .git folder i beyond me.
But none the less, I'll try adding it to rsync --exclude and see if that helps you out @ck-trigfb

Here is the rsync --exclude .git/ change.
https://github.com/firecow/gitlab-ci-local/commit/8d84502b691298beed5010afd919d5a3ad37fcf4
Just reopen, if you are still experiencing this issue. @ck-trigfb


Update index.html

Removed the problematic code snippet from footer

Is there any problem with the changes I made ? If so pls do inform and I will work on it

#303 Solved


align master

What changes were proposed in this pull request?
aaaa
How was this patch tested?
aaaa
Please review https://spark.apache.org/contributing.html before opening a pull request.

Can one of the admins verify this patch?


cpu over 100%

Describe the bug
we run apm-agent at test sever, use jmeter test http request about 70/s, but after 1 day,  java cpu usage over 100%, and java application has been killed
top command:

top -Hp command:

below is config:

Closing as this should be fixed via the linked PR. It would be cool if you could confirm. If it's not working for you, we'll re-open this.

Just would like to chime in here, on version 1.3.0 we saw approximately 3x CPU load compared to no APM in place. Application performance was not affected.
Now, with a build made yesterday from master (1.3.1-SNAPSHOT), we are seeing negligible performance overhead.
Great work all, Keep it up, Thank you!

That's great to hear! Thanks for the feedback.


Combat data rates for The Battlefield

Handle monsters that only appear after a fixed number of kills
Handle heroes that appear in ranges, return -1 as the rate to denote that the hero is possible but otherwise doesn't affect normal encounter rates (superlikelies with a very low chance)
Return boss as the only encounter when battlefield is cleared

man they did not make this data easy to find and it looks like there isn't fratboy data either

someone sent me a spading spreadsheet, I'll implement the data using that


⚠ Bofrost.de has degraded performance

In 8e35044, Bofrost.de (https://www.bofrost.de) experienced degraded performance:

HTTP code: 200
Response time: 1007 ms

Resolved: Bofrost.de performance has improved in 9d5bd82.


Feature request

Please dont get this wrong, pico is already good as it is, i'm just asking 2 QoL features i sincerely miss since switched from utorrent.
One is the ability to open/run file straight from the torrent window, like in utorrent where i torrented some animes and i can just double click the file in the "file tab list" and the video start playing.
The other one is the ability to rename file while in torrent dialogue option when you clicked torrent/magnet link, some animes are still in japanese characters and in utorrent i can just copypaste the english name inside the torrent dialogue window and the file names changed.
Please consider these 2 features, best regards to pico.

+1, I will switch from qBittorrent with high probability after these features


Added resizable split panes

Needs resizable treeview but will leave that to Sander

Added commit with CSS variable refactor, color adjustments


PrimeNG setup

Setup PrimeNG. PrimeNG comes with a lot of angular components.

Installed PrimeNG, PrimeIcons, and PrimeFlex and imported their css files into the styles.css in the app directory.


sos status show the uname of the machine

Currently when I run sos status for a task on the cluster, I can find the queue it runs under. However I don't know the node it was submitted to. This is sometimes quite important because when I want to reproduce an erroneous behavior I would like to send it to the exact node it failed initially. (this was in fact the case for one of our recent mysterious failure that took us a while to pin it to a hardware malfunction in a particular node). Is there a way to retrieve this information from SoS task signatures?

There is no built-in support for this since sos status depends on information saved by task instances to .task files, and no information about computing node is saved.
However, this could potentially be fixed by something like
task:
sh:
    echo $HOSTNAME
    ....

if computing nodes has this environment variable.

I think at the high level, the question is how to track which computing node a task was executed at, without letting users worry about it.  On slurm for example,
squeue -t R --format="%.20i %.20j %.5t %.5C %R"

shows the list of nodes for the jobs.
In SoS , having the HOSTNAME information in the status output is what I can think of. It should be robust enough to implement as
import platform
platform.node()

although other approaches should be equally okay as long as this can be traced easily.

The echo command or anything works for slurm could be inserted into the task template before the sos execute line.

Thank you @BoPeng I'm fine to close this ticket if there is nothing we can possibly do at the time when task instance is saved.

In my template defined in hosts.yml`, I have things like
#PBS -l
#PBS -v
#PBS -o /home/{user_name}/.sos/tasks/{task}.out

module load {' '.join(modules)}
{command}

so module load is something added by the template that is executed before sos execute (the command part).
if you add the echo line there, something like
#PBS -l
#PBS -v
#PBS -o /home/{user_name}/.sos/tasks/{task}.out

echo $HOSTNAME
{command}

the hostname of the computing node would be written to /home/{user_name}/.sos/tasks/{task}.out, which will be available in the outputsection of the output of sos status -f. Is this what you were looking for?

Oh yes sorry I should have mentioned that I thought of it as well and have just put it into my template. As you can see, my template has these files saved to the current directory where the sos run command is executed. Perhaps a  better practice is to write these files to ~/.sos? Usually files under ~/.sos are forgotten and the folder gets larger, and that's why I would like to have it consolidated to the sos status command under ~/.sos  so I don't have to manage these err and out files.

The .out and .err files are "absorbed" into .task files when the tasks are completed (and the .task files will be removed after a few days or with sos purge). If you really want to write such information to somewhere else, something like echo $HOSTNAME > $HOME/{task}.host.id could do.


Set SparseCheckoutPath to buildenv/jenkins/

In order to reduce the space usage on Jenkins master, set
SparseCheckoutPath to buildenv/jenkins/ on master. The git full checkout
will happen on slave machines.
Fixes: #1895
Signed-off-by: lanxia<EMAIL_ADDRESS>

References:
https://jenkinsci.github.io/job-dsl-plugin/#path/javaposse.jobdsl.dsl.helpers.ScmContext.git-configure
https://stackoverflow.com/questions/25943651/sparse-checkout-with-jenkins-dsl-plugin

Grinder/9018
Space used in jobs/Grinder_testList_1/workspace@script is 61M (vs before 174M)
Cannot test at Adopt Jenkins as the script needs to be approved (Grinder/3605)


AltheaC_Win_19_08_05

New blog post for 8/5/19 Errata release

Docs Build status updates of commit 5897094:
:x: Validation status: errors
Please follow instructions here which may help to resolve issue.

File
Status
Preview URL
Details

:x:Error

Details

[Error]

Cannot sync git repo to specified commit because branch AltheaC_Win_Blog_19_08_05 has been deleted or has been force pushed: fatal: Couldn't find remote ref AltheaC_Win_Blog_19_08_05

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Subset Sum problem of DP

A Dynamic Programming Question. Plz Add a hacktoberfest label to it.

Modified!!

i have modified the commits I had made.. @siddharth25pandey

Good luck :) @siddharth25pandey


[TIR] Update LowerTVMBuiltin to use Optional

The member variables device_type_ and device_id_ are tracked during LowerTVMBuiltin, are initially undefined, and are checked before use.  This is the usage pattern expected for Optional<T>, but these variables previously had the type PrimExpr.
This commit updates these to Optional<PrimExpr>, and uses the helper function GetDeviceMethodName to add more detail to the error messages when they are undefined.

@tvm-bot rerun


Replace placeholder texts with real descriptions of benefits

Now we use placeholders "Paragraph of text beneath the heading to explain the heading.":

Resolver in https://github.com/larajournal/larajournal.github.io/pull/22 by @alone784


Feature/math test

Types of PR

[ ] New Features
[x] Upgrade of existing features
[x] Bugfix

Link to the issue
Description

Add test cases in math test.
Remove unused message types.
Fix problems in calculating maximum curventure.

How to review this PR.
please check passing all test cases.
Others

Yet another missing typo


Load low resolution previews, or progressive JPEGs preemptively

Find myself loading a channel, then scroll, then wait for too long to see anything. Would be nice to see low resolution previews or for images to start loading before I scroll to them somehow so I can orient myself quicker.

http://blog.patrickmeenan.com/2013/06/progressive-jpegs-ftw.html

We use an image proxy to get different image sizes on the fly. Generating a progressive JPEG on request right now looks like too technically difficult for the very subtle wins.


Error: cannot traverse unknown node type: JavaScript

When the coffescript contain javascript expression `xxxxxx`, decaffeinate throw the error "cannot traverse unknown node type: JavaScript"
Example code:
`import Ember from 'ember'`
`import Resolver from 'ember/resolver'`
`import loadInitializers from 'ember/load-initializers'`
`import config from './config/environment'`
Ember.MODEL_FACTORY_INJECTIONS = true

App = Ember.Application.extend
  modulePrefix: config.modulePrefix,
  podModulePrefix: config.podModulePrefix,
  Resolver: Resolver

loadInitializers(App, config.modulePrefix)

`export default App`

Fixed in v1.13.0.