Quanity Screenshot misalignment, leads to incorrect parsing

Current Behavior
it looks like the quantity screenshot is sometimes misaligned, causing
-- wrong quantities
-- "Failed to parse quantity for "
This misalignment doesnt seem to happen when scanning

first page
last page
last row in reverse

but it does consistently happen in the rest of the cases
This is both in Character Development Items and Materials

Expected Behavior
The scanner to correctly exports the data
Reproducing a Behavior
3840x2160 Fullscreen Resolution
Scan with either Character Development Items and or Materials enabled
Device OS
Windows 10
Genshin Impact Version
3.8
Inventory Kamera Version
1.3.9
Screen resolution, screen mode, and UI scale
3840x2160 Fullscreen
Additional notes and remarks
No response
Evidence
logging4kFS.zip

.good export
logging folder

https://github.com/Andrewthe13th/Inventory_Kamera/assets/47488157/86512729-bea7-465b-ae1b-3a6022e315e2

screen recording, showing part of the first and second page

items that were falsely quantised or failed to parse in the first two rows of 'page 2' (see video)
NameOfItem,CorrectQuanity,ParsedQuanity,ParsingFailed
RecruitsInsignia,603,60,
GoldenRavenInsignia,22,9,
TreasureHoarderInsigina,488,1,
ShimmeringNectar,98,0,X
WhopperflowerNectar,483,842,
SturdyBoneShard,68,0,X
FragileBoneShard,357,57,
FamedHandguard,2,0,X
OldHandguard,321,291,
ChaosOculus,12,10,
ChaosGear,862,0,X

Preflight Checklist

[X] I have checked for similar issues in the issue page, and I have not found any similar to mine.
[X] I am using the latest version of the scanner.
[X] I tried setting the scanning delay to maximum, and it still doesn't work.
[X] I have attached the video recording to the bug report.
[X] I have attached the error log to the bug report.
[X] I am available to later explains the issue.
[X] I have disabled all screen filtering software or plugins (i.e. HDR, Image Sharpening) while scanning.
[X] I use default in-game keybindings or have configured keybindings for the scanner.

Tested again in 4.0 and its mostly the same as described before, except that the first page now is also affected, and the overall error rate (both incorrect and failed) feels a lot higher to the point where it failing is the norm

i'm having the same issue with my game at 1920x1080 fullscreen, and it seems like its always the same items.
for example: hero's wit, chaos oculus, crown of insight. always have the wrong value, before my last crown i had 17 and it was counting 117, and now i have 18 and its only counting 1 every scan.

This is a duplicate of the pinned issue. I don't have much interest in improving material scanning much at the moment


shuffle and sample both used in SuffixGenerator.generate

In SuffixGenerator.generate, there is this code:
start = site[0]

site[1].shuffle.each do |alt|
  start, alt = site[0], site[1].sample
  ...
end

The shuffle and and the sample seem to be performing the same job and it could be turned into:
start = site[0]

site[1].shuffle.each do |alt|
  ...
end

with no change (other than the obvious pulling from a random source one less time).

right you are. must've been left over from some refactoring


chore: release 1.10.1

:robot: I have created a release *beep* *boop*
1.10.1 (2023-05-17)
Bug Fixes

keq crashes when the response body does not match content-type (f0bc15e)

This PR was generated with Release Please. See documentation.

:robot: Release is at https://github.com/keq-request/keq/releases/tag/v1.10.1 :sunflower:


Deprecating execute_bo_with_waitlist for XRT >=2.11.

Raise a RuntimeError exception when execute_bo_with_waitlist is called,
this method depends on xclExecBufWithWaitList which is deprecated
since XRT >= 2.11
Fix Xilinx/PYNQ-DEV#358

Codecov Report

Merging #1354 (4847507) into image_v2.8 (0cdf6b9) will decrease coverage by 0.01%.
The diff coverage is 0.00%.

:exclamation: Current head 4847507 differs from pull request most recent head 122a27e. Consider uploading reports for the commit 122a27e to get more accurate results

@@              Coverage Diff               @@
##           image_v2.8    #1354      +/-   ##
==============================================
- Coverage       46.49%   46.47%   -0.02%
==============================================
  Files              28       28
  Lines            4955     4957       +2
  Branches          971      972       +1
==============================================
  Hits             2304     2304
- Misses           2594     2596       +2
  Partials           57       57

Impacted Files
Coverage Δ

pynq/pl_server/xrt_device.py
29.21% <0.00%> (-0.16%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 0cdf6b9...122a27e. Read the comment docs.

after these 3 PR accepts - we'll create a v2.8dev0 source distribution to help datacenter Alveo users


Import or manually create postal codes

This is one of the lowest quality guidance/instructions/help I have ever seen in MS blog is offering regarding Dynamics 365F&O. Contributor is knowingly or unknowingly misleading the community. There is no co-relation between the contents as stated in this blog "Import ZIP/postal codes" with real work to be done if any one wanted to import USA Zip code to Dynamics 365 F&O.  I suggest contributor to put it down or/and try yourself to import USA Zip code/postal codes to Dynamics 365F&O and see if you can follow your blog and import it!!! This blog should/must be modified as soon as possible.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: c87cdf04-f506-4d3b-aefa-0983eb5699cd
Version Independent ID: 294881af-ec4d-86d3-d233-8be9067b8559
Content: Import or manually create postal codes - Finance & Operations | Dynamics 365 | #MSDyn365FO
Content Source: articles/financials/localizations/emea-import-create-postal-codes-manually.md
Service: dynamics-ax-applications
GitHub Login: @EvgenyPopovMBS
Microsoft Alias: epopov

@VavaniSarmah, thank you for submitting your feedback.
@EvgenyPopovMBS, please look into updating this topic based on the feedback.

Thanks, we will look at this.
Just one comment for now: the article is located in the Localization and regulatory features folder for Europe, and thus is not supposed to cover the procedure for the USA.

@EvgenyPopovMBS and @sericks007 - your comments are still not the answer that community is looking for. Let me ask you straight - Can you point me to an article that is explaining how to import USA zipcode into dynamics 365 Finance and Operation or do you know if is there any relevant article on this?

I found a solution and able to import USA Zipcode into Dynamics 365 F& O
Steps to import USA Zipcode into D365FO.pdf
. Explaining the steps below -
Pre-requisite
A.	A.	Make sure that you have the list USA States already created in the system.  (I have another process to import all the states if you don’t want to create manually)
B.	Download the USA ZipCode list from reliable source (I downloaded from here www.pier2pier.com/links/files/Countrystate/USA-Zip.xls) – (Because USA has about 74000 zipcode, I split the downloaded excel file into two smaller files.)
C.	Also I did little modification to the excel file as shown below. Keep only following four columns - ZipCode -City Name - StateCode - CountryName.
Now, goto D365F&O Data Management
Step 1: Create an Import Process (Name like ImportUSAZipCode") under D365F&O "Data Management"
Step 2: Source data format as "Excel"
Step3: Entity name as "Postal codes V3" - which is "LogisticsAddressPostalCodeV3Entity" in D365F&)
Step 4: Keep "Use sample file" option ON
Step 5: Keep "Skip staging" option ON
Step 6: Select "Skip staging = "Full push only"
Step 7:  Keep "Truncate entity data" option as "NO"
Step 8: Select Upload import files - select your ZipCode file that you downloaded as stated in step B above
Step 9: Once uploaded the file Click "View Map" and make sure mapping correct as follows
9.a.  City -->CityID
9.b. County -->CountryRegion
9.c.  State --> StateID
9.d. ZipCode -->ZipCode
(At this point if you want you can save the mapping)
     (At this point if you want you can save the mapping)

Step 10: Once mapping is done, click "Import" menu item in the menu bar
Step 11: If successful, you should see Zipcode data in the staging table
Step 12: Click “View Staging Data”
Step 13: Click “Validate all” to validate the Staging data - Make sure all the rows validated correctly
Step 14: Click "Copy data to Target" menu item in the menu bar. You should see pop-up on your
right hand screen.
Step 15: Click "OK"
Step 16: Click "Run" menu item in the menu bar to run the process (ImportUSAZipCode)
Steps to import USA Zipcode.pdf
I did it myself following these steps and is working. If anybody needs any more information, please feel free to contact me at<EMAIL_ADDRESS>


Update test HTML files

Updated by simply going to http://rosettacode.org/wiki/Hello_world/Text and http://rosettacode.org/wiki/Longest_Common_Substring and copy- pasting the HTML from the Chrome network tab.
Note that this produces slightly different results than, for example:
curl -o spec/support/hello_world_task.html http://rosettacode.org/wiki/Hello_world/Text

Since this is a Chrome extension, I figure that copy-pasting from the results that are returned to Chrome is the more realistic way to simulate the scenario under test.

I wonder, is there some better way to do this (that doesn't involve making live/real HTTP requests)? I suppose that, by the very nature of that requirement, there is not, really?


Add onUpdate() to HandlerDetails

Just like EVentDetails has it's ow onUpdate(), HandlerDetails should too since it could be updated and it is it's own context.

If we want to push the effort to make HandlerDetails be alike unto it's parent class EventDetails we should go as far as also adding an option: saveInactiveHandlerDetails.  When a handler has been removed.
If it makes sense, I haven't given it much thought.

I must've forgot to close this as it has been resolve for a while in 2c8f7ef.  Although looking through the source code it looks like the test is incorrect I'll go ahead and close this (since It's already in the commit history and indeed completed) and mention that I'm currently working on fixing that test.

Closing this without fulfilling the feature request, as it's not super necessary here's why:

As of now there's only 1 of 3 properties which is dynamic and would therefore makes sense to have an onUpdate()

parent and arity are both set on ListenerDetails instance created -- changed once, and never more
prevStackTrace is the only dynamic one and it could easily be retrieved with this here:

// somehow set evDetails and handler
evDetails.onUpdate(function (evD) {
 var newStackTrace = evD.getHandlerDetails(handler).prevStackTrace;
 //  do something with newStackTrace
});

This works b/c prevStackTrace is always changed whenever there's an update on the event object  and so one can keep track of it that way.

QED There's truly no need for a deditaced HandlerDetails.prototype.onUpdate().


CI pipeline config update

Upgrade rest-api-specs-scripts version that contains the version upgrade of oav.

/azp run automation - sdk

Can one of the admins verify this patch?


Add support for React 17

Closes #558
React 17 introduced very few breaking changes, and Simplebar works fine on it without any modification.
As mentioned in #558, onScroll event handlers must now be attached to the scrollableNodeProps rather than the <Simplebar> element itself, because React 17 no longer bubbles the onScroll event. I didn't fix that problem because it's not really an issue with simplebar, it's just how React 17 works.

This should not be accepted, you ignored the real issue instead of solving it.

As I mentioned, I don't think it's a real issue. The documentation for Simplebar never claims that attaching an onScroll handler to the base element will fire when the scrollable node scrolls. The only reason it did was because React pre-17 bubbled scroll events. Now that they don't bubble, it makes sense that you have to attach the handler to the actual scrollable node. If you are using onScroll handlers, fixing these issues should be part of your migration to React 17, not (in my opinion) something that Simplebar should work around.
If the project maintainers disagree I'd be happy to update this to make onScroll on the <Simplebar> element work.

Can this please be merged? @mogzol is right, in that this is not an issue this library should solve. I'd like to use this library for my website, but since I'm using react 17 I can't yet.

Hi,
Thanks for the clarification. I agree with the statement here. Sorry for the late merge!


Blog templates based on GitHub Pages

I am looking for a turn key template like the example blog.  - remove spaces in the url   "dm rn etlist.cf"
Blog templates for on GitHub Pages.

@DMRcodeplugs  Sorry, I do not understand the degree of your doubt, can you be more specific?

I am looking for different templates, for github pages.  I am new an trying to build a user interface.  I am hoping to mod an existing template.  Here is my hopes that a link or page exist that list all the available github pages.
I am looking a platform that list in alphabetical order page number one, and link to subage 3 columns by 6 rows.

Unfortunately, this is not the purpose of this template. This feature of automatically fetching your GitHub Pages and listing them alphabetically on a page, I believe are not in reach of a static site manager project like Jekyll, because the programming is limited to this feature. You would have to use advanced programming logic for an external search, and Jekyll programming is done for local searches on the project.
What you can do, is manually in the markdown file of your page through the permalink. For example:

layout: page
title: My title of page 1
permalink: /page1/

Where "page1" is the name of the repository containing a GitHub Pages (gh-pages).
Practical example: https://williamcanin.me/jekyll-spotify-plugin/
The "https://williamcanin.me" link is my main page that uses a GitHub Pages, and I have another repository in GitHub called "jekyll-spotify-plugin" that contains a branch "gh-pages" (Github Pages), which is another page.

thanks


Feature request: Thumbnails "preview"

Hello
tested version: 0.9.12
I would like to use pdfrankenstein to annotate pdf with 400 pages
unfortunately thumbnails are to small to identify if the page is the correct one or not
Having a "preview" pane would be terrific
user experience could be:
having a thumbnail pane and a preview pane
when a thumbnail is selected, the page is shown enlarged in the previous pane
when navigating with keyboard arrows through the thumbnails in the thumbnail pane, the preview in the preview pane is updated accordingly
this would permit to rapidly navigate through pages and target the right ones without having to open all of them one by one opening/closing inkscape until finding the right ones.

Thanks for the suggestion. Unfortunately, I have since moved to MacOS. As such, I no longer work on new features for this. Do feel free to submit a PR.


Are invalidated columns tracked properly during data file creation?

Apache Iceberg version
None
Please describe the bug 🐞
In the data_file_statistics_from_parquet_metadata function, we track the invalidate_col set which is largely present to mark when a column row group does not have statistic set, therefore we can not know the overall statistics accurately. I have a concern with the current implementation that I would like to hear those with more experience in this fields opinion on.
The current implementation resets the invalidated columns every row group while only deleting the invalid columns after all row groups have been processed. I can imagine a scenario where the first row group has no statistics, but the last row group does. In this scenario I think invalid iceberg metadata would be generated which includes metrics for columns that do not contain statistics in all groups. I think the fix for this is to hoist the invalid columns set out of the loops to avoid resetting the variable every row group.
currently:
def data_file_statistics_from_parquet_metadata():
    for r in range(parquet_metadata.num_row_groups):
        invalidate_col: Set[int] = set() # reset every row group
        for pos in range(parquet_metadata.num_columns):
            if column.is_stats_set:
            else:
                invalidate_col.add(field_id)

    for field_id in invalidate_col:
        del col_aggs[field_id]
        del null_value_counts[field_id]

proposal:
def data_file_statistics_from_parquet_metadata():
    invalidate_col: Set[int] = set() # moved so now tracks for whole file
    for r in range(parquet_metadata.num_row_groups):
        for pos in range(parquet_metadata.num_columns):
            if column.is_stats_set:
            else:
                invalidate_col.add(field_id)

    for field_id in invalidate_col:
        del col_aggs[field_id]
        del null_value_counts[field_id]

Hey @cgbur that's a great point that you're making here. I don't think this is taken into consideration, and might even lead to invalid data. Did you encounter this in practice, if so, do you know how to reproduce this?
The statistics are very fundamental to Iceberg, and having no statistics will introduce a lot of inefficiency in query planning and actual data processing (the file will be included in every query plan).

I have not come up with a reproducible example but discovered this when I found a bug in my code because pyarrow does not write stats for columns where all the values are null. I suspected that if a row group is null then it may do the same, but in that case it still writes out stats. I think whether you should write out stats for all null columns is an issue for that crate.
I do think its valid in the parquet spec to write stats for column A in row group 0 but not in row group 1 etc.  I can not find it in the documentation of the spec but have no reason to believe this is invalid. In all likelihood, none of the current big writers do this. However, I do think the current behavior of reseting every row group and only using the results from the last row group is incorrect and should likely be changed. Currently stats are invalidated for a column if the last row group has no statistics, when I think the intention was to invalidate a columns stats if any of the row groups for that column has no statistics.


refactor(transformer/logical-assignment-operator): use ctx.clone_identifier_reference

[!WARNING]
This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

#5014  👈
#5013
#5012
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @Dunqing and the rest of your teammates on  Graphite


Setup Pi 3 in DSL to use in Kitty.

We need to get the Pi 3 in the dsl setup with a raspbian installation and the right networking configuration.

Pi3 now running in AP mode on its internal wifi. IP address is <IP_ADDRESS>.
The USB dongle uses an older driver and didn't want to work with hostapd. I suggest we buy one the same as Dewi (RT5370).


[RESOLVED] High ICMP ping response time

Problem started at 02:08:14 on 2023.07.17
Problem name: High ICMP ping response time
Host: MF-FG
Severity: Warning
Operational data: Value: 162ms
Original problem ID: 32667
Event details in Zabbix: http://<IP_ADDRESS>/tr_events.php?triggerid=23132&eventid=32667

Problem has been resolved in 1m 0s at 02:09:14 on 2023.07.17
Problem name: High ICMP ping response time
Host: MF-FG
Severity: Warning
Original problem ID: 32667


[Feature Suggest] Tensor Parallellism for Accelerating LLM

Dear Author,
Your contribution is critical for the open-source community. The distributed-llama repo has implemented tensor parallelism from scratch. And the result is amazingly significant. However, there are still improvements that could be made. Because of my poor coding ability, not able to make improvements myself, I hope you can look at my suggestions below.
Challenge: root node's special task and synchronization
When I run the repo version '0.1.0', I find that the softmax operations in MultiHead are conducted on the root node only. This operation costs a significant portion of the total time. Second, the synFfnA and synFfn2 functions also cost a lot of time.
Mature solutions
In fact, these challenges have been found in this paper:  https://arxiv.org/abs/1909.08053. Its solution is shown in the image:

It conducts attention mechanism(softmax) on every worker. Second, the matrix segmentation direction is using column segment and row segment in two consecutive matrices, thus reducing to one synchronization operation instead of two.
If you are willing to make further improvements to the repo, the following is the mature solution for every component of llama2 using tensor parallelism and sequence parallelism.
https://pytorch.org/tutorials/intermediate/TP_tutorial.html
However, it's implemented in Python, and you will be the first one to implement the solution in C++.
Thanks for your contribution!!!
Best Regards

Just as a supplement, the figure shows detailed time costs by the aforementioned function. As you can see how much they cost.

Nice measurments! It seems multiheadAtt is super slow.
@zhengpeirong please check the 0.3.1 version. Now all tasks are executed in parallel so it should be a bit better.

@b4rtaz The 'qkv' has been reverted. Do you plan to deal with this issue? Not only the 'MulHead' costs time, but also the 'Finalize' costs a big portion of time.

@zhengpeirong yes I know. The qkv seems be quite good optimalized if you look at the rest layers. Still the qkv may be improved in this way as you suggested in the first post. I didn't have time to read it yet.
With the finalize layer is that problem, the output of this layer is large (vocabSize) and I think it's not a good idea to synchronize it. But maybe it could be optimised in this way that a worker would use the sampler on slice of own output, then the root node could merge it somehow. Different samplers would require a different logic for merging, but it looks doable (for example sample_argmax looks super easy).
Yes, I want to keep working on this project. More hands are welcome. :-)

@b4rtaz Thanks for your persistence and endeavor.

The qkv can be optimized, and all you need to read is the "3. Model Parallel Transformers" of the paper "Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism".
The finalize can be optimized as your design.
The transfer time for the FFN layer can be reduced from 2 to 1 by utilizing the method in the paper "Megatron-LM".

If you combine all those mechanisms, the non-parallel functions will be optimized! Here is the draft workflow:
TransformerArch buildLlama2Arch(TransformerSpec* spec) {
    TransformerArch a;

    // Inference

    a.I(sendPoke, TASK_TYPE_TRANSFER);
    for (int i = 0; i < spec->nLayers; i++) {
        a.I(llamaRmsAttNorm, TASK_TYPE_INFERENCE); // Combine the existing llamaRmsAtt and llamaRmsAttNorm
        a.I(llamaQuantizeRmsAtt, TASK_TYPE_INFERENCE); // Quantization
        a.I(llamaSyncRmsAtt, TASK_TYPE_TRANSFER); // Sending
        a.I(llamaQkv, TASK_TYPE_INFERENCE); // Compute Q K V
        a.I(llamaMultiheadAtt, TASK_TYPE_INFERENCE); // Merge kv-cache, add RoPE encoding, compute a part of multi-head attention locally
        a.I(llamaAttOutput, TASK_TYPE_INFERENCE); // Worker computes W_O matrix
        a.I(llamaQuantizeAtt, TASK_TYPE_INFERENCE);
        a.I(llamaSyncAtt, TASK_TYPE_TRANSFER); // First communication time-consuming
        a.I(llamaDequantizeAtt, TASK_TYPE_INFERENCE);
        a.I(llamaMergeAtt, TASK_TYPE_INFERENCE); // Merge all attention matrices
        a.I(llamaRmfFfn, TASK_TYPE_INFERENCE);
        a.I(llamaRmfFfnNorm, TASK_TYPE_INFERENCE);
        a.I(llamaQuantizeRmfFfn, TASK_TYPE_INFERENCE);
        a.I(llamaSyncRmfFfn, TASK_TYPE_TRANSFER);
        a.I(llamaFfn, TASK_TYPE_INFERENCE); // Compute SwiGLU activation
        a.I(llamaFfn2, TASK_TYPE_INFERENCE); // Compute the second FFN
        a.I(llamaQuantizeFfn2, TASK_TYPE_INFERENCE);
        a.I(llamaSyncFfn2, TASK_TYPE_TRANSFER); // Second communication time-consuming
        a.I(llamaDequantizeFfn2, TASK_TYPE_INFERENCE);
        a.I(llamaMergeFfn2, TASK_TYPE_INFERENCE);
        a.I(llamaNextBlock, TASK_TYPE_INFERENCE);
    }
    a.I(llamaRmsFinal, TASK_TYPE_INFERENCE);
    a.I(llamaRmsFinalNorm, TASK_TYPE_INFERENCE);
    a.I(llamaLogits, TASK_TYPE_INFERENCE);
    a.I(llamaQuantizeLogits, TASK_TYPE_INFERENCE);
    a.I(llamaSyncLogits, TASK_TYPE_TRANSFER);
    a.I(llamaDequantizeLogits, TASK_TYPE_INFERENCE);
    a.I(llamaMergeLogits, TASK_TYPE_INFERENCE);

    // Worker

    for (int i = 0; i < spec->nLayers; i++) {
        a.W(llamaSyncRmsAtt, TASK_TYPE_TRANSFER);
        a.W(llamaQkv, TASK_TYPE_INFERENCE); // Compute Q K V
        a.W(llamaMultiheadAtt, TASK_TYPE_INFERENCE); // Merge kv-cache, add RoPE encoding, compute a part of multi-head attention locally
        a.W(llamaAttOutput, TASK_TYPE_INFERENCE); // Worker computes W_O matrix
        a.W(llamaQuantizeAtt, TASK_TYPE_INFERENCE);
        a.W(llamaSyncAtt, TASK_TYPE_TRANSFER);
        a.W(llamaSyncRmfFfn, TASK_TYPE_TRANSFER);
        a.W(llamaFfn, TASK_TYPE_INFERENCE);
        a.W(llamaFfn2, TASK_TYPE_INFERENCE);
        a.W(llamaQuantizeFfn2, TASK_TYPE_INFERENCE);
        a.W(llamaSyncFfn2, TASK_TYPE_TRANSFER);
        a.W(llamaNextBlock, TASK_TYPE_INFERENCE);
    }
    a.W(llamaLogits, TASK_TYPE_INFERENCE);
    a.W(llamaQuantizeLogits, TASK_TYPE_INFERENCE);
    a.W(llamaSyncLogits, TASK_TYPE_TRANSFER);

    return a;
}

I hope this repo can catch up with the state-of-the-art algorithm as soon as possible~~

The optimized result will be only 72% of the original generated time!!! It's 1.39x acceleration than this version.
I have roughly computed the optimized result. Specifically, the main transfer time only happens twice and the workload for the root node is divided among 4 workers.

@zhengpeirong this is just a guess, have you proved that by any implementation?
Currently I noticed a problem with the rope layer, it's not easy to split it, because to calculate the output of this layer we need:
Output digits <0; kvDim) = q & k
Output digits <kvDim; dim) = q

So the current implementation divides q and k outputs into equal parts (<0; s), <s; s+1)...). This won't work for the rope, because the first node would require a bit of k output from the second node etc...
I see some posibility to solve it but it is much complex that I thought. I probably should split Q & K layers into many small columns (width=2), and assign columns to nodes.
worker 1: output digits 1, 2, 6, 8, ... (n, n + 1)
worker 2: output digits 2, 4, 9, 10, ... (n + 2, n + 3)

The papar that you linked doesn't have any part about the rope. So probably we have a different case here.

I needed a bit of time to notice my thinking error. After all the rope layer is splitted out to the root node and workers. 🎉  Tested it with 1, 2 and 4 nodes and the macbeth test generates the same output on different topologies *.
* The macbeth test doesn't work with the buffer quantization (it generates a different output), because now the RoPE is applied before the transfer quantization. Previously, it was applied after the transfer dequantization. I expect this affects the perplexity somehow. Probably this will be resolved if the llamaMultiheadAttJoin function will be also splitted out.
Now all nodes have the RoPE cache, and the size of the cache is different for all nodes. This may be a bit optimized, but "so far so good".
root node:
🕒 ropeCache: 8192 kB

1 worker:
🕒 ropeCache: 28672 kB

2 worker:
🕒 ropeCache: 20480 kB

3 worker:
🕒 ropeCache: 26624 kB

Next, I'll try to split out the llamaMultiheadAttJoin function.

Finally I splitted out the multihead layer into all nodes (still not merged, I need to fix mixtral & grok architectures). First measurments:
Model: Llama 3 8B Q40
Buffer: Q80
Setup: 4 x Raspberry Pi 5 8GB + TP-Link LS1008G Switch
Transfer size / token

Devices
0.3.0
This PR
Percentage change

2 x Raspberry Pi 5
S 646 kB + R 476 kB = 1122 kB
S 578 kB + R 442 kB = 1020 kB
-9.09%

4 x Raspberry Pi 5
S 2295 kB + R 714 kB = 3009 kB
S 2193 kB + R 663 kB = 2856 kB
-5.08%

Avg tokens / secon

Devices

0.3.0
This PR
Percentage change

2 x Raspberry Pi 5
Avg generation time
444.27 ms
381.81 ms

Avg inference time
362.73
349.94 ms
-3.53%

Avg transfer time
80.11 ms
30.31 ms*

4 x Raspberry Pi 5
Avg generation time
331.47 ms
359.44 ms

Avg inference time
267.62 ms
258.00 ms
-3.59%

Avg transfer time
62.34 ms
99.69 ms

* I think the used switch is completely non-deterministic, it achieves a random speed at different times. So I recommend to compare only the avg inference time.
It looks like that gave a tiny speed up (maybe 3%). I expected a bit more. 🤔

Update: I changed the implementation a bit, now there is no synchronization between llamaQuantizeMultiheadAtt and llamaAtt. So basically now we have the state-of-the-art parallelism of attention layers. 🎉
Transfer size / token

Devices
0.3.0
PR v2
Percentage change

2 devices
S 646 kB + R 476 kB = 1122 kB
S 510 kB + R 442 kB = 952 kB
-15.15%

4 devices
S 2295 kB + R 714 kB = 3009 kB
S 1887 kB + R 867 kB = 2754 kB
-8.47%

8 devices
S 5771 kB + R 833 kB = 6604 kB
S 4819 kB + R 1487 kB = 6306 kB
-4.51%

The final state of the attention synchronization looks like this for a single block:
root --- xb  ---> node
root <-- xbv ---- node
merge att

The previous implementation:
root --- xb  --> node
root <-- q  ---- node
root <-- k  ---- node
root <-- v  ---- node
root --- xb ---> node
root <-- xb2 --- node
merge att

@b4rtaz 🎉You have completed the sota tensor parallel for Attention Layer!!!
Moreover, continuing our discussion before, there are still two optimizations that can be done:

Computation:
The last layer(Finalize) occupies 11% of the total time. It can be decomposed as parallel computing + synchronization(merge).
Then, 11% can be reduced to 2.75%+synchronization.

Communication:
Currently, there are 3 main synchronization functions in one transformer block, the attention layer takes 1, and the FFN layer takes 2. You are using 2 All-gather operations(syncFfnA and syncFfn2) in the FFN. It can be optimized as 1 All-Reduce operation syncFfn.
The slicing approach is explained in detail by the PyTorch tutorial:
    "feed_foward.w1": ColwiseParallel(),
    "feed_forward.w2": RowwiseParallel(),
    "feed_forward.w3": ColwiseParallel(),

Then 4.76% time can be reduced.

In summary, at most 12% acceleration can be made upon the current version. When the worker number increases, 4 workers in this issue, this acceleration would enjoy more parallelism.

https://github.com/huggingface/transformers/blob/bb48e921868ac750417956de941606f7e2fa02ca/src/transformers/models/llama/modeling_llama.py#L199-L219
@b4rtaz Just so you know, this code implements the FFN layer of llama with Tensor Parallel acceleration. Notice that there is one mistake  that the PyTorch tutorial made about feed_forward.w2, which is a gate layer, so the right solution should be:
    "feed_foward.w1": ColwiseParallel(),
    "feed_forward.w2": ColwiseParallel(),
    "feed_forward.w3": RowwiseParallel(),

@zhengpeirong it seems after I adjusted mlp layers to your suggestion the transfer has dropped by ~40% per token. 🤯

Devices
0.5.0
PR
Percentage change

2 devices
S 510 kB + R 442 kB = 952 kB
S 272 kB + R 272 kB = 544 kB
-42.8%

4 devices
S 1887 kB + R 867 kB = 2754 kB
S 816 kB + R 816 kB = 816 kB
-40.7%

PR
Later I'll check the impact on the generation time.

@zhengpeirong it seems after I adjusted mlp layers to your suggestion the transfer has dropped by ~40% per token. 🤯

Devices
0.5.0
PR
Percentage change

2 devices
S 510 kB + R 442 kB = 952 kB
S 272 kB + R 272 kB = 544 kB
-42.8%

4 devices
S 1887 kB + R 867 kB = 2754 kB
S 816 kB + R 816 kB = 816 kB
-40.7%

PR
Later I'll check the impact on the generation time.

Great and weird.The communication data volume has dropped drastically. But the generation time has increase. Would you provide the detailed log for analysis?

Where you see the generation time data? 🤔

@zhengpeirong it seems after I adjusted mlp layers to your suggestion the transfer has dropped by ~40% per token. 🤯

Devices
0.5.0
PR
Percentage change

2 devices
S 510 kB + R 442 kB = 952 kB
S 272 kB + R 272 kB = 544 kB
-42.8%

4 devices
S 1887 kB + R 867 kB = 2754 kB
S 816 kB + R 816 kB = 816 kB
-40.7%

PR
Later I'll check the impact on the generation time.

＇272 kB ＇ is compatible with the theory analysis.
272/32/4=2.125

Except for transfer data for the embedding layers, we can treat this as 2.
This means that there are 2 times transfer in a single Transformer block.
That's exactly what All-Reduce will show.
Congratulations for finishing this feature suggestion!

Llama 2 7B Q40
nTokens = 90, buffer = Q80
4 x Rasperry Pi 5 8GB

Version
Avg tokens / second
Avg generation time
Avg inference time
Avg transfer time

This PR
4.08
245.08 ms
169.33 ms
75.34 ms

0.7.0
3.90
256.23 ms
168.77 ms
87.12 ms

0.6.0
4.24
235.69 ms
143.44 ms
91.77 ms

2 x Rasperry Pi 5 8GB

Version
Avg tokens / second
Avg generation time
Avg inference time
Avg transfer time

This PR
3.07
325.46 ms
269.04 ms
56.39 ms

0.7.0
2.91
343.44 ms
266.51 ms
76.87 ms

0.6.0
3.06
327.17 ms
249.80 ms
77.28 ms

Tinylama 1.3B 3T Q40
nTokens = 128, buffer = Q80
2 x Rasperry Pi 5 8GB

Version
Avg tokens / second
Avg generation time
Avg inference time
Avg transfer time

This PR
16.86
59.31 ms
50.37 ms
8.58 ms

0.7.0
15.17
65.93 ms
52.07 ms
13.45 ms

Llama 3 8B Q40
nTokens = 90, buffer = Q80
2 x AMD EPYC 7402P 24-Core Processor

Version
Avg tokens / second
Avg generation time
Avg inference time
Avg transfer time

This PR
13.04
76.67 ms
45.33 ms
30.93 ms

0.7.0
12.79
78.21 ms
46.30 ms
31.49 ms

0.6.0
12.55
79.71 ms
47.08 ms
32.22 ms

In all cases the average transfer time has dropped. What is interesting the non-blocking sockets reduce the speed on Raspberry Pi but on a strong machine not. Maybe this mode should be optional.

In all cases the average transfer time has dropped. What is interesting the non-blocking sockets reduce the speed on Raspberry Pi but on a strong machine not. Maybe this mode should be optional.

Do you mean blocking sockets reduces the speed?
Could you try 8 x Raspberry Pi? Since there are obvious transfer delays for 8 devices, I am curious whether it's because of network traffic congestion.
BTW, I think it's time to update the README.md with the newest generation time for people new here.

Do you mean blocking sockets reduces the speed?

No. The non-blocking sockets I think. From the 0.6.1 Distributed Llama has enabled non-blocking sockets for root <> node communciation.

Could you try 8 x Raspberry Pi?

Unfortunelty I don't have 8 devices anymore. I have only 4 x Raspberry Pi 5 8GB.

BTW, I think it's time to update the README.md with the newest generation time for people new here.

You're right. I'll do it soon.

Do you mean blocking sockets reduces the speed?

No. The non-blocking sockets I think. From the 0.6.1 Distributed Llama has enabled non-blocking sockets for root <> node communciation.'

The non-blocking sockets will make the CPU do other jobs instead of waiting. But what's the logical connection between non-blocking and increased inference time?

Could you try 8 x Raspberry Pi?

Unfortunelty I don't have 8 devices anymore. I have only 4 x Raspberry Pi 5 8GB.

In this discussion, you are invited to conduct experiments with more devices and find what number of devices is the best choice, then present it in README.
If the dllama can support any dual number of devices, more scenarios can be supported since there is a big gap between 8 and 16 and 32 devices.

The non-blocking sockets will make the CPU do other jobs instead of waiting. But what's the logical connection between non-blocking and increased inference time?

I think this problem appears only on slow devices like Raspberry Pi. I cannot explain it but you can see the drop in the speed 0.6.0 -> 0.7.0. This was only a minor change between these versions.
Maybe we need more tests.


JuliaCon 2019 | State of the Data: JuliaData | Jacob Quinn

State of the Data: JuliaData, https://www.youtube.com/watch?v=NOJbXnCVryM
It is short talk, but quite hard to grasp. I didn't understand whole meaning of question at 09:44 (question mark), so you should check this point on the list yourself.

Hey, I just edited out the first minute of no talking, can you update these to reflect this change?

Great that you edited this video. Here are new timestamps.
00:00 Welcome!
00:32 Tables.jl
03:07 CSV.jl
05:19 DataFrames.jl
06:07 Highlights of data ecosystem
07:51 Q&A: How you handle JSON as table?
08:39 Q&A: Array of objects
08:53 Q&A: Improving float printing performance (?)


Fix resizable panel bug

https://github.com/cardstack/boxel/assets/8165111/6c9ec942-30cf-4fa8-bf91-163fc36b6974

Closing in favor of https://github.com/cardstack/boxel/pull/1148


another powerfull duktape java on android platform

hi，another more powerful  duktape java on android platform,  the project sit is in
https://github.com/gubaojian/DuktapeJava
can you add link to it in readme  file on your project?

I think that'd send a mixed message about this project. You should ask the proper Duktape project to link it though!


Update terminal quick fix proposal

Part of #162950

@meganrogge this has a breaking change, was it only the npm extension that's using quick fixes?

oh, conflicts @Tyriar


Add  i386 section to external sections

Description
add a external space ship section.
The arch section shows i386 if current shell running in x86 env on macOS. Otherwise it will hide by default.
Screenshot

:tada: This PR is included in version 4.15.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Invoking a non-HTTP triggered function locally using the Azure Functions Core Tools Admin API (cardinality: one)

Is your question related to a specific version? If so, please specify:
Found Python version 3.8.5 (python3).
Azure Functions Core Tools (3.0.2931 Commit hash: d552c6741a37422684f0efab41d541ebad2b2bd2)
Function Runtime Version: 3.0.14492.0
What binding does your question apply to, if any? (e.g. Blob Trigger, Event Hub Binding, etc)
Event Hub Trigger Binding (cardinality: one)
Question
Hi there,
we are trying to follow the documentation about how to pass test data to a non-HTTP triggered function to invoke a Python function locally when running within the Azure Functions Core Tools host.

For all kinds of functions other than HTTP triggers and webhooks and Event Grid triggers, you can test your functions locally by calling an administration endpoint. Calling this endpoint with an HTTP POST request on the local server triggers the function.

We are using the EventHub Trigger binding, so the function signature looks like that:
def main(events: List[func.EventHubEvent]):
    # Process all events.
    for event in events:
        pass

Now, we are trying to figure out how exactly to formulate what to put into <trigger_input> in our scenario.

The message body is required to have the following JSON format:
{
    "input": "<trigger_input>"
}

The <trigger_input> value contains data in a format expected by the function.

When submitting an obviously wrong request like
http http://<IP_ADDRESS>:7071/admin/functions/eventHubTrigger input=foobar

the host says
[2020-10-14T15:03:03.439] Executed 'Functions.EventHubTrigger' (Failed, Id=57244492-47f9-4801-a99f-431f64a2cd6e, Duration=86ms)
[2020-10-14T15:03:03.439] System.Private.CoreLib: Exception while executing function: Functions.EventHubTrigger. Microsoft.Azure.WebJobs.Host: Exception binding parameter 'events'. Microsoft.Azure.WebJobs.Host: Binding parameters to complex objects (such as 'Object') uses Json.NET serialization.
[2020-10-14T15:03:03.439] 1. Bind the parameter type as 'string' instead of 'Object' to get the raw values and avoid JSON deserialization, or
[2020-10-14T15:03:03.439] 2. Change the queue payload to be valid json. The JSON parser failed: Error parsing boolean value. Path '', line 1, position 1.

When naively sending real JSON like {"input": [{"device-id": "1"}]}, the host responds with <Response [400]> (Bad Request).
After these observations, we started digging through the source code of the host and the python function worker in order to figure out how to build an appropriate payload reflecting the "real" thing but quickly got lost.
While it is obvious that there will be more efforts required to send a complex object instead of a simple scalar string as outlined within the example
curl --request POST -H "Content-Type:application/json" --data '{"input":"sample queue data"}' http://localhost:7071/admin/functions/QueueTrigger

we are now wondering if that would be possible at all. Maybe you can help us out?
Thank you very much in advance and with kind regards,
Andreas.

Hi again,
I believe I should share some more background where we are aiming at. Originally, I've misplaced it within https://github.com/Azure/azure-functions-host/pull/6603#issuecomment-707946805 and https://github.com/Azure/azure-functions-host/pull/6603#issuecomment-708034127.
We are currently looking into running full integration tests with pytest through a host instance provided by azure-functions-core-tools.
Our idea was to spin up a function/host instance from a pytest fixture, submit a single or more messages to it by e.g. invoking
http http://<IP_ADDRESS>:7071/admin/functions/eventHubTrigger input=foobar

and then check the outcome of what has been done when processing the message(s) (e.g. writing to a database).
Now, after sublimating myself more thoroughly into the code base, I found azure_functions_worker.testutils.start_webhost as well as tests.endtoend.test_eventhub_functions.test_eventhub_trigger, which probably perfectly reflect our goal. Kudos to @1st1, @Hazhzeng, @elprans, @vrdmr, @ankitkumarr and @maiqbal11.
From reading that code, I learned that there is probably no way to invoke an EventHub Trigger function directly. Instead, the idea seems to be to use a HTTP Trigger in order to indirectly submit an event to EventHub, right?
https://github.com/Azure/azure-functions-python-worker/blob/c465de4e7561c9978f61a21a2c82aa095dca4305/tests/endtoend/test_eventhub_functions.py#L30-L34
With kind regards,
Andreas.
cc @faymarie, @quodt

Hi again,
despite learning that the endtoend integration tests within this repository indirectly invoke an Event Hubs Trigger using a HTTP Trigger, I would like to share some resources where others have also been trying to do it directly by submitting a HTTP POST request to the Admin API.

https://github.com/MicrosoftDocs/azure-docs/issues/35469
https://stackoverflow.com/questions/47002514/azure-function-is-not-triggered-locally
https://stackoverflow.com/questions/47739232/azure-functions-developing-locally-cannot-register-eventhub-triggered-function

It is all revolving around the aspect how to phrase the request body and whether it would work using a JSON body at all.
With kind regards,
Andreas.

@amotl If I understood your problem correctly, I think that I found the "magic" format that needs to be submitted through the POST call.
This is how I was able to use the Admin API with Event Hub trigger function:
curl --request POST 'http://localhost:7071/admin/functions/MulticonNormalization' --header 'Content-Type: application/json' --data-raw '{"input": "{\"SystemProperties\":{},\"myteststuff\":{\"testid\":\"810d9efd-458c-49f2-a9c0-822c897a02e3\",\"testtimestamp\":\"2020-10-28 23:24:16.315294\"},\"testdata\":\"Ping from Az CLI IoT Extension #1\"}"}'

First thing, the JSON in the POST request needs to follow this pattern: {"input":"<escaped JSON string>"}.
In addition, the escaped JSON string must include "SystemProperties":{} object.
If the "SystemProperties":{} object is missing, the Admin API still returns a 202 response, but in the host logs you can find the following error:
System.Private.CoreLib: Exception while executing function: Functions.MyFunctionName. System.Private.CoreLib: Result: Failure
Exception: TypeError: unable to decode incoming TypedData: unsupported combination of TypedData field 'string' and expected binding type <class 'azure.functions.eventhub.EventHubTriggerConverter'>

Dear Tadas,

The escaped JSON string must include a "SystemProperties":{} object.

Ah, that is awesome! Thank you so much for applying your wizardry to the problem we have been facing here. I just wanted to leave you a quick appreciation and will follow up on this next week.
With kind regards,
Andreas.
cc @faymarie, @quodt, @kamejosh

Dear Tadas,
I've translated the curl request to an invocation using HTTPie and it works like a treat (this saves us from having to escape the JSON payload on the first hand):
http http://<IP_ADDRESS>:7071/admin/functions/eventHubTrigger \
  input='{"SystemProperties":{},"foo":"Ping from Az CLI IoT Extension #1","bar":{"id":"810d9efd-458c-49f2-a9c0-822c897a02e3","timestamp":"2020-10-28 23:24:16.315294"}}' \
  --print hHbB

Thanks again!
However, as a next step, I tried to figure out how to submit a list of events, reflected by a binding attribute "cardinality": "many" within function.json like that:
http http://<IP_ADDRESS>:7071/admin/functions/eventHubTrigger \
  input='{"SystemPropertiesArray":{},"data":["foo":"Ping from Az CLI IoT Extension #1","bar":{"id":"810d9efd-458c-49f2-a9c0-822c897a02e3","timestamp":"2020-10-28 23:24:16.315294"}]}' \
  --print hHbB

The SystemPropertiesArray idea has been picked up from inspecting the source code of the tests within azure-functions-python-worker. However, I have no idea how to wrap the actual list of events. Using data here does not work yet.
Maybe you are able to apply some additional wizardry from your pen?
With kind regards,
Andreas.

For investigating this further, I've added the snippet
with open("/tmp/hello", "w") as f:
    f.write(str(trigger_metadata.keys()))

to the beginning of the EventHubTriggerConverter.decode() method.
The outcome for cardinality: one is:
dict_keys(['foo', 'Properties', 'SystemProperties', 'events', 'EnqueuedTimeUtc', 'bar', 'SequenceNumber'])

The outcome for cardinality: many is:
dict_keys(['Properties', 'SequenceNumber', 'events', 'EnqueuedTimeUtc'])

The consequence of this is that _is_cardinality_one() will work and return True, as SystemProperties is contained within the dictionary. However, in the case of cardinality: many, it will not work because _is_cardinality_many() will return False as SystemPropertiesArray is not contained within the dictionary.

Dear @stefanushinardi, @anirudhgarg, @anthonychu and @Hazhzeng,
may I humbly suggest to add the outcome of this research to the aforementioned documentation at
Passing test data to a function > Non-HTTP triggered functions?
The gist is:

When supplying a complex real-world JSON object as <trigger_input> value, it must be properly escaped.
The escaped JSON string must include a "SystemProperties":{} object.

With kind regards,
Andreas.

Also facing issues trying to figure out what to sent as <trigger_input> for blob triggers and other events


Date and time errors when making account reports

Bug Description
When making an account report and setting the "To:" time too close to the current time, yields and error.
The wallet says "Date must be before today", even though it should be possible to make the report from today.
If the time is set to an hour before the current time, the wallet doesn't give you any errors.

Steps to Reproduce
Expected Result
It should be possible to make a report all the way up to the current time. If the user enters a time in the future, the error message should not be "Date must be before today", but something like "The time cannot be in the future" or something.
Actual Result
It is not possible to make a report that goes all the way up past the last hour, and it says "Date must be before today"
Versions

Software Version: 1.2.0-beta.2
OS: MacOS 11.5.2

@soerenbf, I think you should take this, because not being able to choose a time within the current hour doesn't happen on Linux (might be a Mac only issue)


Remove the cli command neurom features

Instead a proper documentation is provided on the list of available features.

Codecov Report

:exclamation: No coverage uploaded for pull request base (master@c2617e4). Click here to learn what that means.
The diff coverage is 100.00%.

:exclamation: Current head 5f1ff51 differs from pull request most recent head 6d5fe17. Consider uploading reports for the commit 6d5fe17 to get more accurate results

@@            Coverage Diff             @@
##             master      #933   +/-   ##
==========================================
  Coverage          ?   100.00%
==========================================
  Files             ?        37
  Lines             ?      2111
  Branches          ?         0
==========================================
  Hits              ?      2111
  Misses            ?         0
  Partials          ?         0

Thank you!


How to do reshape?

Is it possible to change the shape of an xnd container from python?

Reshape is now implemented for the (most important) case that returning a view is possible:
>>> x = xnd([1,2,3,4,5,6])
>>> y = x.reshape(2,3)
>>> y[0][0] = 100
>>> y
xnd([[100, 2, 3], [4, 5, 6]], type='2 * 3 * int64')
>>> x
xnd([100, 2, 3, 4, 5, 6], type='6 * int64')


👩💻 Fix SSR styling of code-blocks

Recent theme work moved theme logic entirely client-side[^note], so that we can support client-only theme configuration (localStorage).
This PR is one "hacky" fix which duplicates each <pre> tag, and sets the dark and light styles respectively. Visibility is then class-driven. I don't immediately know if this is a performance nightmare.
[^note]: Technically SSR can render the proper state server-side, but for first-visits, we have to wait for the client to compute the proper state (and do some hydration-hacks to resolve the state).

@rowanc1 I've just lifted the CSS from highlightjs directly into our styling. This means that we don't need to duplicate any nodes. Are you comfortable with this change?


Send-SQLDataToExcel result differs from SQL query

When I try to export a rather large query (140000 rows) via Send-SQLDataToExcel I experience a rather strange error. The excel file contents differ from a query by Management Studio.
There is one row, which contains mainly NULL but on the rows with content this content gets duplicated into the other rows where it should be NULL.
Any hints to debug this issue?

@jhoneill what is your take? Do we need to see data?

First check that you've got a fairly up-to date version as we did change how this worked a few months ago. Then I would:
(1). Look at the spreadsheet and note the row number(s) of the affected rows.  You will need to subtract 2 from the number(s) as table rows count from zero and Excel counts from one, and row 1 is used for headings so data row 0 is in excel row 2.
(2). Load Send-SQLDataToExcel.ps1  and Export-Excel.ps1 into the ISE or VS Code whichever you are happier with and set breakpoints
in Send-SqlDataToExcel at line 166  (" if     ($DataTable.Rows.Count) { "
and in export Excel.at lines  635 (" $ColumnIndex         += $InputObject.Columns.Count - 1")  and 1054 (" Write-Verbose -Message "Saved workbook $($pkg.File)" ")
(3) Run your script and when dropped into the debugger, use
$DataTable.Rows[<<your row number - 2 >>]
to verify that  what came back in the query is what you expect.
(4) Press [f5] to resume. And when dropped into the debugger a second time  type
$InputObject.Rows[<<your row number - 2 >>]  to check nothing has changed in passing it to Excel
(5) then type  $ws.cells["<<your row number>>:<<your row number>>"] | ft address,value
and see if the right data was posted into excel
(4) Press [f5] to resume. And when dropped into the debugger a third time  type
 $ws.cells["<<your row number>>:<<your row number>>"] | ft address,value  again to see if it was messed up before saving.
I've got a bad feeling that if the data that comes back is as expected and it is wrong when posted to Excel that's a bug with EpPlus, and we might have trouble getting it fixed. You can still send the data to export-excel "old style" but the performance on this size of data won't be great.

I thought i would run 6.5.1 but there were multiple versions installed. I removed the old version and now the error does not longer occur.
I am sorry that i bothered you, thanks for the help.

No worries. If only they were all that easy to solve :-)


[Typography] How to add all font-weights for custom font-face?

[x ] This is a v1.x issue (v0.x is no longer maintained).
[x ] I have searched the issues of this repository and believe that this is not a duplicate.

Expected Behavior
I'm adding a custom fontFamily to typography through createMuiTheme. It automagically picks up the custom font from a /static/ directory, which is awesome, but I've been completely unable to display anything other than a regular (400) font-weight. I've been through all the internets trying out different @font-face methods in .css, .jss, and related solutions with no luck. Can anyone help me see what I'm missing?
Current Behavior
All Typography and Buttons are displaying the same font-weight regardless of what's in the spec.
Steps to Reproduce (for bugs)
My getPageContext.js:
const theme = createMuiTheme({
  typography: {
    fontFamily: [
      'MyHappyFont',
      'Arial',
      'sans-serif',
    ].join(','),
  },
...
})

Context
I'm trying to replicate the complete Roboto set of 300, 400, and 500 font-weights
Your Environment

Tech
Version

Material-UI
v1.2.3

React
16.4

browser
Chrome

etc

@allpwrfulroot You can provide the following options:
https://github.com/mui-org/material-ui/blob/91ecbbd79dca4a2432157e79e6f4f5e2c9f8dfc6/packages/material-ui/src/styles/createTypography.js#L10-L23
to
const theme = createMuiTheme({
  typography: options,
})

Thanks for the fast response! Understood, and I have tried that, without success.
My guess is that somehow the MyHappyFont-x00.otf files aren't being successfully mapped for fontWeightMedium = 500 parts, but I haven't been able to find out enough how createTypography works under the hood to resolve.

Sorry to gravedig but did you ever solve this @allpwrfulroot?


Use AS::Logger instead of Logger if available

Use AS::Logger instead of Logger if available
ActiveSupport::LoggerThreadSafeLevel does not work with stdlib ::Logger
without monkeypatching. rails/rails#24263 introduced thread safety but
requires the target class to implement code to call an after_initialize
method if it exists. ActiveSupport::Logger has those modules included
and the correct interface implemented.
Fix #23
Refs: rails/rails#24263 heroku/rails_stdout_logging#22

It doesn't with Rails 3.x

Thanks! :heart: :rocket: i'll cut a new release soon.

Thank you all!
I'm opening a new issue/question

Tests are failing due to bundle install not working in some cases https://travis-ci.org/heroku/rails_stdout_logging/jobs/118000871
Restarting the tests on travis they continue to fail. I can't reproduce locally. I re-ran the failing tests locally and they all pass. I cut v0.0.5 with this change.

Gem::InstallError: mime-types-data requires Ruby version >= 2.0.

I don't know why that build is trying to install mime-types-data
https://api.travis-ci.org/jobs/118007848/log.txt?deansi=true
https://s3.amazonaws.com/archive.travis-ci.org/jobs/117950369/log.txt

The Rails app must have accidentally gotten it as a dependency, looks like another regression in Rails?

The just released mail 2.6.4 relaxed < 3 dependency on mime-types-data
https://rubygems.org/gems/mail/versions/2.6.4

I guess we could add mail into the appraisal gemfile. Weird that bundler doesn't see what version we're using and pick a version of the gem that is valid with our Ruby version.
Someone changed something that caused our builds to break, I feel like there is a bug to be reported somewhere but i'm not quite sure where yet. I don't think it's Mail, and I don't think it's mime-types. Bundler is my best guess.


Unable to get it working...

Implemented your library on a LinearLayout which contains a third party layout....
But it doesn't work...the slide Right doesnt work. niether the slide Left....
may be I am missing something here...need to implement something else as well ?
I followed the steps you gave for a simple implementation.
What's happening is everything freezes..it neither goes into a hidden state neither it slides..
The third party layout which i am implementing is ArcLayout  from com.ogaclejapan.arclayout.ArcLayout.
Kindly help.

Hi. Please, provide your code

Hi, sorry for late response
here is the code:
layoutRightPanel = (RelativeLayout) findViewById(R.id.layout_right_panel);
slideUp = new SlideUp.Builder(layoutRightPanel)
.withStartState(SlideUp.State.HIDDEN)
.withStartGravity(Gravity.END)
.build();
//then on the click of a button :
if (slideUp.isVisible())  slideUp.hide(); else slideUp.show();
I was trying to implement the slide in from right and slide out on click funcationality
Regards

Also, would like to mention that the panel isnt hidden...still even though i have stated that it should be hidden withStartState(SlideUp.State.HIDDEN)

I see no reason for errors. Can you show your xml file?

Hi Mancj, i am sorry to bother you really.... i was able to fix it....it was on my end..i had put my own animation in the view via styles along with the lib........The library works perfectly fine. Thanks for your efforts to make this lib, its awesome. Thank you very much. and sorry to bother you with all this.
Regards

no problem, everything is fine.


Password Length Regex Doesn't Work As Intended

password length regex: re.compile(r'(.*)+) will be valid for every length instead of just 8 characters or more. regex should be re.compile(r'.{8,}') for desired result.

You're absolutely right. Not sure how I made the mistake back then but you have probably prevented a few others from doing the same with this correction. Very much appreciated.


IR: Global arrays with initializers

An array declaration like the following currently breaks the IR-based codegen:
static const int xOffset[4] = { -1, -1, 1, 1 };

There are two issues at hand here:

We don't recognize static const values like this and generate code for them differently from other globals.

When treating them as global variables, we try to generate a function to compute their inital value. In this case that function returns an array type, which is something we can't express syntactically in C-like declarator syntax, so we end up outputting int xOffset_init[4]() { ... }

Both of these issues are serious enough to warrant a fix.
For (2), we probably need to have a general-purpose fix in place for functions that return array types. A simple fix would be to do on-demand generation of a custom struct type to wrap every unique array type that we use as a function result. E.g., the example above would lead us to declare something like:
struct SLANG_Array_4_of_int { int data[4]; };

Handling this during emit will create a mess when we need to convert from these wrapped struct types to ordinary arrays and vice versa. We might want to handle this as part of type legalization in the IR.
For (1), My sense is that the right fix involves two different pieces:

First, we need to recognize global constants as a distinct case similar to IRGlobalVar, but which will be output as an appropriate constant declaration for the target

Second, we need to get the fix in place for dealing with IR globals (whether constants or variables) where the initializer code can be turned into a simple expression. This might be part of a larger fix for translating from IR back to AST for emit.

This is related to #291.

This is now the main issue blocking progress on porting Falcor to use the IR for all codegen.

The main issues here are resolved, with the IR adding global_var and global_constant opcodes. There are still some details that can/should get ironed out, but this issue is overly broad for what is left.


Show info from other players

For example on the top of the screen. The following info could be useful:

[ ] Name
[ ] Color
[ ] Number of cards in their hand

I think the name and color will be nice in the header (colored name).

Although when we add the other player decks to show how many cards they have I also want to be able to drag cards to other players decks, so that is a bit more work. As soon as we do that though, the player names and colors can be taken out of the header and just moved to the corresponding deck.

Or maybe it is better to just start with showing the decks on the side and not allow us to drag their yet.

Basic UI is done in this PR


Added SSL support.

This change simply adds support for a ssl config option, to allow for when InfluxDB is being hosted over SSL.
The way it's implemented is that when ssl is set to true, the https module is used for requests to InfluxDB, instead of the http module.
Thanks a lot for the library, it's working great.

Would it be possible to get a version cut with this PR?

@aspring I just published v0.4.0 to npmjs. Have fun! :smiley:


do not try default config if we have cookie

and fixed some wrong variable names

The variable name fixes were good catch ... thanks! :)
Perhaps for cookie config .. it should get higher priority then the default config, but I guess in case webui cannot connect then it should fallback to the default config. Otherwise users wont be able to change the config once cookie is assigned and it will always  disconnect. So perhaps append both into one array?

there you go

Awesome! thanks @Twilight !! :)

Welcome :)


How to use resnet-101 for Faster R-CNN on PASCAL VOC?

Hello, I've downloaded a faster r-cnn resnet-101 backbone for PASCAL VOC from https://modelzoo.co/model/faster-rcnnpytorch. I've tried using it as a checkpoint and modifying the pre-trained and backbone depth arguments. I've gotten APs of 0 only, though. Is there any way I can use resnet-101 as a backbone for Faster R-CNN when testing on PASCAL VOC?

Maybe you can download https://github.com/open-mmlab/mmdetection/tree/master/configs/faster_rcnn/faster_rcnn_r101_fpn_mstrain_3x_coco.py.

Isn't this for the coco dataset? Is there a way to use it for PASCAL or another way possible?

The pretrained model for PASCAL and COCO is the same.

MMDetection does not support load checkpoints trained by other frameworks, you need to add a script to convert them.
If you want to use the model in mmdet, you can see the configs in the pascal_voc directory and modify the configs for ResNet-101. You need to train a model before testing it if it is a new config that do not have a pretrain.
You can use COCO pretrain to train model on Pascal VOC.


Was the released version 2.7 updated last month?

Hi guys,
I just wanted to ask if the v2.7 release of s3ninja has somehow been updated last month (while retaining the same version number)?
We have been working with 2.7 since March this year. The version we have inside our internal artifactory repository shows it has dependencies on sirius-kernel 2.0 and sirius-web 2.0.
We noticed that our tests started failing a few weeks ago. After some investigation it looked like the pom for v2.7 in maven central had now changed (on 8th November) - and now had dependencies on sirius-kernel 3.1 and sirius-web 4.11 (while the version of s3ninja was still 2.7)
We are building in 2 different environments (which now have the different v2.7s in their repos) - and it now works in one, but fails in the other (due to Netty dependency conflicts).
We have fixed this by reverting to 2.6 for now - but just wondered if you could confirm if something had happened with v2.7 last month? Looks like it might have been this fix https://github.com/scireum/s3ninja/pull/69 - could it have been released under the already released version 2.7?
Just wanted to check if this is indeed what happened, and raise it in case anyone else has the same problem.
Cheers,
Adrian

Hi,
yes indeed, I forgot to bump the version of s3ninja to 2.8...
Thanks for noticing.
-Fabian

Hi Fabian,
Thanks for the update and confirming that was the case (just flagged it in case anyone experienced the same issue).
Cheers,
Adrian


fix: dependency install for windows

Resolves: datavolo-io/hatch-datavolo-nar#9

It looks good to me. I've tested the build process on Windows 10 Home, Debian 12, and MacOS 15.0.1, and everything works as intended. Build packages load successfully in NiFi.


added BLEND_SET

I needed this blend mode for rendering a framebuffer containing text on transparent background to screen, otherwise it looks fuzzy and wrong.

@RandomErrorMessage thanks for the addition!


Migration

Problem
Why i can't use yii2 migration for create test db? It's not problem Codeception, because hi don't have migration. It's problem yii2-codeception, i think.
Additional info

Q
A

Yii version
2.0.10-dev

PHP version
7.1

Operating system
MacOS Capitan

Codeception
2.2.4

yii2-codeception
dev-master

what is the problem? why can't you use migration?

How i do it automatically like a Codeception\Module\Db ? I want on start test - up migration, up fixture (if need), do test and down migration.

See:
https://github.com/yiisoft/yii2/issues/1772
In particular:
https://github.com/yiisoft/yii2/issues/1772#issuecomment-31605050

@klimov-paul i read this. Why it's don't do in this module? If new user start write first test, he don't see in doc, what he need do to create db for test. First idea - it's use migration, but Codeception & Yii don't help with it. Second - save migration to SQL and use Db module, it's not good way, when we use migration.

i read this.

I doubt it. At yiisoft/yii2#1772 there is a whole disscussion about this there with the explanations why it is not supported out of the box.
The decision is made, there is nothing else I can do. You should apply migrations for your test on your own.

Thanks


Roll engine ae2222f47e78..2cdbc7f92793 (20 commits)

https://github.com/flutter/engine/compare/ae2222f47e78...2cdbc7f92793
git log ae2222f47e78..2cdbc7f92793 --first-parent --oneline
2020-05-14<EMAIL_ADDRESS>Remove pipeline in favor of layer tree holder (flutter/engine#18285)
2020-05-14<EMAIL_ADDRESS>Roll src/third_party/skia 5b2ede3d0d44..39ec60aa8348 (5 commits) (flutter/engine#18384)
2020-05-14<EMAIL_ADDRESS>Roll src/third_party/dart e0257265d34e..2676764792b2 (4 commits) (flutter/engine#18383)
2020-05-14<EMAIL_ADDRESS>Delete unused decode UTF-8, JSON functions (flutter/engine#18360)
2020-05-14<EMAIL_ADDRESS>Roll src/third_party/skia 7156db260239..5b2ede3d0d44 (8 commits) (flutter/engine#18380)
2020-05-14<EMAIL_ADDRESS>Roll src/third_party/dart f99631b12c4a..e0257265d34e (2 commits) (flutter/engine#18378)
2020-05-14<EMAIL_ADDRESS>Roll src/fuchsia/sdk/mac from gOhJW... to Vepm4... (flutter/engine#18377)
2020-05-14<EMAIL_ADDRESS>Roll src/third_party/dart 29c00e28f350..f99631b12c4a (29 commits) (flutter/engine#18373)
2020-05-14<EMAIL_ADDRESS>Roll src/third_party/skia 6c3db04c8b03..7156db260239 (4 commits) (flutter/engine#18370)
2020-05-14<EMAIL_ADDRESS>Add FlJsonMessageCodec (flutter/engine#18221)
2020-05-14<EMAIL_ADDRESS>Roll src/third_party/skia<PHONE_NUMBER>4f..6c3db04c8b03 (9 commits) (flutter/engine#18361)
2020-05-14<EMAIL_ADDRESS>Add FlBasicMessageChannel (flutter/engine#18189)
2020-05-13<EMAIL_ADDRESS>null-annotate lerp.dart, annotations.dart, channel_buffers.dart, hash_codes.dart (flutter/engine#18348)
2020-05-13<EMAIL_ADDRESS>Move FlutterLoader disk I/O to a background thread to comply with Android strict mode (flutter/engine#18241)
2020-05-13<EMAIL_ADDRESS>Add guards on FlValue methods to check for NULL values (flutter/engine#18226)
2020-05-13<EMAIL_ADDRESS>Roll src/third_party/skia 056d543c91e0..71903997254f (7 commits) (flutter/engine#18350)
2020-05-13<EMAIL_ADDRESS>Roll src/third_party/dart d6fed1f62444..29c00e28f350 (16 commits) (flutter/engine#18347)
2020-05-13<EMAIL_ADDRESS>Fix scenario platform view tests on Android (flutter/engine#18332)
2020-05-13<EMAIL_ADDRESS>Roll src/third_party/skia 3ebadcc98eab..056d543c91e0 (8 commits) (flutter/engine#18344)
2020-05-13<EMAIL_ADDRESS>[web] Represent CSS identity transforms as 'none' instead of null (flutter/engine#18288)
If this roll has caused a breakage, revert this CL and stop the roller
using the controls here:
https://autoroll.skia.org/r/flutter-engine-flutter-autoroll
Please CC<EMAIL_ADDRESS>on the revert to ensure that a human
is aware of the problem.
To report a problem with the AutoRoller itself, please file a bug:
https://bugs.chromium.org/p/skia/issues/entry?template=Autoroller+Bug
Documentation for the AutoRoller is here:
https://skia.googlesource.com/buildbot/+/master/autoroll/README.md

Commit queue failed; closing this roll.


Return rows with null values. Only show fill value input for time series

Fixes #110
This PR fixes the following:

There are two different issues here:

The Fill Value input only applies when the frames are formatted as Time Series. This is used to fill frames in the Time Series panel. We should not show it for table frames since it's indeed confusing.
Null values should be returned as null not the previous value (this is the behavior of the PostgreSQL data source, for example).

👍  Go changes look good to me


⚠ Bofrost.lu has degraded performance

In 5b6a819, Bofrost.lu (https://www.bofrost.lu) experienced degraded performance:

HTTP code: 200
Response time: 1406 ms

Resolved: Bofrost.lu performance has improved in c42c368.


Configurable Bundle size to upload to the server

IMPORTANT: All PRs must be linked to an issue (except for extremely trivial and straightforward changes).
Fixes #1483
Description

Added UploadConfiguration that the users can provide via FhirSyncWorker to override the max size of upload Bundle.
Added internal Splitter interface that BundleUploader now depends on to split all the LocalChanges into smaller chunks based on the provided UploadConfiguration.

Alternative(s) considered
Have you considered any alternatives? And if so, why have you chosen the approach in this PR?
Type
Choose one: Feature
Screenshots (if applicable)
Checklist

[x] I have read and acknowledged the Code of conduct.
[x] I have read the Contributing page.
[x] I have signed the Google Individual CLA, or I am covered by my company's Corporate CLA.
[x] I have discussed my proposed solution with code owners in the linked issue(s) and we have agreed upon the general approach.
[x] I have run ./gradlew spotlessApply and ./gradlew spotlessCheck to check my code follows the style guide of this project.
[x] I have run ./gradlew check and ./gradlew connectedCheck to test my changes locally.
[x] I have built and run the demo app(s) to verify my change fixes the issue and/or does not break the demo app(s).

Thanks @aditya-07
Other changes LGTM, Code Owner to have look once

@joiskash please take a look at this to see if this suits your needs.

@joiskash please take a look at this to see if this suits your needs.

This looks good, I was just wondering if referential integrity is maintained if we upload in the order of the changes created.

@joiskash please take a look at this to see if this suits your needs.

This looks good, I was just wondering if referential integrity is maintained if we upload in the order of the changes created.

Order doesn't matter if all the associated resources ( in terms of referential integrity) are in the same Bundle.
But, if they are split into separate Bundles,  referential integrity is maintained as long as the changes are created in the correct order e.g. An Encounter should be created before the associated Observations.
FhirEngine.create(vararg resource: Resource) creates the resources in order they are provided. So, as long as the create api is called with a correctly ordered list, referential integrity during uploads should be maintained.

Order doesn't matter if all the associated resources ( in terms of referential integrity) are in the same Bundle.
But, if they are split into separate Bundles,  referential integrity is maintained as long as the changes are created in the correct order e.g. An Encounter should be created before the associated Observations.
FhirEngine.create(vararg resource: Resource) creates the resources in order they are provided. So, as long as the create api is called with a correctly ordered list, referential integrity during uploads should be maintained.

Ok.. this may not be followed unless forced by the SDK. In our implementation, we checked for each resource that is referred to by the current resource and uploaded that first before uploading the current resource.

@williamito will you please be able to help with updating the documentation?

Order doesn't matter if all the associated resources ( in terms of referential integrity) are in the same Bundle.
But, if they are split into separate Bundles,  referential integrity is maintained as long as the changes are created in the correct order e.g. An Encounter should be created before the associated Observations.
FhirEngine.create(vararg resource: Resource) creates the resources in order they are provided. So, as long as the create api is called with a correctly ordered list, referential integrity during uploads should be maintained.

Ok.. this may not be followed unless forced by the SDK. In our implementation, we checked for each resource that is referred to by the current resource and uploaded that first before uploading the current resource.

the server might not have the referential integrity enforced either. in those cases this is not a problem.
however, i am very wary of opening up the uploader any further (e.g. letting the app decide the order of upload). we can have a separate discussion about that.


chore(k8s): Add helm-chart

Context
Adding a helm chart for prowler as discussed here: https://github.com/prowler-cloud/prowler/discussions/4358#discussioncomment-9937217
Description
Simple helm chart to deploy prowler for k8s.
Implemented additional logics for GKE as one of the paths (/srv/kubernetes) cannot be mounted in GCP clusters.
License
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Love this @shot4free , thanks!! Could you add the steps to deploy the helm chart in the README? That would be so helpful.

Done.


Ctrlr 5.6.23 exports restricted instance without menu

When exporting a (restricted) instance, it does succeed, both on windows and mac, but the menu is completely missing. Same happens when exporting from the vst3 and AU (mac). Also the window size is fixed with horizontal and vertical scroll bars.

Also using
panel:getPanelEditor():setProperty("uiPanelMenuBarVisible", 1, false)

doesn't make the menu bar appear, so it's proper missing or locked off.


Add the DesignCompose plugin

Move the SetFigmaTasks to the plugin and enable it for each app.
This enables the Tutorial app to be full split from the main build and for it to use the previous release of Android Studio, Electric Eel.
Tested by opening the Tutorial project in Electric Eel, building and launching the app and setting the token.
I've not yet applied it to MediaCompose, though I may be able to do that soon in a subsequent PR.
Closes #54
Closes #92

I'm still working on getting tests working so I'm putting up a PR for just the plugin.
I'm also still updating the docs, those updates will be added to this PR.


Not working with custom component children.

https://jsfiddle.net/3oh7znag/
This issue also affects "class" components.
(I'm not sure if this is identical with other getBoundingClientRect issues...)

Just wrap your custom components in <div>s
https://jsfiddle.net/d3dyy5p4/2/

Worked. Thanks!


Fix controller movement handling for flying

This PR addresses issue 64.
In the base RoR2 code, the movement input x and y components are used to create a Vector2, which is then used to rotate the camera's Transform's y component. The result is a movement vector calculated by taking the camera direction (a Transform) and rotating it by the movement input (a Vector2).
Currently, the CIL patch for controller movement handling in this mod works by rotating the movement input vector by an amount calculated based on the angle difference between the headset and controller vectors (both having been projected onto the xz plane).
This reworks the patch to instead just directly swap out the camera's Transform for the off-hand controller's Transform. No rotational difference calculations necessary!
(Note: the case of !HandsReady does not allow this solution, as no transform can be assumed to exist in that case AFAIK; I've just kept that specific branch of the old patch around to support that case.)
This change was lightly tested on my Vive running the latest version of RoR2, but it'd probably be a good idea to test it more thoroughly before merging this PR.

It does indeed feel better to ignore roll! Good catch there.
Hang on while I update this branch...

Nice work! I'll merge your changes now. Thank you for spending the time to do this!


Ruby SDK proposal Phase 1

Summary
This is the first phase of the API proposal for the new Ruby SDK
Motivation
We want to provide a Temporal SDK for Ruby users, allowing them to leverage
Temporal in their applications.
Detailed design
This is an interface proposal and all the details are included in the proposal itself
Drawbacks

implementation cost, both in term of code size and complexity
another SDK for Temporal to support

Alternatives
Alternatives to parts of the proposal are mentioned in the proposal itself
Adoption strategy
There are no current developers to consider here. However there are a few companies
using a Coinbase authored Ruby SDK. There is no current plan to support that migration.
But this shouldn't be too hard and a migration path might get provided by the community.
How we teach this
The full documentation on the SDK will follow once we start getting closer to a stable release.
Unresolved questions

RBS vs Sorbet for static typing
FFI vs Rutie for Core SDK integration

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Looks good :+1: Good work!

I took a first pass at aggregating the feedback and here are the currently open topics:

[] Configuration mutability
[] Binding Client to a single namespace
[] Client connection: eager vs lazy, connection sharing
[] Ruby typing
[] Passing workflow_id when calling #start_workflow
[] Using kwargs in activity/workflow interfaces
[] Core vs gRPC client
[] Worker shared thread pool
[] Worker start/stop
[] Worker configuration mutability
[] Workflow/Activity registration
[] Handling fatal Worker errors
[] Converter/Codec naming
[] follow_runs: true for the Handle#result
[] first_execution_run_id on Client#workflow_handle
[] Thread-local activity context

The discussions will continue in the original comment threads, but I'll reflect the overall alignment process here

Merged this since we pretty much agreed on the design.


multiple partitions

Hello to everyone,
I'd like to create two partition using littlefs, but I haven't found the way to do this.
There is a way to create more partition using littlefs?
Could someone help me?
Thanks,
Giovanni

You can create more than one drive in littleFs - you create and use two separate file systems, each with a separate file definition block (type lfs_t). These may be on different memories, or the same memory.
If you use the same block of memory for both file systems, decide how much memory is to be allocated to each file system. The low-level drivers which are called by littleFs receive a block number and offset within that file system's memory, and your drivers need to convert that into a start address within the right part of the memory.

similar to what @e107steved said,   I added a "block offset" item to the lfs_configuration so I can generically calculate the correct block offset in the block device functions .. This allowed me to initialize multiple lfs partitions that all use the same block device functions.  my primary partition starts at block_offset=0, while my secondary partition starts at block_offset=1024


Release Qualification - fortestonly

This is a generated PR that triggers release qualification tests, and will be automatically merged if all tests pass. In case some test fails, you can manually rerun the failing tests using /test. Force merging this PR will suppress the test failures and let the release pipeline continue.
none

@hklai: The following test failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

prow/istio-perf-tests.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test istio-perf-tests

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@hklai: The following tests failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

prow/istio-perf-tests.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test istio-perf-tests

prow/daily-e2e-rbac-no_auth.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test daily-e2e-rbac-no_auth

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@hklai: The following tests failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

prow/istio-perf-tests.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test istio-perf-tests

prow/daily-e2e-rbac-no_auth.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test daily-e2e-rbac-no_auth

prow/istio-unit-tests.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test istio-unit-tests

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@hklai: The following tests failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

prow/istio-perf-tests.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test istio-perf-tests

prow/daily-e2e-rbac-no_auth.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test daily-e2e-rbac-no_auth

prow/istio-unit-tests.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test istio-unit-tests

prow/daily-e2e-rbac-no_auth-default.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test daily-e2e-rbac-no_auth-default

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@hklai: The following tests failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

prow/istio-perf-tests.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test istio-perf-tests

prow/daily-e2e-rbac-no_auth.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test daily-e2e-rbac-no_auth

prow/istio-unit-tests.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test istio-unit-tests

prow/daily-e2e-rbac-no_auth-default.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test daily-e2e-rbac-no_auth-default

prow/daily-e2e-rbac-auth-default.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test daily-e2e-rbac-auth-default

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@hklai: The following tests failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

prow/istio-perf-tests.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test istio-perf-tests

prow/daily-e2e-rbac-no_auth.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test daily-e2e-rbac-no_auth

prow/istio-unit-tests.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test istio-unit-tests

prow/daily-e2e-rbac-no_auth-default.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test daily-e2e-rbac-no_auth-default

prow/daily-e2e-rbac-auth-default.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test daily-e2e-rbac-auth-default

prow/daily-e2e-cluster_wide-auth.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test daily-e2e-cluster_wide-auth

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@hklai: The following tests failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

prow/istio-perf-tests.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test istio-perf-tests

prow/daily-e2e-rbac-no_auth.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test daily-e2e-rbac-no_auth

prow/istio-unit-tests.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test istio-unit-tests

prow/daily-e2e-rbac-no_auth-default.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test daily-e2e-rbac-no_auth-default

prow/daily-e2e-rbac-auth-default.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test daily-e2e-rbac-auth-default

prow/daily-e2e-cluster_wide-auth.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test daily-e2e-cluster_wide-auth

prow/daily-e2e-rbac-auth.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test daily-e2e-rbac-auth

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@hklai: The following tests failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

prow/istio-perf-tests.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test istio-perf-tests

prow/daily-e2e-rbac-no_auth.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test daily-e2e-rbac-no_auth

prow/istio-unit-tests.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test istio-unit-tests

prow/daily-e2e-rbac-no_auth-default.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test daily-e2e-rbac-no_auth-default

prow/daily-e2e-rbac-auth-default.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test daily-e2e-rbac-auth-default

prow/daily-e2e-cluster_wide-auth.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test daily-e2e-cluster_wide-auth

prow/daily-e2e-rbac-auth.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test daily-e2e-rbac-auth

prow/daily-e2e-cluster_wide-auth-default.sh
d33d26c8506b07558baa8bde237d8b5635d91f57
link
/test daily-e2e-cluster_wide-auth-default

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.


feat: glaredb_upload(<filename>) table func

Summary
When a file is uploaded via GlareDB Cloud, it can be read with glaredb_upload(<filename>).
This function can only be called in remote and hybrid contexts; it is not meaningful locally.
The filename must contain a valid extension (foo.csv).
Example
After uploading a file called test.csv to GlareDB Cloud, it can be accessed like:
SELECT * FROM glaredb_upload('test.csv');

and joined with other data sources, etc.
Details
MVP File Format Limitations

Presently only:

CSV as filename.csv
Parquet as `filename.parquet
Newline-delimited JSOn as filename.json

are accepted.
The file name must currently include the extension.
The file can only use alphanumeric characters.

Testing

I tested this by building the image and running with a GlareDB Cloud environment.
I think it's tractable to write an integration test for this function, in the same vein
as other integration tests, but I'd prefer to leave this as a follow-up refinement
item.

Resolves: #2614

this all seems good, and I'd be fine merging it.

we could probably write tests for this using mino or the mock gcs fixture, but it'd be gnarly. Shouldn't do that today.
before we merge we should definitely go around and make sure the name is good.
want to make sure that it errors correctly, when running in pure local or embedded.

want to make sure that it errors correctly, when running in pure local

It does and we can easily add that test, I see no harm in it.

It does and we can easily add that test, I see no harm in it.

I was moving too quick mostly meant: "a really good error message" and not, say ("credentials not found") or something else.


How to read xdelta3 files with secondary compression enabled?

I'm not sure if I understand the code correctly, but the VCDiffStreamingDecoderImpl class bails out early if the delta file it sees has secondary compression such as lzma enabled. This, however, is the default when the vcdiff file was made with xdelta3. Worse yet, I can't seem to disable the secondary compression using the xdelta command line tool.
Is that a known issue?

I maintain a Java port of this code and got a similar question. Those are xdelta3 extensions, but the flags -S -n -A disable them.


First Coordinate group is sometimes set to [0.0, 0.0]

Description of the issue
I'm using the polyline library through pypolyline module in python3. When encoding a series of coordinates and decoding the polyline afterwards again I noticed that it is sometimes wrongly represented. It seems to be happening during the encoding step as also the encoded polyline string changes when encoding the same series of coordinates in this case.
The first coordinate group is set to [0.0, 0.0] and all following coordinates will be wrong as they just represent a modification of the predecessors.

My observations are that this is random behavior, so may be running the new test 10 times will also make macOS fail.

I've just modified the test to loop 10k times, and it doesn't fail on macOS. Hmm.


Create video on prototyping

Maybe on network pulse? You were tagged in the gdoc version of this @xmatthewx
https://mozilla.github.io/open-leadership-training-series/articles/opening-your-project/start-your-project-roadmap/
https://github.com/mozilla/open-leadership-training-series/blob/gh-pages/_articles/opening-your-project/start-your-project-roadmap.md#prototyping
tips on video creation: https://docs.google.com/document/d/11nGEQ3vuy7GtQwncb5MbDTAehLipC3kENT5zNF6QufY/edit?usp=sharing

Can we set aside a bit of time to discuss in the next couple of weeks?


Add Interface for rest.Context

Add an interface for rest.Context, and the ability to register a context, so that user can create a custom context wrapper for their needs

not needed


TypeError: VolatileMap is not a constructor

const VolatileMap = require("volatile-map")

const map = new VolatileMap(5000)

Thanks! There is an error in the example, should add .default after the require.
Your code should look like this:
const VolatileMap = require("volatile-map").default

const map = new VolatileMap(5000)

Will fix the docs.


Broken Link: Guide to Understanding the OpenAPS Toolkit

This link is broken:
Guide to understanding the openaps toolkit
on this page: https://github.com/openaps/docs/blob/master/docs/docs/walkthrough/manual/phase-1/using-openaps-tools.md

@Praxiteles fixed via https://github.com/openaps/docs/commit/4e9ee124d3f516818134e6200bd3339b920ca785, thanks.


external images don't appear in deck preview

I have a few images stored on 'imgur.com' for use in slides. They appear as expected in Obsidian's preview of the markdown file itself, but not in the 'Deck Preview' created by Marp Slides.
They also appear as expected in the files created by the 'Export as...' buttons at the top of the deck preview.
It would be great to be able to see them - same as with vault-local images - in the deck preview.
Any advice would be very welcome.
Many thanks!

Thanks for the speedy solution Samuele!


makefiles,readme,extra lib-161016

Hi,
I added the makefiles for each example. There is a general makefile in the FLAMEGPU folder that compiles all other makefiles. Simply run 'make all' .
By the way, use 'make HELP' for more info about preqs.
There is also a readme file with some notes about the makefiles.
Let me know if anything is not working properly.
Regards,
M.

A few comments:

make all doesn't work for me, errors with make: *** No rule to make target 'build_modes', needed by 'all'. Stop. for at least the GameOfLife Example
It may be better to rely nvcc being on the users path rather than forcing cuda toolkit version in the make file - i.e. I would need to change the makefile for each example to build it with cuda 8.
make HELP requires uppercase help, typically command line help options use lowercase
In the future, use a relevant branch name for the feature rather than the user (i.e. makefiles not mozhganKch)
There is no need to include a timestamp in the commit message, it is include in the meta-data of the commit.

renamed 'build', works now
about nvcc-> will discuss
-renamed to help
-removed extra flags for run_console
-branch name, timestamp noted


Create prepared statement examples

Simon has started on this for Java, we will follow the example for all of the sdk's

pinging @couchbaselabs/sdk-team so that people follow this :yellow_heart:

While I support this in theory, I don't know if we shouldn't just merge the 'prepared statement' example in the normal query placeholder example, or place the prepared stuff in comments, like so:
q = N1QLQuery(...)
# Uncomment the next line to make this a 'prepared' query
# q.adhoc = False

Rather than repeating an almost identical example just for one single flag. Since there is absolutely no user-facing different (other than a simple flag, and hopefully increased performance..)

ah didn't see Mark's remarks :frowning:, maybe I should have done a pull-request


update pkg & pkg-lock from ethers 5.5.1 to 5.7.1

Updated both package.json and package-lock.json files from<EMAIL_ADDRESS>to ethers @^5.7.1

It would be great to get this merged, siwe has started causing conflicts with other packages that rely on ethers.


Unexpect behavior from honesty example notebook

Hi team,
Thank you for your great project! I am recently running your honesty example notebook and trying to run through your provided example. However in the last two cells of honesty.ipynb. I got no meaningful output from the control side. I made no adjustments to the code and used the 7B model. Any ideas would be helpful!
Thanks

Hi, it's probably because of the variables:
layer_id = list(range(-10, -32, -1))
coeff=8.0

which needs to be tuned for each model. You can ref to honesty_mistral.ipynb for smaller version of honesty-controlled examples with Mistral-7B model.

Thanks! it works in honesty_mistral.ipynb. But how do you decide which layer_ids to use？

NVM I found one previous post that answer this question


"Add filename as title" does not seem to do anything

Describe the bug
Regardless of the state of the "Add filename as title" toggle in the plugin settings, my rendered pages  (uploaded here: https://carnet.pointecouteau.com/) don't display the filename as the page title, although my Markdown files do not have any h1 title.
Operating System
Fedora Silverblue 38
Screenshots

Hi this is related to #202, it will be fixed in the next release.

Hi, @KosmosisDire, just a quick question: I just discovered this issue in my instance (using it after a long time though). previously titles worked fine for me (file names as titles), but they're not appearing now at all! I hope it's coming out in .4?

This should be fixed in 1.8.0. Let me know if it still does not work as expected and reopen the issue. If you find any new issues please submit a new issue :)
Thanks!


Adding headers to HTTPError

**In Response to Issue #275 **
 Issue #275
I wanted to see if this is what you had in mind? I also read the link regarding the issue about adding to HTTPException and abondoning HTTPError?
#507
If you noticed I just added the headers to HTTPError and the handlers. I wanted to see which direction you are referring to?

Yup, I think this is the way I initially thought about this. :)

@teaglebuilt Bocadillo has now entered unmaintained state, as per #334. I'm closing this PR as a result. Thanks for your interest. :)


add swarm command

Signed-off-by: Victor Vieux<EMAIL_ADDRESS>

@tnachen the CI says the test fails but I cannot see why because it's on teamcity >.<

@vieux I'll take a look... is this ready for review (assume the build succeeds)?

the issue is here:
[14:14:42][Step 1/1] diff --git a/repo/meta/index.json.gz b/repo/meta/index.json.gz
[14:14:42][Step 1/1] index 2d33b0b..67e115e 100644
[14:14:42][Step 1/1] Binary files a/repo/meta/index.json.gz and b/repo/meta/index.json.gz differ
[14:14:42][Step 1/1] Process exited with code 1
[14:14:42][Step 1/1] Step Command Line failed

should be good now

Merging for now as our CI is down and it looks good to me