Error: “Chunk size too large, text got clipped”

Hello : )
First of all, thank you for your work! We are currently using it for a group project at university and it’s super helpful.
There is just one small issue: When we are using the restore_punctuation function on a large enumeration that is missing commas, we get a “Chunk size too large, text got clipped” error as shown below:

We can't seem to find a solution. Do you have any idea how to fix this?
Thanks in advance!
Phyllis
In case you want to replicate the error, this is the text snipped we are using:
“This is a list: Diindolylmethane (DIM) Dimethylaminoethanol (DMAE) Dong Quai Echinacea Eclipta Alba Egg Shell Calcium Elderberry Eleutherosides Emblica Essential Fatty Acids Energy EDTA Eurycoma Longifolia Evodia Extract Eye Health Ferulic Acid Fish Oils GABA Gamma Tocopherol Garlic Ginger Extract Ginkgo Biloba Ginseng Glucosamine Glutathione Goji Berry Gotu Kola GPC Choline Grape Seed Extract Green Coffee Bean Green Tea Gymnema Sylvestre Health Commentaries Health Questionnaires Heart Attacks Heart Health Herbs Hormone Support Huperzine Immune System Support Inflammation Joint Pain Kohki Tea L-Arginine L-Citrulline L-Cysteine L-Theanine L-Tyrosine Licorice Extract Life Extension Lipoic Acid Liver Support Longevity and Anti-Aging Lutein Luteolin Lycium Berry Lycopene Lysine Magnesium Magnolia Malic Acid Mastic Gum Medium-Chain Triglycerides Melatonin Memory Menopause Menaquinone-7 Men's Health Mental Health Metabolic Syndrome Minerals Mixed Tocopherols Multi-Vitamins Myricetin N-Acetyl Cysteine (NAC) N-Acetyl-carnosine Naringenin Nattokinase Nettle Notoginseng Nutrition Olive Leaf Oolong Tea Omega-3 Fatty Acids OKG Ornithine Oral Chelation Oral Health - Teeth and Gums Osteoporosis Overall Health Pain Relief Parkinson's Disease Passionflower Peony Persimmon Phenylalanine Pheromones Phosphatidylserine Phytosterol Pine Bark Policosanol Pomegranate Pregnenolone Probiotics Prostate Health Pueraria Mirifica Pumpkin Pygeum Africanum R-Lipoic Acid Red Wine Resveratrol Rhodiola Rosea Rosemary Salacia Reticulata Salvia Miltiorrhiza Schisandra Berry Selenium Sexual Health Silymarin Skin Hair and Nails Sleep Soy Phytosterol St John's Wort Stinging Nettle Stress Strontium Citrate Suntheanine Taurine Terminalia Chebula The Common Cold Turmeric Root Tyrosine Uridine Urinary Tract Health Urtica Dioica Root Varicose Veins Vinpocetine Vision Health"

you should write the code that split your text (you can use regex for that)  that passes the model that may solve your problem.

@phyllisgraf Sorry for the late response.  This problem is, that you have a lot of uncommon words with number in them. These texts create a lot of tokens which leads to an overflow - this causes the "chunk_size to large" error.
You can try to solve this issue if you:

Copy the code of this class to your code.
Reduce the "chunk_size" in this line  until the error disappears. Lets say you set it so 100, if the error occurs again, set it to 80 .. and so on.


MI - Data Services Documentation (Navigation)

This issue is to create the navigation structure for the data services topics. This is the continuation of [1].
[1] #73

Done.
[1] https://ei.docs.wso2.com/en/latest/micro-integrator/use-cases/examples/data_integration/rdbms-data-service/
[2] https://ei.docs.wso2.com/en/latest/micro-integrator/references/synapse-properties/data-services/


Help running refact tests

Not really an HLint issue but I'm hoping you can help @zliu41? As of yesterday, the HLint test suite skips the refact tests advising that my refact exe is too old and I need to get a new one. I'm a bit stuck on how to do that - I even went so far as to clone git@github.com:mpickering/apply-refact.git and stack build but even that doesn't seem to have a valid build plan. Do you have any advice?

Yeah HLint now requires apply-refact >= <IP_ADDRESS> because it relies on passing extensions to apply-refact via -X which is supported as of <IP_ADDRESS>.
If you have GHC 8.10 you can just do cabal install apply-refact, or if you don't: nix-shell -p 'haskell.packages.ghc8101.ghcWithPackages (ps: with ps; [])' --run "cabal install apply-refact"
Or you can install from nix directly: nix-env -iA nixpkgs.haskellPackages.apply-refact
You can also clone the repo and run cabal install.
Stack build no longer works because the required version of ghc-exactprint isn't on stackage.
I'm hoping to release a new version soon that supports more GHC versions which hopefully makes it easier.

If you have GHC 8.10 you can just do cabal install apply-refact,

That did it for me.

Stack build no longer works because the required version of ghc-exactprint isn't on stackage.

Perhaps temporarily the stack.yaml could be patched to go to the ghc-exactprint repo-commit-and-sha?

I'm hoping to release a new version soon that supports more GHC versions which hopefully makes it easier.

Most excellent. Thank-you!

Perhaps temporarily the stack.yaml could be patched to go to the ghc-exactprint repo-commit-and-sha?

Sounds like a plan!

Perhaps temporarily the stack.yaml could be patched to go to the ghc-exactprint repo-commit-and-sha?

Sounds like a plan!

Well, I don't know the right thing to do exactly in this instance but it's a shame it doesn't build out of the box 😉  Anyway, I'm working again so pay me no heed!


Add Sysdig agent to eks-anywhare-common addons

Removed eks-anywhere-snow and moved to eks-anywhare-common. Tester added

@shapirov103 @elamaran11 please note that the previous PRs that we cancelled were right.  The files are not marked ass deleted because the git detects that the same ymls that were deleted from the eks-anywhere-snow are not in eks-anywhere-common   that is the reason why you don't see deletions but renames instead

@shapirov103 @elamaran11 please note that the previous PRs that we cancelled were right. The files are not marked ass deleted because the git detects that the same ymls that were deleted from the eks-anywhere-snow are not in eks-anywhere-common that is the reason why you don't see deletions but renames instead

I see move is clearly marked on the files now. Thanks.

@shapirov103 Snow machine is also good to Approve. Please do the needful.


Don't listen to PS_JOIN_MASK in createPen

Example bytes:

	BYTE rectangleWithCustomBrush[] = {
		/* -- Placeable Header -- */
		/* Key */          0xD7, 0xCD, 0xC6, 0x9A,
		/* Hmf */          0x00, 0x00,
		/* Bounding Box */ 0x00, 0x00, 0x00, 0x00, 0x00, 0x0F, 0x00, 0x0F,
		/* Inch */         0xA0, 0x05,
		/* Reserved */     0x00, 0x00, 0x00, 0x00,
		/* Checksum */     0xB1, 0x52,

		/* -- Metafile Header -- */
		/* File Type */       0x01, 0x00,
		/* Header Size */     0x09, 0x00,
		/* Version */         0x00, 0x03,
		/* Total Size */      0x09 + 0x08 + 0x04 + 0x07 + 0x04 + 0x07 + 0x03, 0x00, 0x00, 0x00,
		/* Number Objects */  0x02, 0x00,
		/* Max Record Size */ 0x08, 0x00, 0x00, 0x00,
		/* No Parameters */   0x00, 0x00,

		/* -- META_CREATEPENINDIRECT -- */
		/* Size */      0x08, 0x00, 0x00, 0x00,
		/* Function */  0xFA, 0x02,
		/* Pen Style */ 0x00, 0x00,
		/* Width */     0x3F, 0x00, 0x00, 0x00,
		/* ColorRef */  0x00, 0x00, 0xFF, 0x00,

		/* -- META_SELECTOBJECT -- */
		/* Size */         0x04, 0x00, 0x00, 0x00,
		/* Function */     0x2D, 0x01,
		/* Object Index */ 0x00, 0x00,

		/* -- META_CREATEBRUSHINDIRECT -- */
		/* Size */       0x07, 0x00, 0x00, 0x00,
		/* Function */   0xFC, 0x02,
		/* BrushStyle */ 0x02, 0x00,
		/* ColorRef */   0x00, 0xFF, 0x00, 0xFF,
		/* HatchStyle */ 0x04, 0x00,

		/* -- META_SELECTOBJECT -- */
		/* Size */         0x04, 0x00, 0x00, 0x00,
		/* Function */     0x2D, 0x01,
		/* Object Index */ 0x01, 0x00,

		/* -- META_RECTANGLE -- */
		/* Size */       0x07, 0x00, 0x00, 0x00,
		/* Function */   0x1B, 0x04,
		/* BottomRect */ 0x00, 0x08,
		/* RightRect */  0x00, 0x07,
		/* TopRect */    0x00, 0x03,
		/* LeftRect */   0x00, 0x02,

		/* -- META_EOF -- */
		/* Size */     0x03, 0x00, 0x00, 0x00,
		/* Function */ 0x00, 0x00
	};

Before:

After:

It seems to lose the rounded edges in the After version, is that expected?

This is how the data are rendered in Microsoft Paint on Windows (regular GDI I assume):

Ah, perfect. I tried some online converters since I'm not at my Windows box and they suggested rounded corners but I trust Paint more :)

I don't think this change is correct. In Win32 API the join masks are respected when PS_GEOMETRIC flag is set (https://msdn.microsoft.com/en-us/library/windows/desktop/dd162705(v=vs.85).aspx). PS_GEOMETRIC flag has the value 0x10000. The value cannot be expressed within WMF files, so the join mask should really be ignored there. For EMF files, however, it is possible to express and it calls into the same gdip_metafile_CreatePenIndirect function. I think the code should be returned back with a check around it that PS_GEOMETRIC flag is set.

Ah i see. I only tested with metafiles where this PR was correct. Didn't notice that I was changing EMF behaviour.
I submitted #266. I noticed that CreatePen doesn't even listen to line caps so really CreatePenIndirect and ExtCreatePenIndirect should be handled separately from each other


Docs Audit - Utilities

Resolves #1049
Utilities

[x]  Code Blocks
[x] Drawers
[x] Lightswitch
[x] Local Storage Store
[x] Modals
[x] Toasts
[x] Popups

@DukeRupert looks like there was a bit of a miscommunication, so heads up about some changes made in this PR:
https://github.com/skeletonlabs/skeleton/pull/1073

Ok, that is my bad, I was looking at old stuff that showed the section as unassigned still. Single file though so it should not be horrific.

Small one, but the current setter imports reference (I assume) old function imports.
import { setUserPrefers, setMode } from '@skeletonlabs/skeleton';
should be
import { setModeUserPrefers, setModeCurrent } from '@skeletonlabs/skeleton';

@dirk-bester No problem, we are moving fast which means that this is kind of inevitable. Thanks for helping. @endigo9740 Thanks for giving me the heads up.

@endigo9740 On the lightswitch page the title does not match the url, which is different from the others. Would you like it to be singular, plural or keep it as is?

@DukeRupert let's go ahead and leave that as is. Our convention for URLs is plurals, but the singular version reads better on the page itself. We reference that page from a couple places in the docs, so easiest solution is just to leave it. But thanks for asking!

https://skeleton-docs-p4sbl8cv7-skeleton-labs.vercel.app/utilities/drawers abitrary strikes again. Could probably use a global search for it. I see 20 locally but I am not merged to the latest atm.

https://skeleton-docs-p4sbl8cv7-skeleton-labs.vercel.app/utilities/drawers
Props, the bottom 2

labelledby
string
-
Provide an ID of the element labeling the drawer.

describedby
string
-
Provide an ID of the element describing the drawer.

Everything is camelCase except these two.

https://skeleton-docs-p4sbl8cv7-skeleton-labs.vercel.app/utilities/local-storage-stores
const storeExample: Writable = localStorageStore('storeExample', 'initialValueHere');
This self documents via 'initialValueHere'
// Subscribe to the store
storeExample.subscribe(() => {});
Should this and similar do something like a console log? Or 'typical' usage?
Or maybe in a future "examples" effort link to source code in example apps?
Anything to make it a quick concise learn rather than yet another research project when you are brand new to svelte and skeleton and typescript and everything. Speaking from recent and continuing experience of course ;-)

https://skeleton-docs-p4sbl8cv7-skeleton-labs.vercel.app/utilities/modals
.w-modal | - | Sets a standard responsive width for modals.
.w-modal-slim | - | Create a slimmer modal. Great for small component modals.
.w-modal-wide | - | Create a wider modal. Great for full screen component modals.
It is unclear to me where I would use these classes.

@dirk-bester Good feedback. To address each post above:

We're aiming to do global fixes last, rather than in these piecemeal passes. We will fix the arbitrary spelling soon.
label/describeby are ARIA attributes. They are verbatim here. We'll leave those as is
All instruction for local storage store comes from the original author (see the link at the bottom of the page). Again I suggest we leave as is unless people starting raising and issue - you're the first in the months since this was added.
I agree with the modal classes. These are demonstrated in the example component modals, but a small bit of text in the accordion would be beneficial. They're for standardizing custom modal width sizes.

@DukeRupert I'm devoting some time to these PRs today, so I'll go ahead and implementing the remaining items per my message above. Then aim to merge this in to dev branch. Thanks again for your contributions!


ppInk Crash

Hi, love the program, but every once in a while, ppInk crashes.
Here is the info from crash.txt:
12 / 09 / 2020 22:02UIThreadException

Oops, gInk crashed! Please include the following information if you plan to contact the developers (a copy of the following information is stored in crash.txt in the application folder):

Object reference not set to an instance of an object.

Stack Trace:
   at System.Windows.Forms.NotifyIcon.ShowContextMenu()
   at System.Windows.Forms.NotifyIcon.WndProc(Message& msg)
   at System.Windows.Forms.NotifyIcon.NotifyIconNativeWindow.WndProc(Message& m)
   at System.Windows.Forms.NativeWindow.Callback(IntPtr hWnd, Int32 msg, IntPtr wparam, IntPtr lparam)

Can you please provide more information about context : were you clicking on some button ?
can you indicate also which version you are using ?
Thanks

i have some concern to analyze your problem : your report is not reporting any line code... Can you confirm you are working with latest version. which windows are you running ?

I downloaded the program a few days ago. I am on Windows 10 H2H2.

Can you try this test version:
ppInkTst.zip
It is an in progress version. I've checked that lines are reported. can you tell me if the issue is present and try to define the except scenario that leads to the problem. Thks

Couldn't reproduce the problems. Either a fluke or the new version solves it. Thanks!


Extends name space not work ?

Hi, do i miss something, it seem am not able to extend the PIXI.sound CLASS ?
i would like to extends the CLASS to add more custom feature for my custom projet.
But i get error

I wanted to keep a uniform structure everywhere but assuming this it ok for now.
I dont like this way but i will use it.
let $audio = PIXI.sound;

  $audio.initialize = function() {

  };

  /** Destroys all sounds from cache {keep perma}*/
  $audio.destroy = function(perma){
    this._sounds.forEach(s => { !s._perma && s.destroy() });
  };

let see if any other suggest :) or close thanks


GetValidMethodAccess causes exception.

Brief Description
Even though method.IsOverride is true, ((Class) method.Namespace).GetBaseMethod(method) returns null. As a result of this, GetValidMethodAccess causes null reference exception.
OS: OS X
Used headers
class Q_WIDGETS_EXPORT QWidget : public QObject, public QPaintDevice
{
....
int metric(PaintDeviceMetric) const Q_DECL_OVERRIDE;
This exception is caused in QWidget's metric.
Even though  QPaintDevice's metric exists, QPaintDevice's metric doesn't exists in AST,
which causes exception.
Used settings
Qt5.9
Default QtSharp

I'm sorry for lack of information. I continue to find a bug myself.

This bugs are solved. Thank you.


kean/Yalta

Yalta - An intuitive and powerful Auto Layout library
Language - Swift

https://github.com/vsouza/awesome-ios/pull/2333


Nitweb clean

Cleans some misc part of Nitweb. Notable fact, replace the hover on cards by a dropdown menu with caret.
Can be seen here: http://nitweb.moz-code.org/doc/core::array
For now, the dropdown menu allows the user to swtich between signature and documentation. More contextual options in the future.
This looks quirk with the stars rating (left untouched in the new dropdown system) so still need the mouse over. Since the next PR rewrite this part, I will let this as it is.
We load the stars only when the dropdown is selected so we gain some perfs on the home page.
This PR is based on #2265

I like the dropdown caret
Also, maybe keep the title (even in a reduced font) so we still know what is the entity on the card.
The doc should be disabled of something if there is only a synopsys since it is already in the front part of the card.

+1

Menu invisible on Firefox.

I don’t know why, but I don’t see the caret you are talking about.

On firefox:

Maybe clean your cache? What version are you using?

I even tried with a clean version of Chrome and nothing appeared. Now I see them. Weird. UQAM network I gess.

:+1:

Responsive/20

@Bl4ckb0ne: We have #2177 for that.

I will merge the other PR, you can rebase this one after.

test this please

http://gresil.org/jenkins/view/Intégration/job/nit_tests/engine=nitg-s,label=deploy_linux/1256/testReport/tests.nitcs.src/nitweb/nitweb/


ci: Add ability to skip

Adding [skip ci] or [ci skip] will allow CI to not run on push events.

Coverage remained the same at 100.0% when pulling 8dac378b7f476ed64239d8aae4190f0c0f284a85 on add-skip-ci into beba157c3aee4ba6cf643645373b38f4fa8f5c66 on main.

Abandoning. Decided to go another way.


The big one

Due to the way that certain y-e components are dependent on one-another, this PR is larger than it should be and touches many parts of the exporter repo.
This PR:

[x] asyncifies the vaults exporter
[x] asyncifies the treasury exporter
[x] asyncifies the sms exporter
[x] asyncifies the treasaury-tx exporter
[x] asyncifies the transactions exporter
[x] asyncifies the wallet exporter
[x] asyncifies the partners exporter
[x] significantly speeds up treasury-txs, partners, transactions exporters
[x] batches calls in the backend, massively reducing total # of http requests and volume of data transfer
[x] extracts yearn.prices functionality from this repo, replacing with ypricemagic
[x] replaces the treasury txs exporter and treasury exporter with more streamlined, optimized versions of the code.

Still working on:
as this is supremely large, there are a few things left to debug. I am working on each locally but any help is welcome:

[x] arbitrum exporters are having trouble with closest_block_after_timestamp
[ ] arbitrum exporters are unable to progress past yearn's init file. Check diff brownie versions
[ ] arbi exporters having trouble with "vault" creamusdc which is clearly not a vault
[ ] there will be other things I'll add here as I continue with testing/fixing

Todo:

[ ] validating actual outputs
[ ] cleaning up code snippets that are no longer utilized
[ ] check me to feel good when finished

I'll flesh this comment out more as I proceed thru testing

containers look good:
Mainnet:
[ ] vaults
[ ] transactions
[ ] wallets
[ ] treasury
[ ] treasury-tx
[ ] sms
[ ] partners
Fantom:
[ ] vaults
[ ] transactions
[ ] wallets
[ ] treasury
[ ] treasury-tx
[ ] sms
[ ] partners
Arbitrum:
[ ] vaults
[ ] transactions
[ ] wallets
[ ] treasury
[ ] treasury-tx
[ ] sms
[ ] partners
Optimism:
no optimism containers are running. I keep getting "too many calls" so I'm currently running one container and allowing it to populate the cache
[ ] vaults
[ ] transactions
[ ] wallets
[ ] treasury
[ ] treasury-tx
[ ] sms
[ ] partners
Gnosis:
No gnosis containers are running due to non verified curve registry. Fix complete, test in progress.
[ ] vaults
[ ] transactions
[ ] wallets
[ ] treasury
[ ] treasury-tx
[ ] sms
[ ] partners

closing, we merged big temp instead


Owner credentials moved into User Identity table

Since most of our authenticators use the UserIdentity table, it makes
sense for us to store a user's credentials (login, salt, password)
there as well. This patch moves the credentials fields into the
identity table directly, since we don't want to put them in claims
(which are search indexed).

Coverage remained the same at 100.0% when pulling 7527a42d7c40ddd060a672f83cf65d4200a9cf6f on feature/identity_creds into 9cc88406f48b783cf723cc4e688abac348b7eaa5 on develop.


Not respecting rotation value

First and foremost thanks for awesome library. While scary at first, but example project provides in depth instructions how to use everything.
My use case is simple - user selects a video and then I suggest compressing options that can be used before uploading video file to backend.
We encountered issues with compressing videos from SM-G920F ( Samsung S6 ) running Android 7.0. When user selects a vertical video from device and library is used to compress video (even without changing video resolution) resulting video is rotated 90 degrees. I double checked and MediaFormat.KEY_ROTATION is returning 90 on source video.
I first though that's the issue with my code but then I built sample app provided in this repo and ran it on phone in question. Selected first option Transcode Video/Audio (GL Renderer) -> selected vertical video from device -> choose transcode option on video track. Regardless of resolution I choose (even when using same width/height as in source video) after transcoding resulting video is horizontal
Here is link for videos taken with that phone (horizontal and vertical) plus resulting video after compression.
All other phones I tested with Pixel4A Android 13, Samsung S9+ Android 10, Samsung S9 Android 9, Samsung A71 Android 12, Samsung A50 Android 10, Huawei P20 Android 10 they work properly
Is it something device specific? Can you push me in correct direction on what can be done from my side ?

Happy you are enjoying LiTr!
Which tranform method are you using? What is your target MediaFormat? I will try to reproduce this issue on my end.

I'm using following method of MediaTransformer class
 public void transform(@NonNull String requestId,
                          List<TrackTransform> trackTransforms,
                          @NonNull TransformationListener listener,
                          @IntRange(from = GRANULARITY_NONE) int granularity)

This is how I construct target media format video track:
    private fun createVideoMediaFormat(videoTrack: VideoTrackFormat): MediaFormat {
        return MediaFormat().apply {
            setString(MediaFormat.KEY_MIME, MediaFormat.MIMETYPE_VIDEO_AVC)
            setInteger(MediaFormat.KEY_WIDTH, videoTrack.width)
            setInteger(MediaFormat.KEY_HEIGHT, videoTrack.height)
            setInteger(MediaFormat.KEY_BIT_RATE, videoTrack.bitrate)
            setInteger(MediaFormat.KEY_I_FRAME_INTERVAL, videoTrack.keyFrameInterval)
            setInteger(MediaFormat.KEY_FRAME_RATE, videoTrack.frameRate)
            setLong(MediaFormat.KEY_DURATION, videoTrack.duration)
            setInteger(MediaFormat.KEY_ROTATION, videoTrack.rotation)
        }
    }

VideoTrackFormat is basically a copy from your sample project.
We are not aiming to be video production app, therefore we provide limited set of resolutions. This is how we map Video track according to user selected option
    private fun mapMediaTrackFormat(
        track: MediaTrackFormat,
        option: VideoCompressionOption
    ) = when (track) {
        is AudioTrackFormat -> track.copy(bitrate = DEFAULT_AUDIO_BITRATE) // we modify only audio quality for audio tracks
        is GenericTrack -> track
        is VideoTrackFormat -> {
            when (option) {
                VideoCompressionOption.ORIGINAL -> track.copy(bitrate = option.bitrate) // keep resolution, angle, etc. just modify bitrate
                else -> track.copy(
                    width = option.width,
                    height = option.height,
                    bitrate = option.bitrate,
                    rotation = videoRotation(option, track.isVertical)
                )
            }.copy(keyFrameInterval = DEFAULT_KEY_FRAME_INTERVAL)
        }
    }

    private fun videoRotation(option: VideoCompressionOption, isVideoVertical: Boolean): Int {
        val destinationIsVertical = option.height > option.width
        var rotation = 0
        if (isVideoVertical) {
            if (!destinationIsVertical) rotation = 90 // source is vertical, destination resolution is not, so rotate it
        } else {
            if (destinationIsVertical) rotation = 90 // source is horizontal, destination resolution is not, so rotate it
        }
        return rotation
    }

I consider source video vertical via following condition
    val isVertical: Boolean
        get() = height > width || rotation > 0

Rotation on the video you sent me is -90, which I think would not play well with rotation > 0 logic.

The logic I use to downscale a video just reduces the smallest dimension (AKA resolution) to desired value, adjusts larger dimension to keep aspect ratio and maintains original orientation. Works pretty well.

Rotation on the video you sent me is -90, which I think would not play well with rotation > 0 logic.

Fair enough, but sample project does not modify rotation and yet if video is transcoded with it, it's flipped as well horizontally as well?  Can you please point me where should I take a look in sample project's code?

Also I double checked rotation value.
I tried both methods using
val mediaMetadataRetriever = MediaMetadataRetriever()
mediaMetadataRetriever.setDataSource(context, uri)
mediaMetadataRetriever.extractMetadata(MediaMetadataRetriever.METADATA_KEY_VIDEO_ROTATION)

And via
 val mediaExtractor = MediaExtractor()
 mediaExtractor.setDataSource(context, uri, null)
val mediaFormat = mediaExtractor.getTrackFormat(trackIndex)
mediaFormat.getInteger(MediaFormat.KEY_ROTATION)

Both return 90?

Interesting. ffprobe is showing -90
I will debug on my end

I tried with LiTr demo app, it works fine. I think there is some corner case your rotation calculation is not catching.

Can you compare final width, height and rotation values that make up a target media format in your logic? I wonder if width and height are getting messed up.

Thanks for taking your time to look into it!
However as I already pointed out we moved our code out of the equation, there is no rotation logic. I'm not using any of our code. Issue is reproducible when using Samsung S6 SM-G920F with sample LiTr application provided in this repository
Please take a look at sample videos
We connected phone in question and cloned LiTr project from github using Android Studio. In provided video you can see we are doing fresh install of LiTr sample project from github on Samsung S6. Then we record vertical video and go back to LiTr app. Select Transcoding option, select freshly recorded video, input same width and height as in original video file and click transcode. Resulting video is flipped. There's no code from our side - only LiTr project code without any modifications (fresh pull and install)
I do think this is device specific?

I tried this on my Pixel 3 and transcoded video is portrait. So the problem here seems to be device related.
From your video (thank you for providing them!) I noticed that width and height of target video get switched - 1920w x 1080w becomes 1080h x 1920w, while rotation of 90 is preserved by LiTr. So you end up with portrait resolution video which is displayed with 90 degree rotation, which makes it landscape.
My guess is that this is happening because Samsung Galaxy S6 media stack is trying to be clever and actually change the video resolution to match desired orientation.
Let's try something. Can you try to comment out line 748 in TransformationPresenter in LiTr demo app and try again on S6? Let's see if not setting rotation on a track metadata will help.

Thank you so much for taking your time. We decided to drop support for android 6 and this device along with it.
I'm closing the issue so that it doesn't mess with repo stats :)


Fix qt5 include paths on linux

With this change, the package will at least build on different architectures on Linux. There is bound to be an even better way to figure out these paths independent of the platform, though.

@tpisto, @fabong: ping?

Yes, you're right. It's better if it works. I'll try it.

Your fix is not working anymore with with jessie debian distribution.
But I agree with you : it will be better to set variable to make it works on each version, platform and architecture of linux. We can see on each architecture lists that there is a common pattern : ()https://packages.debian.org/en/jessie/qtbase5-dev#pdownload

Well, what do other packages that link against qt5 do to figure which path to use? This package should do the same. Note that this is Debian specific, and that other distros do put the headers in /usr/include/qt5/.

Yes, got it. I'm gonna find a solution to make debian distributions work with your fix. Unfortunately, I'm a bit busy, I'll do it this weekend.

Ihe Qt5 libraries are not in myLibraries, I also get an undefined symbol error for symbol _ZN10QByteArray11shared_nullE.

@tpisto, @fabong: It's been a week already, can you please pull this?

@andreas-gruenbacher sorry, I didn't see. I'm testing it.

It's working correctly.

I'm also testing it on macOS Sierra

It's not working anymore with macOS Sierra.

If we can define myLibraries by os, it will be better.

What errors do you get on macOS? Where does macOS have the Qt5Core.pc and Qt5Gui.pc pkgconfig files?

You should just create an other myLibraries for

[ fabong MacBook-Pro-de-Fabrice ~/git/pdf-filler ] npm i
\
><EMAIL_ADDRESS>install /Users/fabong/git/pdf-filler/node_modules/pdf-fill-form
> node-gyp rebuild

gyp WARN download NVM_NODEJS_ORG_MIRROR is deprecated and will be removed in node-gyp v4, please use NODEJS_ORG_MIRROR
gyp WARN download NVM_NODEJS_ORG_MIRROR is deprecated and will be removed in node-gyp v4, please use NODEJS_ORG_MIRROR
Package Qt5Core was not found in the pkg-config search path.
Perhaps you should add the directory containing `Qt5Core.pc'
to the PKG_CONFIG_PATH environment variable
No package 'Qt5Core' found
Package Qt5Gui was not found in the pkg-config search path.
Perhaps you should add the directory containing `Qt5Gui.pc'
to the PKG_CONFIG_PATH environment variable
No package 'Qt5Gui' found
gyp: Call to 'pkg-config --cflags Qt5Core Qt5Gui cairo poppler-qt5' returned exit status 1 while in binding.gyp. while trying
to load binding.gyp
gyp ERR! configure error
gyp ERR! stack Error: `gyp` failed with exit code: 1
gyp ERR! stack     at ChildProcess.onCpExit (/Users/fabong/.nvm/versions/node/v4.7.0/lib/node_modules/npm/node_modules/node-gy
p/lib/configure.js:305:16)
gyp ERR! stack     at emitTwo (events.js:87:13)
gyp ERR! stack     at ChildProcess.emit (events.js:172:7)
gyp ERR! stack     at Process.ChildProcess._handle.onexit (internal/child_process.js:211:12)
gyp ERR! System Darwin 16.3.0
gyp ERR! command "/Users/fabong/.nvm/versions/node/v4.7.0/bin/node" "/Users/fabong/.nvm/versions/node/v4.7.0/lib/node_modules/
npm/node_modules/node-gyp/bin/node-gyp.js" "rebuild"
gyp ERR! cwd /Users/fabong/git/pdf-filler/node_modules/pdf-fill-form
gyp ERR! node -v v4.7.0
gyp ERR! node-gyp -v v3.4.0
gyp ERR! not ok
npm ERR! Darwin 16.3.0
npm ERR! argv "/Users/fabong/.nvm/versions/node/v4.7.0/bin/node" "/Users/fabong/.nvm/versions/node/v4.7.0/bin/npm" "i"
npm ERR! node v4.7.0
npm ERR! npm  v2.15.11
npm ERR! code ELIFECYCLE

npm ERR<EMAIL_ADDRESS>install: `node-gyp rebuild`
npm ERR! Exit status 1
npm ERR!
npm ERR! Failed at the<EMAIL_ADDRESS>install script 'node-gyp rebuild'.
npm ERR! This is most likely a problem with the pdf-fill-form package,
npm ERR! not with npm itself.
npm ERR! Tell the author that this fails on your system:
npm ERR!     node-gyp rebuild
npm ERR! You can get information on how to open an issue for this project with:
npm ERR!     npm bugs pdf-fill-form
npm ERR! Or if that isn't available, you can get their info via:
npm ERR!
npm ERR!     npm owner ls pdf-fill-form
npm ERR! There is likely additional logging output above.

npm ERR! Please include the following file with any support request:
npm ERR!     /Users/fabong/git/pdf-filler/npm-debug.log

I think the following examples should help getting this fixed for macOS as well:
https://gist.github.com/LogIN-/54b8bebd12de24eb884b
https://github.com/atom/node-keytar/pull/46/files
I can test on Fedora.

@fabong, are you happy with this version now?

@tpisto, @fabong: ping?

i tried yesterday and It was not working. I want to find what is wrong because it seems great.

@fabong: was there any progress in the last three weeks? Thanks.

Sorry, I just was a bit busy last month. I retry it and it's working on macOS. I just needed to reinstall qt5 like :

@tpisto: Can you please pull this now that @fabong has verified that it works? Thanks.


Error if first node is down in 3 node Master-Master cluster

I have a Master Master redis cluster of 3 (node1,node2,node3). Locking mechanism works fine if we block the network for node2 or node 3. But if we block node1's network then it fails with the below error
Exception in thread "main" org.redisson.client.RedisNodeNotFoundException: No node for slot: 15087 and command (EVAL)
at org.redisson.connection.MasterSlaveConnectionManager.getEntry(MasterSlaveConnectionManager.java:578)
at org.redisson.connection.MasterSlaveConnectionManager.connectionWriteOp(MasterSlaveConnectionManager.java:563)
at org.redisson.command.CommandAsyncService.async(CommandAsyncService.java:368)
at org.redisson.command.CommandAsyncService.evalAsync(CommandAsyncService.java:334)
at org.redisson.command.CommandAsyncService.evalWriteAsync(CommandAsyncService.java:282)
at org.redisson.RedissonLock.tryLockInnerAsync(RedissonLock.java:207)
at org.redisson.RedissonLock.tryAcquire(RedissonLock.java:139)
at org.redisson.RedissonLock.tryLock(RedissonLock.java:225)
at com.seamless.common.cache.distributed.LockManager.getLock(LockManager.java:37)
at com.testlock.app.App.main(App.java:34)

Below is how I'm creating the Redission client
`
import java.util.List;
import java.util.concurrent.TimeUnit;
import org.apache.log4j.Logger;
import org.redisson.ClusterServersConfig;
import org.redisson.Config;
import org.redisson.ReadMode;
import org.redisson.Redisson;
import org.redisson.RedissonClient;
import org.redisson.core.RLock;
public class LockManager {
private static final Logger LOG = Logger.getLogger(LockManager.class);

private RedissonClient redissonClient;

LockManager(List<String> nodes){
	Config config = new Config();
	ClusterServersConfig serverConfig=config.useClusterServers();
	serverConfig.setReadMode(ReadMode.MASTER);

	for(String node :nodes){
		serverConfig.addNodeAddress(node);
	}
	redissonClient = Redisson.create(config);

}

public boolean getLock(final String lockKey,int timeout){
	RLock lock=redissonClient.getLock(lockKey);
	try {
		return lock.tryLock(0, timeout, TimeUnit.MILLISECONDS);
	} catch (InterruptedException e) {
		LOG.error("Error getting lock "+e.getMessage());
	}
	return false;
}

public void releaseLock(final String lockKey){
	RLock lock=redissonClient.getLock(lockKey);
	if(lock.isHeldByCurrentThread())
		lock.unlock();
}

}
`

Locking mechanism works fine if we block the network for node2 or node 3. But if we block node1's network then it fails with the below error

This error occurs because master for slot 15087 was shutdown. Failover did not work because you have no slave server for this master. Add slave servers for each master

@mrniko Thanks for the quick response. But I have few question

The RedLock algorithm mentioned is supposed to work with master master setup(without any slave)?
If I'm supposed to add slave for each master do I need to configure in the Redission config as well. Like instead of ClusterServersConfig serverConfig=config.useClusterServers(); shall I use config.useMasterSlaveServers() . If so in the API I can only find methods to add only one master address.
Thanks in advance.

P.S I'm new to Redis.

@mrniko so this means that Redission's Redlock algorithm will work only with Master-Slave model in terms of fail over ?There is no internal failover mechanism build in the client? Suppose I have 3 redis node cluster in master-master mode. I have created the client with round robin load balancer.Now in normal scenario if I try to acquire a lock it works fine. If now out of three 1 node goes down. Now if I go to acquire a lock should it fail or should it acquire in the active 2 nodes (according to the Redlock algorithm).
P.S In my case it fails.

If you talking about RedLock where you need to acquire N locks, then you need to use RedissonMultiLock object

@mrniko  Thanks .One quick question will RedLock algorithm work if 3 redis master nodes are connected in cluster mode or is it necessary that they are independent masters not connected in a cluster?

@MdSarfarazKhan RedissonMultiLock doesn't depend on RLock source. So it should work in a cluster too.

@MdSarfarazKhan What is your solution of this issue? I try to use RedissonMultiLock with 5 independent masters, But it will throw exception if I shutdown one of the nodes.

Any master has hashslot down -> cluster down -> exception

@dotrungduchd  According to the  Redlock algorithm(http://redis.io/topics/distlock), if a redis instance is not available it should try to talk with next instance but not throw exception. Did I make  mistake in using RedissonMultiLock?

Will solve this issue in 2.2.7. See issue #533


Create Dynamic PudlTabl methods

Scope
This PR adds the ability to dynamically generate PudlTabl methods for retrieving dagsterized output tables from the PUDL DB. It also adds the output table denorm_balance_sheet_assets_ferc1, which can be used for demonstration/testing.

I definitely think we should remove the old methods once we know which to keep, or it's going to start getting confusing. If we want we could define a list of tables that should have PudlTabl methods if loading all of the assets is casting too broad a net.

I suppose there is the potential we'll have denormalized assets that use the default io manager and aren't written to the database. For example, we might not want to load pu_eia to the database.
We could filter out assets based on io_manager they use:
for asset in output_assets:
    # Iterate through assets keys because multi_assets contain a key for each asset it produces
    for key in asset.keys:
        io_manager = asset.get_io_manager_key_for_asset_key(key)
        # We only want to create methods for assets that have been loaded to the DB
        if io_manager == "pudl_sqlite_io_manager":
            asset_name = key.to_python_identifier()

            # Create method called asset_name that will read the asset from DB
            self.__dict__[asset_name] = partial(
                self._get_table_from_db,
                table_name=asset_name,
                resource=Resource.from_id(asset_name),
            )

If a table isn't getting written to the database, should it have a Resource definition? I guess we have some of these right now like plant_parts_eia
So are the only criteria for accessing the table through PudlTabl that:

the table has a Resource definition.
the table is written into the database.

Also I think we can't get around needing to have a manually compiled dictionary that maps our old method names to the underlying tables which they represent, since we abbreviated many of them.

Good point about the abbreviations. If we need a mapping of table names to method names I guess we don't need to mess with importing assets and filtering by io_manager_key? Just have something like this:
def _register_output_methods(self):
        """Load output assets and register a class method for retrieving each one."""
        table_method_mapping = {
          "denorm_plants_utils_ferc1": "pu_ferc1",
          "advanced_metering_infrastructure_eia861": "advanced_metering_infrastructure_eia861",
          ...
        }
        for table_name, method_name in table_method_mapping.items():
            self.__dict__[method_name] = partial(
                self._get_table_from_db,
                table_name=asset_name,
                resource=Resource.from_id(table_name),
            )

Ohh I think the CI is failing because the runner ran out of memory when reading in the demand_hourly_pa_ferc714 table. This wasn't happening before because @zaneselvans adjusted reading logic in PudlTabl.demand_hourly_pa_ferc714() to read in chunks then concat:
# Concatenating a bunch of smaller chunks reduces peak memory usage drastically
      # and doesn't seem to take any longer.
      return pd.concat(
          [
              # enforce_schema() cuts memory use by ~70% b/c of categorical tzones
              dhpa_res.enforce_schema(df)
              for df in pd.read_sql(
                  "demand_hourly_pa_ferc714",
                  self.pudl_engine,
                  chunksize=100_000,
              )
          ]
        )

I don't think there is any harm in using this chunking logic for all of the tables.

Good call on reading in chunks, I just made that update

We're reading all the tables in chunks in the IO Managers now too and it seems to work well and doesn't add a noticeable amount of time.  The peak memory usage is reduce by a crazy amount. Like 10x.  I don't really understand why.

Oh whoops I forgot about the pickling issue :/

I think @arengel said we should probably go ahead and remove the pickling infrastructure and they would stick with an older version until the transition is complete.

Oh I see. I removed the changes in #2251.

I'm going to go watch the sunset and if it CI passes I'll merge it in when I get back and do some work on #2490 this evening / over the weekend.


give the map generator a name

Could you give the Map generator class a name?
i want to extend it to make my own ready function without messing with the original
i added one for me to use it: TDMapGenerator
But any would do ;)

Ahhh and the draw path also?

will add this on the next release. thank you!


Assorted performance cleanups in views

There are some Django views that make unnecessary slow or expensive calls, mostly because they predate paginated index lookups and such. This issue is for finding and fixing some (but not necessarily all) of them and cleaning up some related code to make it avoid doing expensive things accidentally.

The only useful change I could find was to remove the unpaginated index query in the contacts views.

Other than printing fetch_limit, looks good.
I'd like to see about bringing counts back at some point, especially since we use them for groups anyway and groups can easily be roughly the same size as the entire set of contacts, but let's get things working first and then we can go from there.

Ready for re-review.

:+1:


Umbrella issue: localize Kubernetes website to Bengali

#Maintainers

mitul3737
Imtiaz1234
rajibmitra

This issue tracks Bengali Documentation progress.
Kubernetes Website Repository: https://github.com/kubernetes/website
Follow this doc
Docs to follow
Join the Slack

Join the Kubernetes Slack
Join the kubernetes-docs-bn,  sig-docs-localizations

Checklist to translate a term

Check that no one else has claimed the page in the comments below.
Comment below the page that you would like to localize, focus on one page per PR, at a time.
Comment below the page that you would like to localize, focus on one page per PR, at a time.
Maintainers will add your username and Pull Request next to your selected page in the below checklist.
Fork this repo, make your localizations, and submit a pull request following the name convention [bn]  Localization <file_name.md>.
ex: [bn] Documentation  cloud_native_apps.md
Target dev-1.23-bn.1 while creating the PR
tag/ping a maintainer to make it easier to track progress

#You may check this week's PR wrangler's list
#You may join the google #sig-docs group
Points to remember:

Please use the word localization instead of translation.

For more information on how to contribute, check out guidelines

For Volunteers
Volunteers can comment below on this issue with the page-name they are interested in documentation
Please also provide a placeholder PR in your comment.
Example: I would like to contribute to content/bn/<xyz.md>
Priorities
We need at least 52 pages documented in Bengali  before go-live, below are some suggested terms to work:
### Files that have been localized
- [x] README-bn.md
- [x] config.toml

- [x] content/bn/releases/_index.md
@Mouly22
   #33573
- [x] content/bn/docs/home/_index.md
  @Imtiaz1234
  #32505
- [x]  content/bn/docs/setup/_index.md
@Imtiaz1234
#32839
- [x] content/bn /_index.html
@Mouly22
#33572
- [x] content/bn /case-studies/_index.html
  @Imtiaz1234
  https://github.com/kubernetes/website/pull/31676

- [x] content/bn/docs/concepts/overview/what-is-kubernetes.md
@ikramulkayes
#33294
- [x] content/bn/docs/contribute/_index.md
@Saber382
#31814

- [x] content/bn/docs/home/supported-doc-versions.md
@shahriyar101931
#34693
- [x] content/bn/docs/reference/_index.md
@PratikDey
#36753
- [x] content/bn/docs/reference/glossary/index.md
@Mouly22
#33521

- [x] content/bn/docs/setup/best-practices/_index.md
@PratikDey
#36722

- [x] content/bn/docs/setup/production-environment/turnkey-solutions.md
@nazma1234
#31678

- [x] content/bn/docs/tasks/_index.md
@Imtiaz1234
#32883

- [x] content/bn/docs/tasks/tools/_index.md
@Imtiaz1234
#32885

- [x] content/bn/docs/tasks/tools/included/_index.md
@Arindam200
#38787

- [x] content/bn/docs/tutorials/_index.md
@Imtiaz1234
#32886

- [x] content/bn/docs/tutorials/hello-minikube.md
@sarkartanmay393
#34934

- [x] content/bn/docs/tutorials/kubernetes-basics/create-cluster/_index.md
@AbdullahArean
#36065

- [x] content/bn/docs/tutorials/kubernetes-basics/deploy-app/deploy-intro.html
@abhijeet-26
#39325
- [x] content/bn/docs/tutorials/kubernetes-basics/explore/_index.md
@abhijeet-26
#39391

- [x] content/bn/docs/tutorials/kubernetes-basics/explore/explore-interactive.html
@abhijeet-26
#39391
- [x] content/bn/docs/tutorials/kubernetes-basics/explore/explore-intro.html
@abhijeet-26
#39778

- [x] content/bn/docs/tutorials/kubernetes-basics/expose/_index.md
@Acesif
#39714
- [x] content/bn/docs/tutorials/kubernetes-basics/expose/expose-interactive.html
@Acesif
#39763
- [x] content/bn/docs/tutorials/kubernetes-basics/expose/expose-intro.html
@Acesif
#39762
- [x] content/bn/docs/tutorials/kubernetes-basics/scale/_index.md
@abhijeet-26
#39808

- [x] content/bn/docs/tutorials/kubernetes-basics/scale/scale-intro.html
@nazma1234
#39276

- [x] content/bn/docs/tutorials/kubernetes-basics/update/_index.md
@Acesif
#39713

- [x] content/bn/includes/task-tutorial-prereqs.md
@Arindam200
#38506

### Files to be localized
- [ ] content/bn/docs/setup/learning-environment/_index.md
@sajibAdhi
#39839
- [ ] content/bn/docs/setup/production-environment/_index.md
- [ ] content/bn/docs/setup/production-environment/windows/_index.md
- [ ] content/bn/docs/tasks/tools/install-kubectl-windows.md
@Acesif
- [ ] content/bn/docs/tasks/tools/included/kubectl-convert-overview.md
@noor-e-jannatnafia
- [ ] content/bn/docs/tasks/tools/included/kubectl-whats-next.md
@AdibReza
- [ ] content/bn/docs/tasks/tools/included/optional-kubectl-configs-bash-linux.md
@Acesif
- [ ] content/bn/docs/tasks/tools/included/optional-kubectl-configs-bash-mac.md
@Acesif
- [ ] content/bn/docs/tasks/tools/included/optional-kubectl-configs-zsh.md
@Acesif
- [ ] content/bn/docs/tasks/tools/included/verify-kubectl.md
@Acesif
- [ ] content/bn/docs/tasks/tools/install-kubectl-linux.md
@Acesif
- [ ] content/bn/docs/tasks/tools/install-kubectl-macos.md
 @Acesif
- [ ] content/bn/docs/tutorials/kubernetes-basics/update/update-interactive.html
@PratikforCoding
- [ ] content/bn/docs/tutorials/kubernetes-basics/update/update-intro.html
- [ ] data/i18n/bn/bn.toml
- [ ] content/bn/docs/tutorials/kubernetes-basics/create-cluster/cluster-interactive.html
- [ ] content/bn/docs/tutorials/kubernetes-basics/create-cluster/cluster-intro.html
- [ ] content/bn/docs/tutorials/kubernetes-basics/_index.html
- [ ] content/bn/docs/tutorials/kubernetes-basics/scale/scale-interactive.html
@abhijeet-26
- [ ] content/bn/docs/tutorials/kubernetes-basics/deploy-app/_index.md
@noor-e-jannatnafia
- [ ] content/bn/docs/tutorials/kubernetes-basics/deploy-app/deploy-interactive.html
- [ ] static/_redirects

I am working on README-bn.md, config.toml, content/bn/docs/home/_index.md, content/bn/docs/setup/_index.md, content/bn/docs/tutorials/kubernetes-basics/_index.html, content/bn/releases/_index.md

Can I please work on content/bn /case-studies/_index.html ?

Can I please work on content/bn/docs/setup/production-environment/turnkey-solutions.md ?

Yes, surely! @nazma1234

/triage accepted
Great work!

Hey @mitul3737

Please use the word documentation instead of translation.
I think we mean "localization instead of translation"

/retitle Umbrella issue: localize Kubernetes website to Bengali

@anubha-v-ardhan done!

Can I work on content/bn/docs/concepts/overview/what-is-kubernetes.md ?

sure @ikramulkayes

Fork this repo, make your localizations, and submit a pull request following the name convention [bn] Documentation <file_name.md>.
ex: [bn] Documentation cloud_native_apps.md

I think we should mention Localization and not Documentation

@anubha-v-ardhan updated that

I want to work with content/bn/docs/contribute/_index.md 😁

I would like to work on  content/bn /_index.html @mitul3737

Sure @Mouly

I would like to work on  content/bn/docs/concepts/overview/what-is-kubernetes.md @mitul3737

@Mouly22 , Ikramul Kayes  @ikramulkayes  is working on this

/language bn

I would like to work on content/bn/docs/tutorials/kubernetes-basics/_index.html @mitul3737

I am working on content/bn/docs/reference/glossary/index.md

I would like to work on content/bn/docs/tutorials/kubernetes-basics/_index.html @mitul3737

I am also working on content/bn/releases/_index.md

I would like to work on content/bn/docs/tutorials/kubernetes-basics/_index.html @mitul3737

Okay, sure!

I would like to work on content/bn/docs/setup/_index.md .

I would like to work on  content/bn/docs/tasks/_index.md .

I would like to work on  content/bn/docs/tasks/_index.md

I would like to work on content/bn/docs/tasks/tools/_index.md

I would like to work on content/bn/docs/tasks/tools/_index.md

Would like to work on content/bn/docs/tutorials/_index.md

This issue replaces #31605

I would like to work on content/bn/docs/tasks/tools/install-kubectl-macos.md @mitul3737

@Mouly22 , yes you can 🔥

Hey @mitul3737 , I would like to work on content/bn/docs/home/supported-doc-versions.md file

@shahriyar101931 , yes you can

/good-first-issue

There's a lot of work here! This isn't a good issue for someone making their first contribution.
/remove-good-first-issue
/remove-help

@mitul3737 Please assign me content/bn/docs/tutorials/hello-minikube.md

Yes , sure @sarkartanmay393

How's this work going, overall?

@sftim We have some new contributors. The progress is slow I might say but we are going to have many more Bengali contributors. I have trying to guide and motivate some fellow mates to contribute. Hope they will join in a short time 😊

I want to contribute on content/bn/docs/tutorials/kubernetes-basics/create-cluster/_index.md
Please Assign Me @mitul3737

@AbdullahArean You have been assigned

May I work on issue content/bn/docs/setup/best-practices/_index.md ?

@PratikDey You have been assigned

Can I work on content/bn/docs/reference/_index.md ?

@PratikDey You have been appointed.

Can I work on content/bn/docs/setup/learning-environment/_index.md?

@PratikDey  You have been appointed

Can I work on content/bn/includes/task-tutorial-prereqs.md ?

@Arindam200 You are appointed!

Can I Work on  content/bn/docs/tasks/tools/included/_index.md ?

@Arindam200 You have been appointed!

Can I work on content/bn/docs/tutorials/kubernetes-basics/scale/scale-intro.html?

I would like to contribute on the content/bn/docs/tutorials/kubernetes-basics/scale/scale-intro.html. Can you please assign it to me?

@Mouly22  , @AbdullahArean  You have been unassigned from the tasks due to long time of inactivitiy

content/bn/docs/setup/production-environment/turnkey-solutions.md? This file already exists.

Yes @abhijeet-26 ! My bad. You may choose any others file.

Okay . Update this once.

content/bn/docs/tutorials/kubernetes-basics/deploy-app/deploy-intro.html.

@abhijeet-26 You have been appointed.

Can I work on :

content/bn/docs/tutorials/kubernetes-basics/explore/_index.md
content/bn/docs/tutorials/kubernetes-basics/explore/explore-interactive.html
content/bn/docs/tutorials/kubernetes-basics/explore/explore-intro.html

You have been appointed @abhijeet-26

I would like to contribute to  "content/bn/docs/tasks/tools/included/kubectl-whats-next.md". Can you assign me?

Can I please work on content/bn/docs/tutorials/kubernetes-basics/update/_index.md, content/bn/docs/tutorials/kubernetes-basics/expose/_index.md,  content/bn/docs/tutorials/kubernetes-basics/expose/expose-interactive.html,  content/bn/docs/tutorials/kubernetes-basics/expose/expose-intro.html

@Acesif & AdibReza You guys have been appointed. Kindly proceed with the localization and create a PR

I want to work on "content/bn/docs/tasks/tools/included/verify-kubectl.md".

I want to work on
content/bn/docs/tasks/tools/included/optional-kubectl-configs-bash-linux.md
content/bn/docs/tasks/tools/included/optional-kubectl-configs-bash-mac.md
content/bn/docs/tasks/tools/included/optional-kubectl-configs-zsh.md
content/bn/docs/tasks/tools/included/verify-kubectl.md
content/bn/docs/tasks/tools/install-kubectl-linux.md
content/bn/docs/tasks/tools/install-kubectl-macos.md
content/bn/docs/tasks/tools/install-kubectl-windows.md

@Acesif You have been appointed. Kindly complete these files as soon as possible.

content/bn/docs/tutorials/kubernetes-basics/scale/_index.md
content/bn/docs/tutorials/kubernetes-basics/scale/scale-interactive.html

You have been appointed @abhijeet-26

I would like to contribute to <content/bn/docs/tasks/tools/included/kubectl-convert-overview.md> and <content/bn/docs/tutorials/kubernetes-basics/deploy-app/_index.md>.

@noor-e-jannatnafia You have been appointed.

I want to contribute to content/bn/docs/tutorials/kubernetes-basics/update/update-interactive.html , content/bn/docs/tutorials/kubernetes-basics/update/update-intro.html**, content/bn/docs/tutorials/kubernetes-basics/create-cluster/cluster-interactive.html , **
content/bn/docs/tutorials/kubernetes-basics/create-cluster/cluster-intro.html

@PratikforCoding Kindly take files each at a time. I have appointed you for content/bn/docs/tutorials/kubernetes-basics/update/update-interactive.html the  file.

You have been appointed @abhijeet-26

@mitul3737 Hello,
content/bn/docs/tasks/tools/included/verify-kubectl.md was assigned to me, however, it seems that it has already been localized by someone else.

@mitul3737 content/bn/docs/tasks/tools/included/verify-kubectl.md was assigned to me, however, it seems that someone has previously localized it and now it is showing a merge conflict

can i contribute to localize content/bn/docs/setup/production-environment/_index.md,
content/bn/docs/setup/production-environment/windows/_index.md

@MashiatK  Kindly proceed. You have been appointed

Assign me the following :
content/bn/docs/tutorials/kubernetes-basics/update/update-intro.html
content/bn/docs/tutorials/kubernetes-basics/create-cluster/cluster-intro.html
content/bn/docs/tutorials/kubernetes-basics/_index.html
static/_redirects

You have been assigned @Acesif

@mitul3737 Please mark static/_redirects as complete, since it doesn't have any content to localize.

@Acesif Kindly makes changes as @sftim  mentioned in this file

@MashiatK Are you still working on the below ones?
content/bn/docs/setup/production-environment/_index.md

and
content/bn/docs/setup/production-environment/windows/_index.md

@MashiatK Are you still working on the below ones?
content/bn/docs/setup/production-environment/_index.md

and
content/bn/docs/setup/production-environment/windows/_index.md

You can proceed with them and as 1 week has already passed, if you create the PRs first, I will accept those.

Yes, will finish by tomorrow.
On Fri, 17 Mar 2023, 10:59 am Md Shahriyar Al Mustakim Mitul, <
@.***> wrote:

@MashiatK https://github.com/MashiatK Are you still working on the
below ones?
content/bn/docs/setup/production-environment/_index.md
and
content/bn/docs/setup/production-environment/windows/_index.md
You can proceed with them and as 1 week has already passed, if you create
the PRs first, I will accept those.
—
Reply to this email directly, view it on GitHub
https://github.com/kubernetes/website/issues/31677#issuecomment-1473132007,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AZTZ7RBNPZ7VIHFK6NN7KADW4PVUZANCNFSM5N6WLV3A
.
You are receiving this because you were mentioned.Message ID:
@.***>

If you can finish vy tomorrow, according to the assign files, I will check yours @MashiatK.
Lets see who can contribute faster 🤔

@nerdynikhil would you like to conteibute to the bn.toml file?

Sure, I can do that
On Fri, 17 Mar 2023 at 1:35 PM, Md Shahriyar Al Mustakim Mitul <
@.***> wrote:

@nerdynikhil https://github.com/nerdynikhil would you like to
conteibute to the bn.toml file?
—
Reply to this email directly, view it on GitHub
https://github.com/kubernetes/website/issues/31677#issuecomment-1473340955,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AIVWP3WNMME2XBANH4FTTQ3W4QLMHANCNFSM5N6WLV3A
.
You are receiving this because you were mentioned.Message ID:
@.***>

@nerdynikhil You have been assigned. Kindly proceed with the bn.toml file

@noor-e-jannatnafia  You have been appointed content/bn/docs/setup/production-environment/_index.md

@mitul3737 Is  content/bn/docs/setup/production-environment/_index.md already taken? If not, kindly assign it to me.

You have been appointed @Acesif

In https://github.com/kubernetes/website/pull/33618#issuecomment-1627822614, @mitul3737 wrote:

@sftim I hope, we have done the basic localization and can move forward now.

/area localization
How's this work going? What's the next step?

Hey @sftim , the progress was stopped for a while but we have started working on the repo again 😊

Hey @sftim , can you create us a new branch ( copy of main) ,  where we can merged our [bn ] Localize content.    As you know dev-1.23-bn   is too much outdated and behind from 10000+ commit.

We've made a branch dev-1.24-bn; try targeting that.

How's the work going?

The first version of Kubernetes in Bangla is now live!
For this reason, the dev-1.24-bn.1 branch is being deprecated.
There is still plenty of scope to update in our first version. Feel free to check out our website and create an issue if you find any small typos or big mistakes.
Kubernetes in Bangla : https://kubernetes.io/bn/

Hello Contributors,
As you may know, the first version of Kubernetes in Bangla has been live since May 2024!
We are now ready to start our work on the second version of the Kubernetes Bangla documentation.
Our latest working branch is dev-1.31-bn.1.
New Tracking Issue:
Our new tracking issue is #47747. Please refer to this issue for updates and progress.
PR Guidelines:
When you create a new branch on your forked repo, make sure it’s based on the latest dev-1.31-bn.1 branch.
Source Repository: kubernetes/website
Source Branch: dev-1.31-bn.1
Target Branch: dev-1.31-bn.1 (when creating the PR)
Also, when submitting a PR, please include the following line in the description:
Related issue: #47747
Kubernetes in Bangla: https://kubernetes.io/bn/
Happy contributing!

/retitle Umbrella Issue : Tracking the Localization Progress of Kubernetes Documentation

Hello Contributors,
As you may know, the first version of Kubernetes in Bangla has been live since May 2024!
We are now ready to start our work on the second version of the Kubernetes Bangla documentation.
Our latest working branch is dev-1.31-bn.1.
New Tracking Issue:
Our new tracking issue is #47747. Please refer to this issue for updates and progress.
PR Guidelines:
When you create a new branch on your forked repo, make sure it’s based on the latest dev-1.31-bn.1 branch.
Source Repository: kubernetes/website
Source Branch: dev-1.31-bn.1
Target Branch: dev-1.31-bn.1 (when creating the PR)
Also, when submitting a PR, please include the following line in the description:
Related issue: #47747
Kubernetes in Bangla: https://kubernetes.io/bn/
Happy contributing!

#44993

https://github.com/kubernetes/website/issues/44993

/retitle Umbrella Issue: Tracking Kubernetes Documentation Localization Progress

sdfg

@asem-hamid


rqt_mav_manager and kr_crazyflie_interface migrated to ROS2 humble

Migrated the following two packages to ROS2 humble:

rqt_mav_manager
interface/kr_crazyflie_interface

Tried renaming the files using git mv but did not reflect in the commit.

Hi! Please reword the commit messages to make them more descriptive and push force to the branch.


No entropy settings are available

The default entropy args are -1,
which will prevent the early exit.
This will degrade to normal ft and infer.

The eval_entropy.sh scripts solve this issue.


A question about the rpb in LegacyNeighborhoodAttention2D

My question
Why is the same relative position index used for several positions in the middle?
Information
https://github.com/SHI-Labs/Neighborhood-Attention-Transformer/blob/1437787fc16bd2ede16e5de6e47beaa4cc0f7ccd/natten/nattentorch2d.py#L43-L57
A simple visualization:

The related code is copied from LegacyNeighborhoodAttention2D:
# %%
import matplotlib.pyplot as plt
import numpy as np
import torch

kernel_size = 3
height = width = 5
rpb_size = 2 * kernel_size - 1

# %%
fig, axes = plt.subplots(nrows=height, ncols=width, figsize=(8, 8))
shared_bg = np.zeros((height, width), dtype=np.uint8)

# %%
idx_h = torch.arange(0, kernel_size)
idx_w = torch.arange(0, kernel_size)
idx_k = ((idx_h.unsqueeze(-1) * rpb_size) + idx_w).reshape(-1)
print(idx_k.reshape(kernel_size, kernel_size))

# %%
num_repeat_h = torch.ones(kernel_size, dtype=torch.long)
num_repeat_w = torch.ones(kernel_size, dtype=torch.long)
num_repeat_h[kernel_size // 2] = height - (kernel_size - 1)
num_repeat_w[kernel_size // 2] = width - (kernel_size - 1)
bias_hw = (
    idx_h.repeat_interleave(num_repeat_h).unsqueeze(-1) * (2 * kernel_size - 1)
) + idx_w.repeat_interleave(num_repeat_w)
bias_idx = (bias_hw.unsqueeze(-1) + idx_k).reshape(-1, kernel_size ** 2)
print(bias_idx)
'''
tensor([[ 0,  1,  2,  5,  6,  7, 10, 11, 12],
        [ 1,  2,  3,  6,  7,  8, 11, 12, 13],
        [ 1,  2,  3,  6,  7,  8, 11, 12, 13],
        [ 1,  2,  3,  6,  7,  8, 11, 12, 13],
        [ 2,  3,  4,  7,  8,  9, 12, 13, 14],
        [ 5,  6,  7, 10, 11, 12, 15, 16, 17],
        [ 6,  7,  8, 11, 12, 13, 16, 17, 18],
        [ 6,  7,  8, 11, 12, 13, 16, 17, 18],
        [ 6,  7,  8, 11, 12, 13, 16, 17, 18],
        [ 7,  8,  9, 12, 13, 14, 17, 18, 19],
        [ 5,  6,  7, 10, 11, 12, 15, 16, 17],
        [ 6,  7,  8, 11, 12, 13, 16, 17, 18],
        [ 6,  7,  8, 11, 12, 13, 16, 17, 18],
        [ 6,  7,  8, 11, 12, 13, 16, 17, 18],
        [ 7,  8,  9, 12, 13, 14, 17, 18, 19],
        [ 5,  6,  7, 10, 11, 12, 15, 16, 17],
        [ 6,  7,  8, 11, 12, 13, 16, 17, 18],
        [ 6,  7,  8, 11, 12, 13, 16, 17, 18],
        [ 6,  7,  8, 11, 12, 13, 16, 17, 18],
        [ 7,  8,  9, 12, 13, 14, 17, 18, 19],
        [10, 11, 12, 15, 16, 17, 20, 21, 22],
        [11, 12, 13, 16, 17, 18, 21, 22, 23],
        [11, 12, 13, 16, 17, 18, 21, 22, 23],
        [11, 12, 13, 16, 17, 18, 21, 22, 23],
        [12, 13, 14, 17, 18, 19, 22, 23, 24]])
'''

# %%
for h in range(height):
    for w in range(width):
        new_bg = shared_bg.flatten().copy()
        new_bg[bias_idx[h * height + w]] = 255
        new_bg = new_bg.reshape(height, width)
        axes[h, w].imshow(new_bg)

# %%
plt.show()

Hello and thank you for your interest,
Just to give a bit of background: RPB is in theory a continuous function, at least they way we intended it for NA/DiNA.
Here we're only learning a discrete set of weights because our kernel size is typically fixed.
As for its implementation here, most tokens (non-edge cases) share an identical RPB grid: north, south, east, west -- and positions in between, i.e. northwest.
And of course there's a magnitude: 1 north, 2 north, etc.
As a result, if you look at a visualization of NA, you would see that if we don't consider edge cases, the key-value positions for the rest of the feature map is identical: query is centered, and the neighbors are wrapped around it, hence they share the same RPB.
It becomes different for the edge cases precisely because they are not centered. For instance, the north-west (top-left) most pixel is always attending to an "extended neighborhood", which is explained in the original NAT paper, therefore its relative positional biases with respect to its key-value pair, or neighborhood, would be different compared to non-edge cases where they're always centered.
I hope this explains the idea, but if that's not the case, please let us know so we can clarify further.

@alihassanijr
Thanks for your reply!
About the original question
In my original example, some settings were blocking my understanding. I optimized the code and it is more intuitive now.
But this also leads to another problem, see the discussion in the next section.
import matplotlib.pyplot as plt
import numpy as np
import torch

# specify the height and width of the feature map
height = width = 10

# construct a figure containing height*width subfigures corresponding to different (h,w) pixel
fig, axes = plt.subplots(nrows=height, ncols=width, figsize=(8, 8))
fig.suptitle('All Index Windows of RPE for each position of H-W Plane')

# specify the size of kernel for position bias
kernel_size = 5

# construct a shared relative position bias map
rpb_size = 2 * kernel_size - 1
shared_rpb_bg = np.zeros((rpb_size, rpb_size), dtype=np.uint8)

idx_h = torch.arange(0, kernel_size)
idx_w = torch.arange(0, kernel_size)
# absolute 1D indices in the left-top window of the rpe map (2*kernel_size-1, 2*kernel_size-1)
# other window indices can be obtained by adding a new start index on this `idx_k`
idx_k = ((idx_h.unsqueeze(-1) * rpb_size) + idx_w).reshape(-1)

# construct indices of the window in rpe map for each (h,w) pixel
num_repeat_h = torch.ones(kernel_size, dtype=torch.long)
num_repeat_w = torch.ones(kernel_size, dtype=torch.long)
num_repeat_h[kernel_size // 2] = height - (kernel_size - 1)
num_repeat_w[kernel_size // 2] = width - (kernel_size - 1)
# the base h and w of the four edge regions is different from others
bias_hw = idx_h.repeat_interleave(num_repeat_h).unsqueeze(-1) * rpb_size + idx_w.repeat_interleave(num_repeat_w)
# each (h,w) in the H-W plane corresponds to a window of kernel_size*kernel_size containing indices
bias_idx = (bias_hw.unsqueeze(-1) + idx_k).reshape(-1, kernel_size ** 2) # height*width,kernel_size**2

# traverse all positions to visualize and highlight their own index window in the shared rpe map
for h in range(height):
    for w in range(width):
        new_rpb_bg = shared_rpb_bg.flatten().copy()

        new_start_idx = h * height + w
        new_rpb_bg[bias_idx[new_start_idx]] = 255  # index the specific window in rpb map
        new_rpb_bg = new_rpb_bg.reshape(rpb_size, rpb_size)
        axes[h, w].imshow(new_rpb_bg)
        axes[h, w].set_title(f"Win {(h,w)}")

plt.show()

About the relative position bias for NAT
Let's consider a simple case, kernel_size=3, and the rpb map is [23-1, 23-1]=[5,5].
The real indices of rpb map is:
(-2, -2), (-2, -1), (-2, 0), (-2, 1), (-2, 2),
(-1, -2), (-1, -1), (-1, 0), (-1, 1), (-1, 2),
(0, -2), (0, -1), (0, 0), (0, 1), (0, 2),
(1, -2), (1, -1), (1, 0), (1, 1), (1, 2),
(2, -2), (2, -1), (2, 0), (2, 1), (2, 2),

In traditional attention, the rpb is simple and it has no edge regions that require special consideration. So it only has one index pattern:
(-1, -1), (-1, 0), (-1, 1);
(-1, -1), (-1, 0), (-1, 1);
(-1, -1), (-1, 0), (-1, 1);

But in the convolution-like NAT operation, the rpe become more complicated.
The index window in the non-edge region is consist with the above pattern window.
The index window in the edge region is:
# start at the pixel (h=0, w=0), we denote the matrix as $W_{0,0}$
(0, 0), (0, 1), (0, 2);
(1, 0), (1, 1), (1, 2);
(2, 0), (2, 1), (2, 2);

# start at the pixel (h=0, w=1), we denote the matrix as $W_{0,1}$
(0, -1), (0, 0), (0, 1);
(1, -1), (1, 0), (1, 1);
(2, -1), (2, 0), (2, 1);

# start at the pixel (h=1, w=0), we denote the matrix as $W_{1,0}$
(-1, 0), (-1, 1), (-1, 2);
(0, 0), (0, 1), (0, 2);
(1, 0), (1, 1), (1, 2);

# ... and so on.

In current implementation of the rpb of LegacyNeighborhoodAttention2D, the index pattern does not correspond to the abovementioned real indices of rpb map.

@alihassanijr
oh.... I understand it. Thank you so much for your patient reply.

I'm closing this issue now because we're moving our extension to its own separate repository, and due to inactivity.
Please feel free to reopen it if you still have questions, or open an issue in NATTEN if it's related to that.


MessageBox Enchancement

Limit the length of the text that is allowed to be placed in the "Show Messagebox" command on the server side to prevent extremely large message boxes (they can't be closed by the client and it is annoying).
On the client side, truncate any text outside of a range around 256 characters or so.

Server side limitation is enough I think. :)

Sounds good.


[error] Installation of py-evm fails

py-evm Version: N.A
OS: win
Python Version (python --version): 3.8.10

What is wrong?
Installation of py-evm fails ❌
pip install py-evm
ERROR: Command errored out with exit status 1:
     command: 'c:\users\sumitb\practice\repos\py-evm-app\venv\scripts\python.exe' -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'C:\\Users\\sumitb\\AppData\\Local\\Temp\\pip-install-dk72gaip\\pyethash_9549dc9d39ab463bb2fda2de40067962\\setup.py'"'"'; __file__='"'"'C:\\Users\\sumitb\\AppData\\Local\\Temp\\pip-install-dk72gaip\\pyethash_9549dc9d39ab463bb2fda2de40067962\\setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record 'C:\Users\sumitb\AppData\Local\Temp\pip-record-wpytmuwq\install-record.txt' --single-version-externally-managed --compile --install-headers 'c:\users\sumitb\practice\repos\py-evm-app\venv\include\site\python3.8\pyethash'
         cwd: C:\Users\sumitb\AppData\Local\Temp\pip-install-dk72gaip\pyethash_9549dc9d39ab463bb2fda2de40067962\
...
 src/python/core.c(2): fatal error C1083: Cannot open include file: 'alloca.h': No such file or directory
    error: command 'C:\\Program Files (x86)\\Microsoft Visual Studio\\2019\\BuildTools\\VC\\Tools\\MSVC\\14.28.29333\\bin\\HostX86\\x64\\cl.exe' failed with exit status 2

@iSumitBanik unfortunately Windows seems to run into these issues quite a bit. The highest rated answer in this thread seems to have quite a bit of success with a similar issue.
I'm going to close as it seems like supporting build tools issues but if you feel like this should remain open and that there's something the library can support I'd be happy to re-open. Unfortunately I don't have a Windows machine to even try to sniff around this. Best of luck.


WIP: ANC Subsequent visits - Outside Care activity

#257

@mariano-dagostino please review.
Note there were some requierments changes, which were implemented at #281.


Publish checkout-ui-extensions 0.19.1

<EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS>
Background
This PR bumps the versions and will be used to publish the packages. It is a follow-up to https://github.com/Shopify/ui-extensions/pull/520.
Solution
Followed package release steps.
🎩
n/a
Checklist

[X] I have :tophat:'d these changes
[X] I have updated relevant documentation

Closing this as we want to publish at version 0.20.0.


D lib updated for x64 build mode on windows

Support for the x64 build mode on windows with DMD 2.074.0 and the latest Libevent

Looks like this broke unix builds.  As extra credit, if you are able to add D support to the cmake build environment then we can get it to build on appveyor with each pull request, ensuring it won't regress in the future.

I'll have a try.

This will also need an Apache Jira ticket opened.
https://thrift.apache.org/docs/HowToContribute

@Heromyth any progress on this?

So sad, there is a bug in phobos64.lib. It will make the examples failed.

This should be rebased on the current master as I have updated the docker files.  Perhaps if you could open a Jira ticket for this issue and rebase on master and force push, we can get a more recent build.

It's updated by #1380


Simpleperf error when more than 6 events

Hi, so I'm using the simpleperf stat command on WA, but when I have 7 events, there seems to be an error in the parsing stage. Only occurs when --csv is in the option string.
  perf:
    cleanup_assets: true
    command: stat
    events:
    - r11
    - r8
    - r13
    - r12
    - r19
    - r1D
    - r1B
    force_install: false
    labels: ['simpleperf']
    optionstring: '-a --interval 10 --per-core --interval-only-values --use-devfreq-counters --csv'
    perf_type: simpleperf
    report_option_string:
    report_sample_options:
    run_report_sample: false

Here's the return error:
2023-09-15 15:26:08,535 ERROR    instrument:         Error in instrument perf
2023-09-15 15:26:08,535 DEBUG        signal:         Sending error-logged from <ErrorSignalHandler (DEBUG)>
2023-09-15 15:26:08,535 ERROR    instrument:           File "/home/hsc/miniconda3/lib/python3.11/site-packages/wlauto-3.4.0.dev1+05eab42f-py3.11.egg/wa/framework/instrument.py", line 272, in __call__
2023-09-15 15:26:08,535 ERROR    instrument:             self.callback(context)
2023-09-15 15:26:08,535 ERROR    instrument:           File "/home/hsc/miniconda3/lib/python3.11/site-packages/wlauto-3.4.0.dev1+05eab42f-py3.11.egg/wa/instruments/perf.py", line 160, in update_output
2023-09-15 15:26:08,535 ERROR    instrument:             self._process_simpleperf_output(context)
2023-09-15 15:26:08,535 ERROR    instrument:           File "/home/hsc/miniconda3/lib/python3.11/site-packages/wlauto-3.4.0.dev1+05eab42f-py3.11.egg/wa/instruments/perf.py", line 173, in _process_simpleperf_output
2023-09-15 15:26:08,535 ERROR    instrument:             self._process_simpleperf_stat_output(context)
2023-09-15 15:26:08,535 ERROR    instrument:           File "/home/hsc/miniconda3/lib/python3.11/site-packages/wlauto-3.4.0.dev1+05eab42f-py3.11.egg/wa/instruments/perf.py", line 251, in _process_simpleperf_stat_output
2023-09-15 15:26:08,535 ERROR    instrument:             self._process_simpleperf_stat_from_csv(stat_file, context, label)
2023-09-15 15:26:08,535 ERROR    instrument:           File "/home/hsc/miniconda3/lib/python3.11/site-packages/wlauto-3.4.0.dev1+05eab42f-py3.11.egg/wa/instruments/perf.py", line 265, in _process_simpleperf_stat_from_csv
2023-09-15 15:26:08,535 ERROR    instrument:             context.add_metric('{}_{}'.format(label, row[1]), row[0], 'count', classifiers=classifiers)
2023-09-15 15:26:08,535 ERROR    instrument:                                                      ~~~^^^
2023-09-15 15:26:08,535 ERROR    instrument:
2023-09-15 15:26:08,535 DEBUG        signal:         Sending error-logged from <ErrorSignalHandler (DEBUG)>
2023-09-15 15:26:08,535 ERROR    instrument:         IndexError(list index out of range)
2023-09-15 15:26:08,536 INFO      processor:         Processing using "csv"

Couldn't quite figure out what the issue is. The moment I only have 6 events, it works just fine.
Thanks!

Hi,
Thanks for reporting this.
I suspect this means that your device only has 6 hardware counters available. When enabling more events than counters available I'm seeing additional messages in the raw simpleperf.out file. E.g.
simpleperf W cmd_stat.cpp:865] Percentages < 100% means some events only run a subset of enabled time,
probably caused by hardware counter multiplexing (less counters than events).
Try --use-devfreq-counters if on a rooted device.

These messages are causing the parsing to fail so handling this scenario need to be fixed, however to prevent reduced accuracy I'd suggest limiting the number of events enabled if possible.

Hmmmm, I think my device does allow 6 counters at the same time + the cycle counter which is 0x11. Is there any way I can just force the parse despite the limit? Or is that something that needs to be figured out on the simpleperf binary end?

Although simpleperf can handle this, the main issue with the parsing is that these error messages are being printed in the middle of the output data which is the part of the reason  the parsing is falling over.
We need to investigate if we can prevent these additional prints or remove them from the output file properly.
As a quick workaround we can try skipping the corrupted lines but this will mean that some entries will be dropped so we'll need to find a proper solution to this. In case it helps you I have pushed the workaround to my branch which can be found here [1]
[1] https://github.com/marcbonnici/workload-automation/commit/fc620f8b23fb0fadb9453c7ccd30f190976b9c43


Emit errors in standard format for compilers

I was wondering if it would be possible to change the error output to a more standard compiler format that would make the line and column easier to extract.
Current: <file>:~: <error message> (<col>:<lin>)
Preferred: <file>:<line>:<column> <error-text>

@lawrence-dol Do you mean something like this SyntaxError: [1:35]: Await is only valid in async functions?
I did an experiment with my retirement project and it seems to be easy to port it.

@KFlash
No, I mean the same as javac and almost every other compiler I've encountered (every C compiler uses the same format, too). For example, where the column is reported:
c:\some\path\Version.java:12:37: Expected `;`

and where only the line number is reported:
c:\some\path\Version.java:12: Expected `;`

In the retirement project it's like that now except I wrapped it in brackets. It's similar to the error messages reported by the ShiftJS parser in ASTExplorer.

Thanks for this issue. This repository and project will no longer be maintained, please consider its successor: https://github.com/meriyah/meriyah
Thanks for understanding and we apologize for any inconvenience!


fix to use "end" instead of "while"

fix: https://github.com/microsoft/vscode-markdown-tm-grammar/issues/70
before:

after:

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.:x: shskwmt sign nowYou have signed the CLA already but the status is still pending? Let us recheck it.

Closing this as out of date. As I mentioned in the comment, I think we need a different fix for the issue


Exposing refund value and refund fees in an AbstractOfferPart

While introducing another operator in Sweden to the OSDM landscape we are analysing the refund values.
There are 2 options to expose the amount refunded during an after sales operation:

in the confirmed refundOffer that refers to the refunded offerParts
on the offerPart itself in the refundAmount property

The refundAmount property in the AbstractOfferPart can expose the refunded value. It is however not clear how the refund information can be exposed.
The refundAmount value itself
Is this the nett or gross value? And if it is nett, how should after sales booking fee's or ticket fee's be calculated? Example:

fulfilment 1 value 100
fulfilment 2 value 50
fulfilment 3 value 100
after sales booking fee of 10 (not per ticket but per single operation)

When these 3 fulfillments are cancelled in the same refundOffer operation, what value should be exposed in the refundAmount for each offerPart?

fulfilment 1 refundAmount = 100 (gross)
or refundAmount = 100 - 10/3 (guesstimated nett)
or refundAmount = 100 - 10/pro rata (guesstimated nett)

Technically it is not correct to divide an overarching fee since there is no direct relation between a fee and the offerParts. Therefor our working assumption is that the refundAmount is gross
Exposing applies after sales fees
And how should the after sales fees be exposed? there is a feeRef but the fee's itself has no indication wether it was applied during booking creation or during after sales. Since we have a bookedOffers[].offerPart.price for the sales value, I expect the bookedOffers[].offerPart.feeRefs[] +bookedOffers[].fees[] to be sales fees. And the bookedOffers[].offerPart.refundAmount to be the refund value (gross) and have a bookedOffers[].offerPart.refundFeeRefs + bookedOffers[].refundFees for the refund financial data.
This way the client can determine:

the gross amount = AbstractOfferPart.refundAmount
the optionally deducted after sales fee = sum of AbstractOfferPart.refundFeeRefs[] > BookerOffers[].fees[]`
nett refund = gross - after sales fee

Is it indeed intended to have different ways to expose refund values, both through refundOffers and offerParts? Is it recommended to favour the refundOffer since that is the actual refund operation?

I would suggest that the operation fee is a new confirmed offer in the booking and refundAmount amount is omitted and replaced with offerPart.price since it always is 100% anyway and distributor must calculate the amount.
Eg. This use case gives 80% back of the price and have an refund operation fee of 50 SEK
{
	"bookedOffers": [
		{
			"offerId": "offer1",
			"summary": "2nd, class Stockholm C - Gothenburg C",
			"admissions": [
				{
					"objectType": "Admission",
					"id": "offerPart1",
					"price": "1000 SEK",
					"refundFee": "200 SEK",
					"status": "REFUNDED",
					"summary": "2nd, class Stockholm C - Gothenburg C",
					"reservationRefs": [
						{
							"id": "offerPart2"
						}
					]
				}
			],
			"reservations": [
				{
					"id": "offerPart2",
					"summary": "Seat reserved in carriage 5 seat 21",
					"refundFee": "0 SEK",
					"status": "REFUNDED"
				}
			]
		},
		{
			"offerId": "refundFeeOffer1",
			"summary": "Refund operation fee",
			"feeRef": "fee1",
			"fee": [
				{
					"objectType": "Fee",
					"id": "fee1",
					"price": "50 SEK",
					"status": "CONFIRMED"
				}
			]
		}
	]
}

Updated the PR with the changes discussed:

transaction context: sales or after sales
status on fee to indicate if the fee is provisional, confirmed or refunded


Found mostly working esbuild Angular compiler - fix pending issues and use it for Angular CLI build?

🚀 Feature request
Command (mark with an x)

[x] build
[x] serve

Description
I found a mostly working esbuild compiler for Angular. I know Angular team is investigating this, so could be of some help.

https://github.com/cherryApp/ngc-esbuild

Describe the solution you'd like
Please expedite build speed improvements, current Angular 13.x builds are too slow, even my most simple app with 5k of own LOC and 1.8MB JS bundle size takes 2min to build on a CI/CD agent. I checked other questions here, I would be fine to not have type checking, I can add a parallel type check with npm-run-all, it would still be faster.
For example, one enterprise application that I have here, with 15MB bundle size (combined main and lazy chunks), takes 1min to build with Angular 13 CLI on my Ryzen 9 laptop. It's a mix of Angular 13 and Angular 1.x code. Another enterprise application with the same bundle size takes 30 seconds to build with webpack/esbuild-loader and type checks running in parallel. It only has Angular 1.x code, no Angular 13.
Assuming the above data and linear correlation between output bundle size and build time (15MB / 1.8MB * 2min), I estimate 16min on a CI/CD agent for our larger app.
Describe alternatives you've considered
N/A

One of the features of version 14 which is currently in RC stage is an experimental EsBuild browser builder. See https://github.com/angular/angular-cli/pull/22995 for more information.
Closing since this feature is already present as an opt-in experiment.

@alan-agius4 Thanks. Do you plan to support SCSS? Other unsupported features are probably fine, but I can't imagine anyone using raw CSS in 2022.
Also is there any ETA on this feature's release? I see

This builder is considered experimental and is not recommended for production applications.

Support for SCSS will be added down the line based on the feedback we receive.

But I can't imagine anyone using raw CSS in 2022.

Surprising a large percentage of users still use plain CSS.

@alan-agius4 Does it mean SCSS is not planned for v14 ?


Update python for best practices and optimization

-Replace some lists with laziness i.e. generator expressions
-Sometimes use faster string concatenations
-Use sys.exit() over exit() in programs
-Rely on non-empty sequence to be True
-Add missing imports
-docstrings should be in triple quotes, not single ones (PEP 257)
-PEP 471: use scandir over listdir for certain cases
-Replacing dangerous default values to None
-other cleanup (PEP 8)

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Was this performed by a tool or did you manually fix these?  I ask because it's a lot to review and I'm likely to continue making the same mistakes, so if this was a tool I'd like to be able to run it myself.

@0xdabbad00 part of it is manual and part of it is from pylint.
The important ones for program logic:
-Replacing dangerous default values to None
-Add missing imports
The important ones for performance is:
-Replace some lists with laziness i.e. generator expressions
-PEP 471: use scandir over listdir for certain cases

I'm closing this it now deviates from the current code so it has conflicts. This merge was too large for me to feel comfortable merging.     My preference is to use python black: https://black.readthedocs.io/en/stable/


[Typo] Chapter 2, section 7: PRONOUN before VERB

A minor typo in part 2 of the section 7 questions.

If a proper noun after a verb is found, print the token.text.

should be, given the original question:

If a proper noun before a verb is found, print the token.text.

Thanks a lot ! Looks like this was related to the same issue as #15.

Sorry about that, I only went through the issues but not the PRs. Thank you for offering this course, BTW. :)


Command palette should return the "File: Compare New Untitled Text Files" command when I search for "diff"

Title says it all
Current behavior:

I open command palette and type "diff"
Here are the results that I get with a bunch of extensions installed:

Expected behavior:

the search results should also include the "File: Compare New Untitled Text Files" command

Probable solution:

add extra metadata for the command? (I hope the search engine does include that?)
alternatively - extend the title (though this adds extra bloat visually)

Extra scope to consider

maybe all the other "File: Compare" commands should also be included?

Couple ideas:

Add a metadata description to the command so that it shows up in the command palette's "similar commands":

metadata: {
	description: nls.localize2('asdf', 'Opens a new diff editor with two empty untitled files.')
}

To here: https://github.com/microsoft/vscode/blob/e44fee751cd30d7ed1db9c567ae0e891ec8a5595/src/vs/workbench/contrib/files/browser/fileActions.ts#L769-L770
To get this:

Change the name of the command to include diff.

Cool, I actually did not know that. Just recently had a discussion with a colleague how to make commands appear when the words do not match!

This bug has been fixed in the latest release of VS Code Insiders!
@mbalc, you can help us out by commenting /verified if things are now working as expected.
If things still don't seem right, please ensure you're on version ed6c6d3f28fa4cb66f6d73918365e41fb81db14c of Insiders (today's or later - you can use Help: About in the command palette to check), and leave a comment letting us know what isn't working as expected.
Happy Coding!

i see this, adding verified unless @mbalc does not see this fix as well

yep, looks good to me as well now, good job


Fix completion handler cache image setting

Fixed an issue from the following conditions:

Image was in the cache
A completion handler was provided to the image view

Before the fix, the image would not be set. After the fix, the image is now properly set, even if you provide a completion handler.

Thanks for this @kcharwood! I merged in your changes in 4da49ab9 and b056b3cb.

I'll push this out in the 1.1.2 release here shortly.


jCenter is going down on 1 March 2021, need help to migrate to mavenCentral

So you never migrate to mavenCentral?

Way, I did nothing but I think the library is still available as mavenCentral did not close the read access no?


Fixed "timout" to "timeout"

Thank you!

@all-contributors please add Finalrykky for doc

@all-contributors please add Finalrykku for doc


Default lifetime expiracy wasn't being tested. Added test for that an…

Default lifetime expiracy wasn't being tested. Added test function for that porpouse and createCachePool signature was changed with default parameter.

My mistake, CacheItemPoolInterface doesn't hace default lifetime


Update Calico TAGS to v2 release and fix documentation

In the docs the kubectl apply part to deploy calico is missing.
Also in the doc /etc/kubernetes is used for calico manifest but
/srv/kubernetes is used in script. The doc is fixed to match the
script. Also, Calico tags are updated to v2 release
(http://docs.projectcalico.org/v2.0/releases/)

The Calico changes here look good to me.  @ArchiFleKs would you mind making the same version bumps to the equivalent single-node manifest?
https://github.com/coreos/coreos-kubernetes/blob/master/single-node/user-data#L852

I updated the docs and generic multi and single node script to use kube-addon-manager v6.1.
I also added heapster and updated addons manifest in documentation for the "Deploy addons section"

I'd thought they're would be some kind of convergence/magic, since calico
is looking into etcd ^^.
Maybe we can start kubelet with calico and addon manager, wait for calico
and then drop the addons template?
Le lun. 9 janv. 2017 à 04:39, Casey Davenport<EMAIL_ADDRESS>a
écrit :

@caseydavenport commented on this pull request.
In Documentation/deploy-master.md
https://github.com/coreos/coreos-kubernetes/pull/799:

@@ -668,6 +668,14 @@ kube-controller-$node
kube-proxy-$node

+### Configure Calico
+
+To start Calico services :
+
+```
+docker run --rm --net=host -v /srv/kubernetes/manifests:/host/manifests quay.io/coreos/hyperkube:v1.5.1_coreos.0 /hyperkube kubectl apply -f /host/manifests/calico.yaml

@ArchiFleKs <https://github.com/ArchiFleKs> the problem is that if a pod
is started using the flannel without the Calico CNI plugin, then Calico
won't know about the pod and thus won't be able to enforce policy on it,
even if you restart Calico.

You'd have to restart the pod itself in order for it to be recreated with
the Calico CNI plugin in order to make it work.

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
<https://github.com/coreos/coreos-kubernetes/pull/799>, or mute the thread
<https://github.com/notifications/unsubscribe-auth/ABN4qQ8BOaaahIzHGgZvAWRnoWKBEVGdks5rQavogaJpZM4Lbdvl>
.

@caseydavenport any update on this ?

@robszumski @caseydavenport : Hi Guys, any update on this ? :)

@ArchiFleKs Sorry for the delay on this, I've been totally swamped!

I'd thought they're would be some kind of convergence/magic, since calico
is looking into etcd

Calico just looks at it's own part of etcd (/calico) so it's not aware of anything that flannel might have written, so unfortunately no magic here.
I'm still leaning towards just using a kubectl applyto install Calico in the step-by-step documentation, provided @robszumski is OK with that.  We could either do that here, or in the deploy-addons stage, but my preference would be here given the ordering concerns with other add-ons.

@caseydavenport : maybe we could write the calico.yaml template with addons manager and wait for it to be ready (maybe with docker and kubectl) before writing the other addons ?
This way we get to keep addons-manager and calico without manual cURLing ?

@caseydavenport Yeah, we might as well move forward with that

maybe we could write the calico.yaml template with addons manager and wait for it to be ready (maybe with docker and kubectl) before writing the other addons ?

My concern with that is that in the future people can unknowingly add additional add-ons via the add-on manager.  AFAIK the add-on manager doesn't have a concept of "wait for this to be running before deploying any other add-ons", so it's totally possible that other add-ons would be deployed before Calico.

@caseydavenport @robszumski Yes but if calico is the first addon we write, we can may be check the state of the calico pods before writing other addons with the script. Therefore we're sure that calico is the first addons to be deploy

@caseydavenport @robszumski I'm going to drop this, it seems to already been updated in docs


Why the detection with opencl version is using #ifdef  syntax?

My English isn't very good, please don't mind.
I use image2d object in my source but I get "segmentation fault" error.
I found the cl.h installed in my compute is defined from CL_VERSION_1_0 to CL_VERSION_1_2 inside the source code.
My opencl driver and header is NVIDIA's card, I don't know why.
But I found khronos opencl c++ wrapper using "#if defined()" syntax to detect opencl version, it will success to use Image2D in this wrapper.
(but i need to modify CL_VERSION_1_2 macro from 1 to 0 inside cl.h)
Thanks.

before i change my cl.h

after i change my cl.h

is nvidia not support opencl 1.2 ?
Why they define CL_VERSION_1_2 in the cl.h?

Yeah, until recently, NVIDIA only supported OpenCL v1.1. You should ensure that the OpenCL headers you compile against match up with the OpenCL version supported by the vendor/library you use at run-time.


Bad content-length header

I have a scope that was recorded with nock.bak that looks like this:
{
    "scope": "https://api.example.com:443",
    "method": "GET",
    "path": "/mypath?platform=web&key=JJHDC7UK73EH",
    "body": "",
    "status": 200,
    "response": {
        "anonid": "Mjk2MjEyMDc5"
    },
    "rawHeaders": [
        "Access-Control-Allow-Origin",
        "*",
        "Content-Type",
        "application/json",
        "Date",
        "Wed, 07 Mar 2018 09:50:09 GMT",
        "Server",
        "nginx/1.12.2",
        "Set-Cookie",
        "scookie=; path=/; expires=Thu, 01-Jan-1970 00:00:00 GMT",
        "X-Redux-Status",
        "ZOOL",
        "Content-Length",
        "30",
        "Connection",
        "Close"
    ]
},

That response may have originally been 30 bytes long, but I suspect that since it's stored as an inline data structure, nock will serialize it without the original pretty printing.
Is there a way to force nock to always store the original request?

Hmm could you please create a PR with a failing pull request? That will help us investigate the issue


Make LocalModel Agent reconcilation frequency configurable

What this PR does / why we need it:

Make LocalModel Agent reconcilation frequency configurable
Add a new option to configmap and the helm chart.

Which issue(s) this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close the issue(s) when PR gets merged):
Fixes #
Type of changes
Please delete options that are not relevant.

[ ] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update

Feature/Issue validation/testing:
Please describe the tests that you ran to verify your changes and relevant result summary. Provide instructions so it can be reproduced.
Please also list any relevant details for your test configuration.

[ ] Test A

[ ] Test B

Logs

Special notes for your reviewer:

Please confirm that if this PR changes any image versions, then that's the sole change this PR makes.

Checklist:

[ ] Have you added unit/e2e tests that prove your fix is effective or that this feature works?
[ ] Has code been commented, particularly in hard-to-understand areas?
[ ] Have you made corresponding changes to the documentation?

Release note:

Re-running failed tests

/rerun-all - rerun all failed workflows.
/rerun-workflow <workflow name> - rerun a specific failed workflow. Only one workflow name can be specified. Multiple /rerun-workflow commands are allowed per comment.

/lgtm
/approve


Make DELTA_TIME configurable

Okay, so after #4 the algorithm logic got a lot less awkward, and that opens up some possibilities. Currently DELTA_TIME is hard-coded to 60 Hz, but it should probably be configurable at some level.
The obvious thing would be to just make it a resource:
pub struct PhysicsTimeStep(pub f32)

However I'm wondering, would that hurt performance? Does the rust compiler precompute constants, that means we shouldn't do this?
If so, perhaps we should consider if we can somehow use const-generics to still make it configurable at build-time (at least at an internal level).
Second question is: would it make sense to also allow a variable timestep? i.e. consume the remainder of the accumulator with one not-whole physics step.
Would obviously not be deterministic, but could perhaps produce smoother visuals if you don't do smoothing in your renderer.

I think we should probably just make it a resource like NumSubsteps for the sake of ergonomics and consistency. I doubt it would have any meaningful performance impact.
We could also group simulation configuration like this under one resource like XpbdConfig/XpbdContext or PhysicsConfig/PhysicsContext, although I'm not sure if it's more standard in bevy to have many small resources or a few larger ones.

Second question is: would it make sense to also allow a variable timestep? i.e. consume the remainder of the accumulator with one not-whole physics step.

I haven't tried other timesteps before, but it would probably be good to have them available, and it should be quite straightforward to implement it now.
bevy_rapier seems to have a variable timestep here, and it also seems to have an "interpolated timestep".

I'm working on this, PR coming soon


Add a page for "Wren community" stuff

Would love a place on the site for "here are some Wren libraries" and "here are some integrations for editors".
Speaking of, here are some Wren libraries:

wren-test
Please
wren-colors
wren-vector3d

Here are some FFI bindings:

Rust: tilpner/wren-sys
Rust: pwoolcoc/wren-sys
Rust: pwoolcoc/wren-rs

And here are some editor integrations:

Vim
Emacs

A page on the wiki might be best for this, as it allows everyone to add their libraries without waiting for a pull request.

Agreed. What should that page look like?

This is a great idea! I'm up for putting it on the wiki here, or putting it on the main site. Either way works. Feel free to take a stab at it and send me a PR. :)