[BUG] ... running balance doesnt work on any accounts except Main account

Describe the bug
the running balance column does not show up on any account except for my main account.
To Reproduce

Go to YNAB dashboard
Click on Main budget account. running balance is there.
Click on secondary account in list. no running balance

Expected behavior
Running balance should be on each account as well as on "all accounts"
Screenshots

Vs

Desktop (please complete the following information):

OS: Windows
Browser: Chrome
Toolkit Version 3.4.0

Setting Export
Please replace the text 'REPLACE_ME_WITH_SETTINGS' below with your exported Toolkit settings. You can export these by going to the Toolkit Options page, click the Import/Export Settings button at the top right and copying the text in the modal which appears.
Note! DO NOT replace the leading and trailing ``` characters as they are required formatting characters.
[{"key":"AccountsDisplayDensity","value":false},{"key":"AccountsEmphasizedInflows","value":false},{"key":"AccountsEmphasizedOutflows","value":true},{"key":"AccountsStripedRows","value":false},{"key":"AccountsStripedRowsColor","value":"#fafafa"},{"key":"AccountsStripedRowsDarkColor","value":"#1e1e1f"},{"key":"AutoDistributeSplits","value":true},{"key":"AutoEnableRunningBalance","value":true},{"key":"AutomaticallyMarkAsCleared","value":false},{"key":"BetterScrollbars","value":false},{"key":"BottomNotificationBar","value":false},{"key":"BudgetProgressBars","value":"goals"},{"key":"BulkEditMemo","value":true},{"key":"BulkManagePayees","value":true},{"key":"CalculateIRR","value":"Purple"},{"key":"CalendarFirstDay","value":false},{"key":"CategoryActivityCopy","value":false},{"key":"CategoryActivityPopupWidth","value":false},{"key":"ChangeEnterBehavior","value":false},{"key":"ChangeMemoEnterBehavior","value":false},{"key":"CheckCreditBalances","value":false},{"key":"CheckNumbers","value":false},{"key":"ClearSelection","value":false},{"key":"CollapseInspector","value":false},{"key":"CompactIncomeVsExpense","value":true},{"key":"ConfirmEditTransactionCancellation","value":false},{"key":"CreditCardEmoji","value":false},{"key":"CtrlEnterCleared","value":false},{"key":"CurrentMonthIndicator","value":false},{"key":"CustomAverageBudgeting","value":false},{"key":"CustomizeColourScheme","value":true},{"key":"DateOfMoney","value":false},{"key":"DaysOfBuffering","value":false},{"key":"DaysOfBufferingExcludeCreditCards","value":false},{"key":"DefaultCCToCleared","value":false},{"key":"DeselectTransactionsOnSave","value":true},{"key":"DisableToolkit","value":false},{"key":"DisplayTargetGoalAmount","value":"3"},{"key":"DisplayTotalMonthlyGoals","value":"show-total-only"},{"key":"DisplayTotalOverspent","value":false},{"key":"DisplayUpcomingAmount","value":true},{"key":"EasyTransactionApproval","value":false},{"key":"EditAccountButton","value":false},{"key":"EnlargeCategoriesDropdown","value":true},{"key":"FilterCategories","value":true},{"key":"GoalIndicator","value":true},{"key":"GoalWarningColor","value":false},{"key":"GoogleFontsSelector","value":false},{"key":"HideAccountBalancesType","value":false},{"key":"HideAgeOfMoney","value":false},{"key":"HideClosedAccounts","value":false},{"key":"HideDebtRatio","value":false},{"key":"HideHelp","value":true},{"key":"HideReferralBanner","value":true},{"key":"HighlightNegatives","value":false},{"key":"HoveredBudgetRows","value":false},{"key":"ImportNotification","value":"1"},{"key":"IncomeVsExpenseHoverHighlight","value":true},{"key":"LargerClickableIcons","value":true},{"key":"LiveOnLastMonthsIncome","value":false},{"key":"MasterCategoryRowColor","value":false},{"key":"MasterCategoryRowColorSelect","value":"#d1d1d6"},{"key":"MasterCategoryRowDarkColorSelect","value":"#636366"},{"key":"MemoAsMarkdown","value":false},{"key":"MonthlyNotesPopupWidth","value":false},{"key":"NavDisplayDensity","value":false},{"key":"NotesAsMarkdown","value":false},{"key":"POSStyleCurrencyEntryMode","value":false},{"key":"Pacing","value":false},{"key":"PrintingImprovements","value":true},{"key":"PrivacyMode","value":false},{"key":"QuickBudgetWarning","value":false},{"key":"ReconcileAssistant","value":true},{"key":"ReconcileBalance","value":true},{"key":"ReconcileConfetti","value":false},{"key":"ReconciledTextColor","value":"1"},{"key":"RemovePositiveHighlight","value":true},{"key":"RemoveZeroCategories","value":false},{"key":"ResetColumnWidths","value":true},{"key":"RightClickToEdit","value":true},{"key":"RowHeight","value":false},{"key":"RowsHeight","value":false},{"key":"SavingsRatio","value":"0.10"},{"key":"ScrollableEditMenu","value":true},{"key":"ShowAvailableAfterSavings","value":true},{"key":"ShowCategoryBalance","value":true},{"key":"SpareChange","value":true},{"key":"SplitTransactionAutoAdjust","value":true},{"key":"SplitTransactionAutoFillPayee","value":false},{"key":"SplitTransactionTabExpand","value":false},{"key":"SquareNegativeMode","value":true},{"key":"StealingFromFuture","value":false},{"key":"StripedBudgetRows","value":false},{"key":"SubtractUpcomingFromAvailable","value":"1"},{"key":"SwapClearedFlagged","value":false},{"key":"TargetBalanceWarning","value":false},{"key":"ToBeBudgetedWarning","value":false},{"key":"ToggleAccountColumns","value":true},{"key":"ToggleMasterCategories","value":false},{"key":"ToggleSplits","value":false},{"key":"ToggleTransactionFilters","value":false},{"key":"ToolkitReports","value":true},{"key":"UnclearedAccountHighlight","value":true},{"key":"ViewZeroAsEmpty","value":false}]

I'm not sure quite why this happens. I've been able to replicate it myself as well.
It seems to be due to a column sizing issue. Enabling "Add Reset Column Widths Button" and clicking that button when I see the column missing fixes it for me.
Let me know if that makes it stick for you - it seems to work for me from that point forward.

Hello!
yes that does seem to work.
I also am not on the same computer now, however so my toolkit did not have
quite the same settings. I was able to resize the columns on this browser.
On Fri, 18 Nov 2022 at 22:02, William McKinnerney @.***>
wrote:

I'm not sure quite why this happens. I've been able to replicate it myself
as well.
It seems to be due to a column sizing issue. Enabling "Add Reset Column
Widths Button" and clicking that button when I see the column missing fixes
it for me.
Let me know if that makes it stick for you - it seems to work for me from
that point forward.
—
Reply to this email directly, view it on GitHub
https://github.com/toolkit-for-ynab/toolkit-for-ynab/issues/3005#issuecomment-1320803396,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/A4GOS4ODNYJXFO7I4ZR2E6DWJBNO7ANCNFSM6AAAAAASBBGJPY
.
You are receiving this because you authored the thread.Message ID:
@.***>

--
Regards,
Shawn Gillespie

I've run into the same issue when enabling Running Balance (where the running balance column is missing or very narrow), and have fixed it (with caveat to follow) with "Reset Column Widths".
I seem to run into an issue, however, where the reset of the column widths doesn't persist unless I manually fiddle with at least one of the column widths to change it. In other words, after the reset, unless I customize at least one of the column widths, the problem reappears when I go to another page and come back to the page in question.

Yeah, I have had this issue and the workaround is just to resize the running balance because it gets hidden as well for whatever reason.

I think its a similar bug. But could you verify that the running balance doesn't display when you choose "reset column widths" in the menu? I have noticed my browser sometimes has trouble knowing how big my screen is and I have to reset it because it is enabled just hiding
Josh Saxton

From: DebbieKat @.>
Sent: Tuesday, May 23, 2023 3:50:00 PM
To: toolkit-for-ynab/toolkit-for-ynab @.>
Cc: Joshua Saxton @.>; Comment @.>
Subject: Re: [toolkit-for-ynab/toolkit-for-ynab] [BUG] ... running balance doesnt work on any accounts except Main account (Issue #3005)
I have the toolkit set to automatically enable running totals on my accounts, but every time I view my accounts, it is turned off. Is this the same bug? Or a new one?
—
Reply to this email directly, view it on GitHubhttps://github.com/toolkit-for-ynab/toolkit-for-ynab/issues/3005#issuecomment-1560035645, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ABCFY6IOSLQEF3M2WHC6SO3XHUIGRANCNFSM6AAAAAASBBGJPY.
You are receiving this because you commented.Message ID: @.***>

I think its a similar bug. But could you verify that the running balance doesn't display when you choose "reset column widths" in the menu? I have noticed my browser sometimes has trouble knowing how big my screen is and I have to reset it because it is enabled just hiding Josh Saxton
…
________________________________ From: DebbieKat @.> Sent: Tuesday, May 23, 2023 3:50:00 PM To: toolkit-for-ynab/toolkit-for-ynab @.> Cc: Joshua Saxton @.>; Comment @.> Subject: Re: [toolkit-for-ynab/toolkit-for-ynab] [BUG] ... running balance doesnt work on any accounts except Main account (Issue #3005) I have the toolkit set to automatically enable running totals on my accounts, but every time I view my accounts, it is turned off. Is this the same bug? Or a new one? — Reply to this email directly, view it on GitHub<#3005 (comment)>, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ABCFY6IOSLQEF3M2WHC6SO3XHUIGRANCNFSM6AAAAAASBBGJPY. You are receiving this because you commented.Message ID: @.***>

Yes, reset column widths does appear to fix it.
Thanks!

It's annoying, but the column is still there then, it just makes it so small you can't see the column. But it is there.

From: DebbieKat @.>
Sent: Tuesday, May 23, 2023 6:28 PM
To: toolkit-for-ynab/toolkit-for-ynab @.>
Cc: Joshua Saxton @.>; Comment @.>
Subject: Re: [toolkit-for-ynab/toolkit-for-ynab] [BUG] ... running balance doesnt work on any accounts except Main account (Issue #3005)
I think its a similar bug. But could you verify that the running balance doesn't display when you choose "reset column widths" in the menu? I have noticed my browser sometimes has trouble knowing how big my screen is and I have to reset it because it is enabled just hiding Josh Saxton
…
________________________________ From: DebbieKat @.> Sent: Tuesday, May 23, 2023 3:50:00 PM To: toolkit-for-ynab/toolkit-for-ynab @.> Cc: Joshua Saxton @.>; Comment @.> Subject: Re: [toolkit-for-ynab/toolkit-for-ynab] [BUG] ... running balance doesnt work on any accounts except Main account (Issue #3005https://github.com/toolkit-for-ynab/toolkit-for-ynab/issues/3005) I have the toolkit set to automatically enable running totals on my accounts, but every time I view my accounts, it is turned off. Is this the same bug? Or a new one? — Reply to this email directly, view it on GitHub<#3005 (comment)https://github.com/toolkit-for-ynab/toolkit-for-ynab/issues/3005#issuecomment-1560035645>, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ABCFY6IOSLQEF3M2WHC6SO3XHUIGRANCNFSM6AAAAAASBBGJPY. You are receiving this because you commented.Message ID: @.***>
Yes, reset column widths does appear to fix it.
Thanks!
—
Reply to this email directly, view it on GitHubhttps://github.com/toolkit-for-ynab/toolkit-for-ynab/issues/3005#issuecomment-1560209163, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ABCFY6M34KNFFMQOT4K4FK3XHU2YRANCNFSM6AAAAAASBBGJPY.
You are receiving this because you commented.Message ID: @.***>

Hello! We're running effort to cleanup issues a bit so we'll be able to actually keep track of them. This issue seem to be fixed (at least I wasn't able to reproduce it with current version of toolkit), so I'm going to close this issue. If you still experience problems, feel free to comment and I'll reopen it.


Android POS/KDS

An android version of this app with all of the same functionality.
This should be in DQL, which means that the iOS version will also need to be converted to DQL as part of a separate piece of work.

I have been working on this whenever I get time and I pretty much have an MVP ready for publishing to the Play store. The app can be built from the main branch under the Android directory. Would be grateful for any testing and messing around with it before I publish to the Play store.
Known issues/missing features:

Custom Locations
Evictions (though I don't think the iOS version has this?)
A few minor UI issues, but no showstoppers (i.e. nothing broken)
No heartbeat config
No interface to change log level

Besides that, the app works fully in demo mode and has feature parity with iOS. It also syncs with other Android devices as well as the iOS app. The app also features the Android Tools Viewer integration, so all tools are available.
Besides the known issues stated above, there is some code refactoring I'd like to do as I'd like it to be a good example of an Android app integrating with Ditto.
I will be making a Loom video demo soon as well!

GH issues have been created in the repo for remaining items and bugs/issues.
Also created a GH issue for publishing to the Play Store so I think we can close this one out!


The training goes error when you updated the 'blip2_t5.py' for optimizer parameters loading

When I run the training command 'python -m torch.distributed.run --nproc_per_node=8 train.py --cfg-path lavis/projects/blip2/train/pretrain.yaml', using the latest version, it goes error. The error information is listed below. I think the reason lies in  'blip2_t5.py' line 54-61, the newly added codes.
''
Traceback (most recent call last):
File "train.py", line 111, in
main()
File "train.py", line 107, in main
runner.train()
File "/root/3DLLM/3D-LLM-main-10.16/3DLLM_BLIP2-base/lavis/runners/runner_base.py", line 360, in train
train_stats = self.train_epoch(cur_epoch)
File "/root/3DLLM/3D-LLM-main-10.16/3DLLM_BLIP2-base/lavis/runners/runner_base.py", line 396, in train_epoch
return self.task.train_epoch(
File "/root/3DLLM/3D-LLM-main-10.16/3DLLM_BLIP2-base/lavis/tasks/base_task.py", line 110, in train_epoch
return self._train_inner_loop(
File "/root/3DLLM/3D-LLM-main-10.16/3DLLM_BLIP2-base/lavis/tasks/base_task.py", line 211, in _train_inner_loop
loss = self.train_step(model=model, samples=samples)
File "/root/3DLLM/3D-LLM-main-10.16/3DLLM_BLIP2-base/lavis/tasks/base_task.py", line 64, in train_step
loss = model(samples)["loss"]
File "/opt/conda/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1194, in _call_impl
return forward_call(*input, **kwargs)
File "/opt/conda/lib/python3.8/site-packages/torch/nn/parallel/distributed.py", line 1026, in forward
if torch.is_grad_enabled() and self.reducer._rebuild_buckets():
RuntimeError: Expected to have finished reduction in the prior iteration before starting a new one. This error indicates that your module has parameters that were not used in producing loss. You can enable unused parameter detection by passing the keyword argument find_unused_parameters=True to torch.nn.parallel.DistributedDataParallel, and by
making sure all forward function outputs participate in calculating loss.
If you already have done the above, then the distributed data parallel module wasn't able to locate the output tensors in the return value of your module's forward function. Please include the loss function and the structure of the return value of forward of your module when reporting this issue (e.g. list, dict, iterable).
Parameter indices which did not receive grad for rank 0: 1 2
In addition, you can set the environment variable TORCH_DISTRIBUTED_DEBUG to either INFO or DETAIL to print out information about which particular parameters did not receive gradient on this rank as part of this error
''

Temporarily fixed in https://github.com/UMass-Foundation-Model/3D-LLM/tree/9717617bc7e68ad0e5a571c58774e7db64c042f9
(Might need to suppress warnings)


(WIP) SgV2: Separate "rows" endpoint into API interface, impl class

What this PR does:
Separates formerly coupled REST endpoint API and implementation into interface (API, annotations) and implementation (no method annotations, actual implementation)
Checklist

[x] Changes manually tested -- verify Swagger API works as well (no unit tests)
[x] Automated Tests added/updated -- passes same tests as before changes (all endpoints covered)
[ ] Documentation added/updated

Agreed, it's not an optimal solution. But when just annotations produce 1/3 of all lines (partly due to auto-indenter using... lots of space) it does seem better to split things as that makes it easier to change implementation, where most work usually is.
I made suggested changes and will merge this; we can further improve aspects as things go.
Couple of things to note:

Only interface works: I tried abstract class and that did NOT work with Jersey at least (although some docs suggested it might)
While JAX-RS class annotations must be on impl class, Swagger seems smarter and allows annotations on either (but like JAX-RS, probably won't merge if both have them).


Improve cross pool injection test

Please see discussion at end of #4405 for further information.

Bumping this issue, with the extra comment that the test is failing quite frequently on rostam in particular and the shared-priority scheduler needs to be looked at sometime soon.

@biddisco is this something you still want to get back to?


json is not serialized in order format

I tried your class for serializing the object to XML. I am facing one problem. While serializing my xml tags are not in order format. Due to that I am getting error when I try to send the SOAP request.
My wrapper class
public class FedexRequestJSON {
	public cls_ProcessShipmentRequest ProcessShipmentRequest;

	public class cls_ProcessShipmentRequest {
		public cls_WebAuthenticationDetail WebAuthenticationDetail;
		public cls_ClientDetail ClientDetail;
		public cls_TransactionDetail TransactionDetail;
		public cls_Version Version;
		public cls_RequestedShipment RequestedShipment;
	}
}

My Output on JSON Serialize(I didn't post the complete output just a sample to show how the order was changed)
{
  "ProcessShipmentRequest" : {
    "WebAuthenticationDetail" : {
      "UserCredential" : {
        "Password" : "**",
        "Key" : "***"
      }
    },
    "Version" : {
      "ServiceId" : "ship",
      "Minor" : 0,
      "Major" : 23,
      "Intermediate" : 0
    },

Is it possible to serialize the same order like in Wrapper class order.

Is there any reason why the order matters?

Is there any reason why the order matters?

It matters sometimes. Some services are with a setting that you must follow the order of elements strictly or it returns an error like "Expected element xxxxx instead of xxxxx". It would be a great improvement to save time doing a reorder after call the utility.
You saved me a lot of time with this utility classes. Thank you so much @skolakan !!


[release-0.41] Manual bulk backport of hotplug test fixes

What this PR does / why we need it:
We fixed a bunch of tests on 0.44 and onwards but never backported those fixes to 0.41, specifically:
#5610, #5769, #5938, #5985
Which issue(s) this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close the issue(s) when PR gets merged):
Fixes #
Special notes for your reviewer:
Release note:

NONE

/lgtm

/lgtm

/approve


AMQP Channel on MQ

New performance test harness for use with the PerfHarness.
This will performance testing of the MQ AMQP Channel using the existing
infrastructure and tests.

This is an additional test channel and does not change any of the existing files.


Feature/suite path

My goal is to to make possible run test suites in parallel. The first step is make reporters independent from test suites hierarchy.
In this request I added suitePath property and refactored the flat reporter.
Next I will pull requests about html reporter, teamcity reporter and moving grep before running tests.

Coverage increased (+0.02%) to 61.8% when pulling bd1afedbf84dcb3fd259dd7d427074f12547fc14 on hatroman:feature/suitePath into 36b2a62471d70fecff4b8e2898a9cade6481a5be on bem:master.


[frontend] Add text field to set a username

add request to the backend
add text field on user page

design here: https://www.figma.com/file/wotPPn36lbheCaGHTlPX0N?node-id=4244:58938#306077576


Create blackjackv2

This plugin automatically swaps between knock-out and pickpocket, no more RSI when doing blackjack.

This is against the statement found here: https://secure.runescape.com/m=news/third-party-client-guidelines?oldschool=1


[2756] Added scholarship to staging

Context
Changes proposed in this pull request
Guidance to review

 Enable scholarships in staging


How to use your library with a server-side read file content?

I am reading a file content using php
<?php
            $file_name = './image6513693026486043647.jpg';
            $image_file_content = base64_encode(file_get_contents( $file_name ));

            $image_size = getimagesize( $file_name );
?>

I tried to pass data to js-side using this
    const jpegData = Buffer.from("<?php echo $image_file_content ?>", 'base64');
    const rawImageData = jpeg.decode(jpegData);
    const clamped_array = Uint8ClampedArray.from(rawImageData);
    const qrContent= window.jsQR(
                clamped_array,
                <?php echo $image_size[0]; ?>,
                <?php echo $image_size[1]; ?>
            );

But the problem is that jpeg.decode give me an error about malformed data
I logged jpegData

I ask you kindly what transformation to to my file data [a valid jpg] to be scanned client-side from your library.

But the problem is that jpeg.decode give me an error about malformed data

This seems like the kind of thing you'd need to take up with the author of the jpeg decode library?
jsQR just needs an array of RGBA pixel values, so using jpeg.decode or such seems right to me, but I do not know why it would throw an error without knowing that code.

I found how to make it work
$image_file_content = base64_encode(file_get_contents( $filepath ));
$image_size = getimagesize( $filepath );

then I force js output bassind data
const jpegData = Buffer.from("<?php echo $image_file_content ?>", 'base64');

const rawImageData = jpeg.decode(jpegData);

const clamped_array = Uint8ClampedArray.from(rawImageData.data);

const qr_code_text = window.jsQR(
                    clamped_array,
                    <?php echo $image_size[0]; ?>,
                    <?php echo $image_size[1]; ?>
);

After then I can use qr_code_text su decode an european green pass
const greenpassBody = qr_code_text.trim().substr(4);
const decodedData = base45.decode(greenpassBody);
const deflatedData = pako.inflate(decodedData);
const decodedGreenPassaData  = cbor.decodeAllSync(deflatedData);
const decodedGreenPassDataValue = decodedGreenPassaData[0].value;
[headers1, headers2, cbor_data, signature] = decodedGreenPassDataValue;
const greenpassData = cbor.decodeAllSync(cbor_data);


Update jay-gordon.yml

bio update

Docs Build status updates of commit ee09092:
:warning: Validation status: warnings

File
Status
Preview URL
Details

advocates/index.html.yml
:warning:Warning
View
Details

advocates/jay-gordon.yml
:white_check_mark:Succeeded
View

advocates/map.yml
:white_check_mark:Succeeded
View

advocates/media/profiles/jay-gordon.png
:white_check_mark:Succeeded
View

advocates/index.html.yml

Line 10, Column 8: [Warning-file-not-found] Invalid file link: './map'.
Line 12, Column 8: [Warning-file-not-found] Invalid file link: './tweets'.

For more details, please refer to the build report.
If you see build warnings/errors with permission issues, it might be due to single sign-on (SSO) enabled on Microsoft's GitHub organizations. Please follow instructions here to re-authorize your GitHub account to Docs Build.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
Note: Your PR may contain errors or warnings unrelated to the files you changed. This happens when external dependencies like GitHub alias, Microsoft alias, cross repo links are updated. Please use these instructions to resolve them.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

Docs Build status updates of commit ee09092:
:warning: Validation status: warnings

File
Status
Preview URL
Details

advocates/index.html.yml
:warning:Warning
View
Details

advocates/jay-gordon.yml
:white_check_mark:Succeeded
View

advocates/map.yml
:white_check_mark:Succeeded
View

advocates/media/profiles/jay-gordon.png
:white_check_mark:Succeeded
View

advocates/index.html.yml

Line 10, Column 8: [Warning-file-not-found] Invalid file link: './map'.
Line 12, Column 8: [Warning-file-not-found] Invalid file link: './tweets'.

For more details, please refer to the build report.
If you see build warnings/errors with permission issues, it might be due to single sign-on (SSO) enabled on Microsoft's GitHub organizations. Please follow instructions here to re-authorize your GitHub account to Docs Build.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
Note: Your PR may contain errors or warnings unrelated to the files you changed. This happens when external dependencies like GitHub alias, Microsoft alias, cross repo links are updated. Please use these instructions to resolve them.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel


ilvl sync feature

It would be cool if we could compute our stats synced to a particular ilvl, a la etro.

This should be merged into issue #19


Move augmentations in transforms

Moving new augmentations from #285 in transforms.
Linking missing transforms in documentations

Are those transforms in the last release? Any BC breaking issue?

Are those transforms in the last release? Any BC breaking issue?

None of these were on the last release, only in master.

As a TODO we should add splitting the compute component of these augmentations out into functionals.


Build release 1.2.5 (take 2)

@fpesce: The following test failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

prow/release-e2e-pilot-no_auth
8dc2e66522df05aa8687bb0ba44f24f5452372b1
link
/test release-e2e-pilot-no_auth

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

/test release-e2e-pilot-no_auth
  Warning  FailedMount  19s (x6 over 34s)  kubelet, gke-gke-082319-u27s2g1mj-default-pool-bedcbf4a-6zgw  MountVolume.SetUp failed for volume "istio-certs" : secrets "istio.default" not found

/test release-e2e-pilot-no_auth


Full Labels in LaserMix

In your paper, you present a comparison with Full Labels (Fig 1. right)
What does "full" mean in the case of LaserMix? Since it is a semi-supervised approach, what does training with the full train split mean? Is it just the Cylinder3D/FIDNet trained in a supervised way? If so, why the results don't match? Or is there any mixing involved  like labeled + labeled?

In your paper, you present a comparison with Full Labels (Fig 1. right)
What does "full" mean in the case of LaserMix? Since it is a semi-supervised approach, what does training with the full train split mean? Is it just the Cylinder3D/FIDNet trained in a supervised way? If so, why the results don't match? Or is there any mixing involved  like labeled + labeled?

Hi @matildecc, thanks for your interest in our work.
For your question: The "full" setting means that the whole training set is considered as both the labeled set and unlabeled set in semi-supervised learning. The framework is LaserMix, which takes a pair of labeled and unlabeled data for feature learning. Therefore, the performance is higher than simply using Cylinder3D/FIDNet for training on the labeled set.
Should you have any questions, please let me know. Thanks again!

Hi @ldkong1205 !
Thank you for your quick answer. And congrats for the work. It's really interesting...
I don't think I understood your answer correctly.
When it's 10%, it means that 10% of the original train split is selected as labeled and 90% as unlabeled. The same idea applies to 20% and 50%. If you're referring to the "full" case, it would mean that 100% of the data is labeled? If yes, how do you perform the mixing part? labeled + labeled? Do the pseudo-labeling still exists ?

Hi @ldkong1205 ! Thank you for your quick answer. And congrats for the work. It's really interesting...
I don't think I understood your answer correctly. When it's 10%, it means that 10% of the original train split is selected as labeled and 90% as unlabeled. The same idea applies to 20% and 50%. If you're referring to the "full" case, it would mean that 100% of the data is labeled? If yes, how do you perform the mixing part? labeled + labeled? Do the pseudo-labeling still exists ?

Hi @matildecc, sorry for the late reply!
For your question:

"When it's 10%, it means that 10% of the original train split is selected as labeled and 90% as unlabeled."

A: Your understanding is correct. This is the standard setting for semi-supervised learning.

If you're referring to the "full" case, it would mean that 100% of the data is labeled? If yes, how do you perform the mixing part? labeled + labeled? Does the pseudo-labeling still exist?

A: In terms of 100%, we assume that all training samples are both treated as "labeled" and "unlabeled". We perform the mixing just as semi-supervised learning. The pseudo-labels for the "unlabeled" (although they have labels under 100% setting) are still generated from the Teacher net. You can think of this as some sort of "data augmentation" of "self-training", where the training samples are supervised by both the ground truth labels, as well as the pseudo-labels generated by the network itself.

Please let us know if the above resolves your question. We are happy to provide more detailed explanations if you still have issues!


Is there any way to use this library if I am not using combineReducers()?

I am trying to fix my redux state to be a specific structure and combineReducers() does not work for the said purpose.
The documentation lacks any information as to why combineReducers() must be used, but it almost feels like either I use combineReducers() or I cannot use this library.
Is there any workaround?

Yes, you can. I dont use combineReducers in my projects and connected-react-router still works fine.
const middlewares = [
    routerMiddleware(history)
];

const enhancers = applyMiddleware(...middlewares);

const store = createReduxStore(rootReducer, enhancers);


Hosts are not set if SearchOptions.hosts is undefined

Because the way of how spread work and how typescript handles Readonly it's quite hard to set hosts dynamically.
const hosts; // undefined by default
const test = { hosts: [], ...{ hosts } };

// Will yield `{ hosts: undefined }`

It's problematic because, AlgoliaSearchOptions.hosts is readonly so if you want to do conditional change it won't let you do it. And because we don't have access to the default values it can make the code less clear to avoid this problem
Fail
 let hosts?: HostOptions[];

 if (appId.startsWith('1234')) {
   hosts = [{ ... }];
 }

const client = algoliasearch(appId, apiKey, {
    hosts,
});
// This will fail without warning

pass
 // meh
 if (appId.startsWith('1234')) {
  const client = algoliasearch(appId, apiKey, {
    hosts,
  });
 } else {
  const client = algoliasearch(appId, apiKey);
}

const options?: AlgoliaSearchOptions;

 if (appId.startsWith('1234')) {
    // @ts-ignore sad :(
   options.hosts = [{ ... }];
 }

const client = algoliasearch(appId, apiKey, options);

You need to change hosts dynamically @bodinsamuel?

That's intentional, and it brings advantages: Makes the immutable client without having us applying deep copies on the giving options.
We don't wanna people being able to change options once the client is initialised. Sorry. 👍

I think the error is clearer here:
const hosts = appId.startsWith('1234') ? [{...}] : undefined

const client = algoliasearch(appId, apiKey, {
  hosts
});

with this code, the hosts value in the client will be undefined, instead of the default value because of
https://github.com/algolia/algoliasearch-client-javascript/blob/a91bf8e611e9892d26e13aca67bbba5bec3b15f5/packages/client-search/src/createSearchClient.ts#L36
this line will override the default hosts with hosts: undefined because of how spread works.
The solution for a user right now is to not pass hosts at all in the object, but the only way to do that is e.g. like this, which isn't so clean:
const client = algoliasearch(
  appId,
  apiKey,
  appId.startsWith('1234') ? { hosts: [{...}] } : {}
);

I'm not sure what the solution is here, but it might be to not rely on spread / Object.assign semantics where undefined overrides a value

Going to re-read this issue tomorrow morning.

thanks for the clarification @Haroenv 👌


Query module: When selecting 'choose layer to select from' it should give information on what kind of data you can query and the unit of this data.

Currently 'show attributes' only opens the dataset mentioning some technical details describing columns, number of rows, etc. This probably wont make much sense to the user to understand what to query. Once the metadata is available, this part should be changed to make more sense to users.

At the moment, available data are:

type - CHARACTRE/DOUBLE PRECISION/ INTEGER
description - needs to be added in the metadata.json
min/max value
The value's unit is not provided by default. If required, this data needs to be added manually to the metadata.json during data-preparation phase.

After adding the data manually to the metadata.json, the information is clearer than before, but would still require information on the data from the user's side. Assuming this is a pre-requisite and hence closing this issue.

After adding the data manually to the metadata.json, the information is clearer than before, but would still require information on the data from the user's side. Assuming this is a pre-requisite and hence closing this issue.


Update 02-advanced-configuration.md

I found that the suggested suppress_comment regex didn't work for me until I inserted another backslash before the n.

Hmm, we have a repo that uses \\(.\\|\n\\)*\\$FlowFixMe (no extra backslash) without issue (and I can't seem to repro this there).
I won't have time to dig in to this until later, but just wanted to comment so we can understand what's different between your system and ours before we take this

TL;DR - I'm not sure why the suppress_comment is not working for you, but I don't think this change should fix it.
The value of suppress_comment is an OCaml string that would be used as an OCaml Str.regexp. For example, if you write suppress_comment=\\[0-9\\]*, this is interpreted as
let suppressComment = Str.regexp "\\[0-9\\]*"

So there are two layers of backslash escaping at work here:

Escaping for the OCaml string
Escaping for the OCaml regex (documented here)

So the value of the string "\\[0-9\\]*" is \[0-9\]*and that's used by the regex.
For this PR, the old suppress_comment was \\(.\\|\n\\)*\\$FlowFixMe. This is interpreted as the string "\\(.\\|\n\\)*\\$FlowFixMe", whose value after escaping is \(.\|<LF>\)*\$FlowFixMe. (where <LF> is the line feed character, generally written as \n)
This PR changes \n to \\n. This means the OCaml string is changed from containing a <LF> to containing \n (a backslash followed by an n). The OCaml regex \n matches the character n.
# Str.string_match (Str.regexp "\\n") "n" 0;;
- : bool = true


vivus + grunt build dosent work

hey, when i use vivus for a yomen webapp project.
on grunt serve, vivus dosent create object tag wraping svg file:
var need = new Vivus('need', { 		file: 'images/need-all.svg', 		onReady: function (myVivus) { 		    $(myVivus.el).addClass('finished').css({ 		    	// 'bottom': 0, 		    	// 'top' : 'auto', 		    	'height' : 'auto', 		    }); 		}	     	});
when i'm using grunt build, object tag wraping my svg, and it dosent animate.

Hey, got any errors in your browser debugger? (In Chrome, open devlopper
tools, then go to the 'console' tab)

Nope. No errors specifically about vivus.
On Fri, 13 May 2016 at 11:45 maxwellito<EMAIL_ADDRESS>wrote:

Hey, got any errors in your browser debugger? (In Chrome, open devlopper
tools, then go to the 'console' tab)
—
You are receiving this because you authored the thread.
Reply to this email directly or view it on GitHub
https://github.com/maxwellito/vivus/issues/105#issuecomment-218985627

Have you tried without your builder? Can you make a jsfiddle? Check that
your SVG is visible and displayed

ok, i'm getting
Uncaught SecurityError: Failed to read the 'contentDocument' property from 'HTMLObjectElement': Blocked a frame with origin "null" from accessing a frame with origin "null". Protocols, domains, and ports must match.
after a lot of reading i found out its a chrome problem with same-origin frame.
my question is why there;s need to wrap svg with object tag on build?

Because it load it and build the DOM, then Vivus pick the SVG tag and move
it to your page (and delete the object tag). No need of an external library
to load the file.

Any help?

ya, it helped.
the issue was the the cross-origin loading iframe.
its fine on proddaction : http://monita.appsecure.co/
2016-05-15 1:11 GMT+03:00 maxwellito<EMAIL_ADDRESS>
Closed #105 https://github.com/maxwellito/vivus/issues/105.
—
You are receiving this because you authored the thread.
Reply to this email directly or view it on GitHub
https://github.com/maxwellito/vivus/issues/105#event-660829581


Laravel 5.4 Support

Added support for Laravel 5.4 ( relates to #2 ).
It seems, that laravelcollective/html now supports Laravel 5.4.
See: https://github.com/LaravelCollective/html/releases

Looks good, thank you! 👍


Cannot run multiprocessing from jupyter code cells but runs fine when paste on Python Interactive Window

Bug: Notebook Editor, Interactive Window, Editor cells

Steps to cause the bug to occur

Separate the called function itself to another .py called "Test1.py"

def my_function(x):
    x += 1
    return x

Start new .py file

import multiprocessing
from Test1 import my_function

pool = multiprocessing.Pool()
results = pool.map(my_function, [1,2,3,4,5,6])
pool.close()
pool.join()
print(results)

Hit Run Cell/Run Selection.

Note that this block of code runs fine when submitted directly to the interactive window or on Jupyter notebook (.ipynb)
Please help.
Actual behavior
Stuck forever

Expected behavior
print out [2,3,4,5,6,7] like shown below

Your Jupyter and/or Python environment
Please provide as much info as you readily know

Jupyter server running: Local

Extension version: 2020.06.89148-xxx

VS Code version:
Version: 1.46.1 (user setup)
Commit: cd9ea6488829f560dc949a8b2fb789f3cdc05f5d
Date: 2020-06-17T21:13:20.174Z
Electron: 7.3.1
Chrome: 78.0.3904.130
Node.js: 12.8.1
V8: 7.8.279.23-electron.0
OS: Windows_NT x64 10.0.15063

Setting python.jediEnabled: true

Setting python.languageServer: Jedi

Python and/or Anaconda version: 3.7.7

OS: Windows

Virtual environment: conda

Developer Tools Console Output

Microsoft Data Science for VS Code Engineering Team: @rchiodo, @IanMatthewHuff, @DavidKutu, @DonJayamanne, @greazer, @joyceerhl

I believe this is a problem with multiprocessing and ipython. See this blog post about it:
https://medium.com/@grvsinghal/speed-up-your-python-code-using-multiprocessing-on-windows-and-jupyter-or-ipython-2714b49d6fac
I did what the blog post suggested and it started working:
#%%
import multiprocessing
from workers import my_function

#%%
if __name__ ==  '__main__':
    pool = multiprocessing.Pool()
    results = pool.map(my_function, [1,2,3,4,5,6])
    pool.close()
    pool.join()
    print(results)

Hi, i did try that before but putting a main did not help. It is still spinning forever.
May i ask what makes running directly in Interactive Window and running from Jupyter link cell difference?
Thank you

The only difference should be an extra bit of code that changes the current directory on the kernel to match the file from where the cell runs. I don't think this should affect the problem though. I believe the root cause of the issue is a timing problem in the kernel (we've seen this bug before and it repro'd with code running from the interactive window).
For example, when I repro'd your bug, it didn't require putting the 'my_function' into a separate file. It repro'd with it in the same file as the pool cell.

Thanks for a quick reply.
I am actually on the ancestor extension of this by DonJayamanne where every command start with "Jupyter" and that extension runs just fine but it is depreciated and i am in need of new home and this extension looks like one. It is just that i have several .py files that coded with multiprocessing.
I went ahead and tried with a big chuck of codes where it calls to several modules that coded with multiprocessing and it finished the run as expected if submitted directly on Interactive Window.
I mean, that "main" thing does not help me get away. Can you recommend the steps i need to do next?
Can "Run Cell" not change the directory to match the file at all so that i can see if it changes anything?
Thank you

Can you recommend the steps i need to do next?

Without root causing the hang in the kernel, it's unclear where the problem lies. I believe it's an ipython issue, but I can't tell for sure without debugging the kernel itself. If you search stack overflow for ipython and multiprocessing pool, you'll see a number of hits. This one seems relevant:
https://stackoverflow.com/questions/57103984/why-cant-jupyter-notebooks-handle-multiprocessing-on-windows

Can "Run Cell" not change the directory to match the file at all so that i can see if it changes anything?

There is no current way to do this. You'd have to change the code in our extension. It's actually not changing the directory. It's actually setting the file variable.
For example, if I execute this code from a python file:
print('foo')

These two pieces of code are sent to the kernel:
__file__ = 'Untitled-1'

print('foo')

However if I execute print('foo') from just the interactive window, then just print('foo') is sent.
The line to change in our code is here:
https://github.com/microsoft/vscode-python/blob/036621a3be73b8d7fb5f31d7acebd4a3b1106b55/src/client/datascience/interactive-common/interactiveBase.ts#L628

Thank you for answering all of my question.
Can you suggest me where to look next in term of building the package after i arbitrarily change the line of code for testing?

@rchiodo
Hi, i have a problem building the .vsix package after the changed is made on interactiveBase.ts to skip the set file thing. If it is not too much to ask, could you please comment the lines and build that for me?
Im on Windows10, i followed the instruction under but no success. I have got error on node-gyp and just can't complete the build.
So i went back and tried to replicate the issue by doing as follows...

I tried to file = opening file path before execute the code in Interactive Window and it just never finished the task.
I also tried to set file before submitting the code with the DonJayamanne's Jupyter extension and it also ran forever.
Do the same on .ipynb file and it also never released the process.

With the above observations, may i say that it has something to do with file? Not sure if others experiencing the same or it is just my machine as i only have one laptop.
Thank you for your consideration.

I tried that out and it seemed to fix it for me. Maybe we have to special case this somehow. Like if the multiprocessing module is imported, don't set __file__ anymore.
I submitted a run so you could get the VSIX too:
https://dev.azure.com/ms/_apis/resources/Containers/6839716/VSIX?itemPath=VSIX%2Fms-python-insiders.vsix

@rchiodo
Thanks for that. I clicked on the link and got rejected (unauthorized problem). Im really new to this. Do you have a page or short instructions where i can follow and make a pick up on .VSIX file.
Thanks

@rchiodo
Hi, just to update you.
I could not get the .VSIX file but i went to the branch you submitted and copy the .zip file. I then extracted and replaced them in-place of the current vscode-python extension under my user folder/.vscode/extensions.
Voila! It works perfectly and I can't be any happier.
If it does not impact others, is it possible to include this to master or put it is as an option where user (like me) can enable/disable it in the extension's settings?
Appreciate your help!

No that link should just work. Not sure why it requires authorization.

Yeah I'd like to know why __file__ is having that effect. Very strange.

I agree with you here. I think passing __file__ may have cause a serious timing issue. I would love to try to make the kernel forget __file__ after it was set (w/o reset the kernel) and see how it takes up the multiprocess block after it forget where it currently is. (Just do not know how to though except restart the kernel which surely make it work afterwards.)
Thanks again for reopening this as i really want it fixed so that i can 100% switch to this new home, hehe.

Hi @rchiodo
Any updates on the matter? Should i close the issue or just leave it like this till it is resolved?
Thanks

It's in our backlog to be fixed at the moment. Not a high priority but setting __file__ may break other stuff too so we'd rather not do it if we can help it.
The plan is to only set __file__ when running code from a different file. This would fix your case if you ran the pool code as the second cell.

Thank you. I will then just leave it like this and wait for your help and closure.
Appreciate your help.

@rchiodo
Sorry to bother you but is there any future plan for the matter? I'm still on the dev version you compiled 3-4 months ago as I am afraid of upgrading.
Cheers!

Sorry but we didn't implement the fix. Other people depend upon the setting of __file__ and we didn't want to break them. We were waiting for any upvotes on this issue to see if anybody else had a similar problem.
I think there might be another way to handle this. Not set the __file__ variable if the interactive window is already open an perFile is set as the interactive mode.

Moved back to triage. Should be easy to fix.
Check for perFile setting. If true and __file__ already set, then don't do it again. This should fix the problem logged in this bug and not break anybody else as they can't run any other files in a perFile IW.

Moved back to triage. Should be easy to fix.
Check for perFile setting. If true and __file__ already set, then don't do it again. This should fix the problem logged in this bug and not break anybody else as they can't run any other files in a perFile IW.

@rchiodo
Thanks for coming up with the fix. I really appreciate!

You're welcome. Our next release should have the fix.

Seems to be working if:

Switch interactive to perFile:

Run a cell in the interactive window before importing multiprocessing
Make sure to wait a bit? Not sure why that matters.

Hi @rchiodo ,
Thanks for the update. It, however, does not fix the multiprocessing issue on mine but the custom version that you've compiled a couple months ago is still running fine.
Lately, I am leaning towards multiprocessing wrapper packages such as 'joblib' and it does not give out the forever spinning issue at all when runs.
Do you think we should close the thread?
Anyway, thanks for your help and your time on the entire discussion.

I'll close this issue. I opened another issue that points out the problem with the interactive window not working on first startup. Not sure why though.


Feat/civ 747

JIRA link (if applicable)
https://tools.hmcts.net/jira/browse/CIV-747
Change description
Details of second claimant; postcode check
Does this PR introduce a breaking change? (check one with "x")
[ ] Yes
[X] No

Merged with another branch


feat: modernization (2024)

@dcbroad3 have you tried Bun?
If you use it you may remove all the ts-node and it installs deps ten times faster

@dcbroad3 have you tried Bun? If you use it you may remove all the ts-node stuff and it installs deps ten times faster

I'm on Windows. Last I heard that wasn't supported, am I wrong? Maybe I could use WSL.

@dcbroad3 have you tried Bun? If you use it you may remove all the ts-node stuff and it installs deps ten times faster

I'm on Windows. Last I heard that wasn't supported, am I wrong? Maybe I could use WSL.

Bundows is there since April 1st https://bun.sh/blog/bun-v1.1
https://bun.sh/


can not pull file from S3

I tried to follow our workshop exercise again, but I failed at this step, any idea?
sudo curl -o /etc/NetworkManager/dispatcher.d/90.set_ppp_route_metric https://soracom-files.s3.amazonaws.com/handson/90.set_ppp_route_metric
Error message:
HypriotOS/armv7: pirate@rpi-soracom in ~
$ sudo curl -o /etc/NetworkManager/dispatcher.d/90.set_ppp_route_metric https://soracom-files.s3.amazonaws.com/handson/90.set_ppp_route_metric
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:--  0:00:39 --:--:--     0curl: (6) Could not resolve host: soracom-files.s3.amazonaws.com

Here is the new url : https://soracom-files.s3.amazonaws.com/starterkit/hcsr04.py
Command : curl -O https://soracom-files.s3.amazonaws.com/starterkit/hcsr04.py
Reference : https://www.soracom.io/iot-starter-kit/


test-branch/execute-job/comment-from-wrong-user-on-pr/6157362e-2b8e-43a6-af68-b3b1f448be93

PR for testing cd92f23c0b625f83971d27d87398b06413ce9a63

/canonical/self-hosted-runners/run-workflows cd92f23c0b625f83971d27d87398b06413ce9a63


Transcriptome versions used at refgenomes.databio.org

Hi guys,
Thanks again for maintaining this awesome resource.
I got a quick question, any ideas on how do respond to the following question ?
https://github.com/COMBINE-lab/salmon/issues/614

responded, thanks for bringing it up here

responded, thanks for bringing it up here


IIS 10, Python 3.6, Django 1.8 and wfastcgi 3.0.0

web.config:
<?xml version="1.0" encoding="UTF-8"?>
<configuration>
    <system.webServer>
        <handlers accessPolicy="Read, Execute, Script">
            <add name="Python WfastCGI Nativo"
              path="*"
              verb="*"
              modules="FastCgiModule"
              scriptProcessor="C:\Python3632\python.exe|C:\Python3632\Lib\site-packages\wfastcgi.py"
              resourceType="Unspecified"
              requireAccess="Script" />
        </handlers>
    </system.webServer>
  <appSettings>
    <!--Required settings-->
    <add key="WSGI_HANDLER" value="django.core.handlers.wsgi.WSGIHandler()" />
    <add key="PYTHONPATH" value="C:\Users\Administrador.FERTISERVER-PRU\Documents\Python\Django_intento2\intento2" />
    <add key="DJANGO_SETTINGS_MODULE" value="intento2.settings" />
    <add key="WSGI_PTVSD_ADDRESS" value="<IP_ADDRESS>:82"/>
  </appSettings>
</configuration>

Error:

Error occurred:
Traceback (most recent call last):
File "C:\Python3632\Lib\site-packages\wfastcgi.py", line 785, in main
os.chdir(response.physical_path)
PermissionError: [WinError 5] Acceso denegado: 'C:\Users\Administrador.FERTISERVER-PRU\Documents\Python\Django_intento2\'
StdOut:
StdErr:

You should probably move your app to somewhere that the IIS worker user has access to. By default I believe it runs as a restricted user to avoid letting the entire network have access to your Administrator account.

You should probably move your app to somewhere that the IIS worker user has access to. By default I believe it runs as a restricted user to avoid letting the entire network have access to your Administrator account.
That did the job, thank you!


Critical: why C and Python bindings

write everything in rust bro

alas, some people avoid carcinization

good meme, now mine


Test Master/Slave WiFi

By whatever means necessary, get the NUC and the laptop to talk over a WiFi network. Echo some messages on one side from the slave.

Wired NUC and Laptop together with an Ethernet cable. Set NUC as master, broadcast std_msgs/String from NUC->laptop and from laptop->NUC. Set laptop as master, same deal.


New PR for u4 hands-on

Same as https://github.com/huggingface/audio-transformers-course/pull/37
However, the initial PR bugs at resolving the conflict.

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.


[ANCHOR-205] Validate PATCH transactions request body.

PR Checklist
PR Structure

[x] This PR has reasonably narrow scope (if not, break it down into smaller PRs).
[x] This PR avoids mixing refactoring changes with feature changes (split into two PRs
otherwise).
[ ] This PR's title starts with name of package that is most changed in the PR, ex.
paymentservice.stellar, or all or doc if the changes are broad or impact many
packages.

Thoroughness

[x] This PR adds tests for the most critical parts of the new functionality or fixes.

What
Add NPE catchs on sending PATCH transactions request
Why
Return a understandable error response to the user instead of only Null exception error stack trace
Known limitations
The PATCH transactions endpoint will need more attention to handle failures of one or more transactions inside a list of transactions. Today the TransactionService returns a BadRequestException as soon as the first failure occurs, even if other transactions were already committed.

Reference Server Preview is available here:https://anchor-ref-pr867.previews.kube001.services.stellar-ops.com/SEP Server Preview is available here:https://anchor-sep-pr867.previews.kube001.services.stellar-ops.com/

Reference Server Preview is available here:https://anchor-ref-pr867.previews.kube001.services.stellar-ops.com/SEP Server Preview is available here:https://anchor-sep-pr867.previews.kube001.services.stellar-ops.com/

Reference Server Preview is available here:https://anchor-ref-pr867.previews.kube001.services.stellar-ops.com/SEP Server Preview is available here:https://anchor-sep-pr867.previews.kube001.services.stellar-ops.com/

Reference Server Preview is available here:https://anchor-ref-pr867.previews.kube001.services.stellar-ops.com/SEP Server Preview is available here:https://anchor-sep-pr867.previews.kube001.services.stellar-ops.com/


docs: prepare onboarding material for Osmosis chain dev

Background
We should have onboarding material across various levels of the tech stack to help new engineers understand the full scope of the project. The following components should be considered:

Tendermint / ABCI (consensus layer)
IAVL (storage layer)
SDK

snapshots
pruning
other SDK related features
core modules used by our project

Osmosis app

core modules

The onboarding material should be concise, without going into much detail. The expectation is that this document is to be the first material to be looked at when onboarding on Osmosis. Links should be added for each topic to be explored in more depth on a needs basis.

I'm imagining a powerpoint, that has a brief descriptions of the various components of the stack, and known problems we face from them, e.g.:

P2P layer, security concerns, gets overloaded very quickly, lots of annoying logs
Mempool layer, FIFO txs, Runs ABCI CheckTX. (Which runs antehandler middleware & msg.ValidateBasic), builds txs based off of GasWanted.
Tendermint Consensus, there exist prevote, precommits, and round increases. Some info on double signs
ABCI, (CheckTx, DeliverTx, Commit) expectations
ABCI++ (can just copy existing slides)
State machine
IAVL exists, is slow. We do one big write at end of block
what is app module vs other modules
Structure of a cosmos module
Links to important genera info to have (staking)
Osmosis repo modules

Epochs, superfluid, gamm, lockup, incentivess
Diagram of how they link together

As far as I know, haven't seen any high level explanations to show to new folks. I end up doing that on calls at the moment, in very ad-hoc ways

Nice! Yeah a PDF on this would be dope. I like the idea!

Not sure if you're familiar with markdown slides but it may be an easy way to keep it maintainable while still having it show up in slide format

ref: https://github.com/cosmos/cosmos-sdk/issues/13171
Just linking this to port some ideas over when we start working on this


IPAM allocator to not accept a datastore update if already present

After #1119, IPAM driver needs to be updated to still block a datastore update for the address space if the address space already has a backing datastore.
Before it was enough to check for the address space presence, since it was getting initialized only if it had a backing datastore. Now this assumption is no longer true.
Signed-off-by: Alessandro Boch<EMAIL_ADDRESS>

LGTM

LGTM


Please provide Typings

I just gave this library a shot, primarily because I was:

looking for a simpler, more robust to CSSTransitionGroup
trying to do a slideUp and slideDown Effect on an auto-sized container (which CSS can't do)

I am honestly amazed by this library, both the core velocity.js and the smooth react integration. It just fits!
Many react users (including me) are quite fond of TypeScript, even react itself comes with all typings included. This library would be even more awesome if it had a velocity-react.d.ts file to help with code completion and error checking. My own knowledge of this library is too limited to have a holistic picture of all possible settings. Is there any chance you could provide the typings? I already checked the web for existing typings for this library, but there are none it seems...

I'm open to PRs, but won't implement this personally.
Note that most of the typing would actually come from Velocity.js, since these components pass through many of the props.

Well, as it happens, there are typings for Velocity already (however, I don't know how complete they are):
https://github.com/DefinitelyTyped/DefinitelyTyped/blob/354cec620daccfa0ad167ba046651fb5fef69e8a/types/velocity-animate/index.d.ts
... just if anybody is interested in doing this. I'm just starting out with this library.

Okay I took a look at it after all. Using your NPM documentation, I was able to figure out most things I think. I have attached my velocity-react.d.ts file to this post (velocity-react.d.ts.zip; I had to zip it because GitHub does not accept *.ts files as attachments).
This file has no guarantee for completion, but it works to get the basic examples going and give some guidance. It also lists the names of all animations that are included in velocity by default.
This file has absolutely zero dependencies to velocity typings. For attributes/references that refer to velocity, this typings file uses Object. This is because the standard velocity typings are crawling with Object and any types to begin with, so there is not much point in including them.
Feel free to do with this file whatever you want. If you take a look and see something missing, please, by all means, do update it. This is merely what I can make of the documentation.

Thanks for putting this together. I'll try and take a look and see about getting it in. I use Flow rather than TypeScript in my own projects, so I'd have to get familiar with it first.

@finneganh @MartinHaeusler Any further progess on this? Typings would be super useful as typescript has gained a lot of momentum since google endorsed it for angular... It makes the api a lot more discoverable too.

bump

Hi @fionawhim, are you planning to add Typings?

@kusmierz Nope.

dude it's almost four years since this issue was created. just bumping here to see what happens 🤷🏻♂


send a Public Reset when receiving a CHLO with the FHL2 tag

Fixes #411.
Chrome sends the FHL2 when it wants to perform a head-of-line blocking
experiment, introduced in QUIC version 36 (see
https://codereview.chromium.org/2115033002). We don’t support this
experiment. By sending a Public Reset when receiving this tag we force
Chrome to use the TCP fallback.

Codecov Report

Merging #489 into master will decrease coverage by 0.01%.
The diff coverage is 100%.

@@            Coverage Diff             @@
##           master     #489      +/-   ##
==========================================
- Coverage    90.4%   90.39%   -0.01%
==========================================
  Files          81       80       -1
  Lines        5416     5412       -4
==========================================
- Hits         4896     4892       -4
  Misses        334      334
  Partials      186      186

Impacted Files
Coverage Δ

handshake/crypto_setup_server.go
82.01% <100%> (+0.15%)
:arrow_up:

session.go
87.47% <100%> (ø)
:arrow_up:

crypto/config_for_client_1.8.go

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 9a1e86c...6d5c977. Read the comment docs.

I tested that

Chrome actually uses the TCP fallback when receiving a Public Reset during the handshake.
The Public Reset is actually only sent when the FHL2 tag is present (using our client, I didn't dig deep enough into the Chrome code to compile a quic_client that sends that tag).


Add space-age exercise

@pfertyk, all eight implemented tests are picked up. There was a ninth test testing error handling, but I marked that as not included in the test suite. It's not that terribly interesting of a test so we won't miss it.

We can do it like that, or we can return a null (or 0) in case of an error. For this exercise, I think it would be a rather clean workaround for the fact that Godot doesn't support error handling :)
Which option do you think is better?


extra \r in eATCIFSR

Extra \r in eATCIFSR
change
return recvFindAndFilter("OK", "\r\r\n", "\r\n\r\nOK", list);
to:
return recvFindAndFilter("OK", "\r\n", "\r\n\r\nOK", list);

You can use our way to try to see if there is no problem.Then can check the serial port using hex printed characters, you will find that is \ r \ r \ n.Thank you for your questions.


%request.Get(foo,bar) is wrongly converted to $g(%request.Data(foo,bar))

Should instead resolve to $g(%request.Data(foo),bar)
Same for %session equivalent

Additionally CodeTidy fails to add an index to the %request.Data call. This should default to 1 if no index is specified by the previous %request.Get.

since argument for default value can take arbitrary form that computes to a value, only refactor if no default value given


[Enhancement] spark/flink connector export data without using column pool (#30855)

spark/flink connector export data without using column pool

[BE Incremental Coverage Report]
:disappointed: fail : 0 / 13 (00.00%)
file detail

path
covered_line
new_line
coverage
not_covered_line_detail

:large_blue_circle:
src/storage/chunk_helper.cpp
0
1
00.00%
[276]

:large_blue_circle:
src/connector/lake_connector.cpp
0
1
00.00%
[277]

:large_blue_circle:
src/runtime/runtime_state.h
0
1
00.00%
[125]

:large_blue_circle:
src/exec/pipeline/scan/olap_chunk_source.cpp
0
1
00.00%
[344]

:large_blue_circle:
src/runtime/runtime_state.cpp
0
6
00.00%
[265, 267, 268, 269, 270, 272]

:large_blue_circle:
src/exec/olap_scan_node.cpp
0
2
00.00%
[194, 691]

:large_blue_circle:
src/runtime/fragment_mgr.cpp
0
1
00.00%
[911]

[BE Incremental Coverage Report]
:disappointed: fail : 0 / 14 (00.00%)
file detail

path
covered_line
new_line
coverage
not_covered_line_detail

:large_blue_circle:
src/storage/chunk_helper.cpp
0
1
00.00%
[276]

:large_blue_circle:
src/connector/lake_connector.cpp
0
2
00.00%
[274, 275]

:large_blue_circle:
src/runtime/runtime_state.h
0
1
00.00%
[125]

:large_blue_circle:
src/exec/pipeline/scan/olap_chunk_source.cpp
0
1
00.00%
[347]

:large_blue_circle:
src/runtime/runtime_state.cpp
0
6
00.00%
[265, 267, 268, 269, 270, 272]

:large_blue_circle:
src/exec/olap_scan_node.cpp
0
2
00.00%
[194, 691]

:large_blue_circle:
src/runtime/fragment_mgr.cpp
0
1
00.00%
[911]

[FE Incremental Coverage Report]
:heart_eyes: pass : 0 / 0 (0%)


Fix the bug of view N/ L/ not showing correct response message

Now view N/ L/ will show "Listed all players with no lineup"

Codecov Report

Merging #257 (d5f5592) into master (1fa72ed) will decrease coverage by 0.05%.
The diff coverage is 33.33%.

@@             Coverage Diff              @@
##             master     #257      +/-   ##
============================================
- Coverage     55.29%   55.23%   -0.06%
  Complexity      610      610
============================================
  Files           107      107
  Lines          2796     2799       +3
  Branches        391      392       +1
============================================
  Hits           1546     1546
- Misses         1103     1105       +2
- Partials        147      148       +1

Impacted Files
Coverage Δ

.../seedu/address/logic/parser/ViewCommandParser.java
13.55% <0.00%> (-0.12%)
:arrow_down:

...java/seedu/address/logic/commands/ViewCommand.java
65.21% <40.00%> (-2.97%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 1fa72ed...d5f5592. Read the comment docs.


MBTiles database

Hi, this project is really amazing. Thanks for the great work you've put in.
I've set it up with GMap.net but I've had a bit of trouble using it with a database. What sort of database would make it possible to retrieve the MBTiles that GMap.net needs? I've looked into the OpenMapTiles server but wasn't sure if it was the right way, or how Gmap.net would be able to get the right tiles.

Technically, all sorts of vector mbtiles can work as long as the style schema is based upon it.
Right now, openmaptiles vector tiles are downloaded and used for this repo.


Having Two Tests With The Same Name Using Snapshot's Should Error

More of feature than a bug.
What is the current behavior?
it('should return a page', () => {
  expect(getPageById(store.getState(), '7')).toMatchSnapshot();
});

it('should return a page', () => {
  expect(getPageById(store.getState(), '8')).toMatchSnapshot();
});

Currently, the above code will not work as multiple runs will result in different snapshot results I'm guessing due to parallelism? This is because snapshots use the same string for the test description, in this case: 'should return a page'. The end user experience is frustrating in that you think your code is not idempotent when really you are just overwriting your own snapshot by using the same test name.
I believe this could save a lot of frustration as copying a test block, pasting below and testing a variation is a common flow.
What is the expected behavior?
I would expect Jest to early exit when trying to do multiple snapshots in the same file with the same description. For example, "You are attempting to use different snapshots for multiple tests. This will result in failing tests. Try to change one of the it() blocks to a different description."
Run Jest again with --debug and provide the full configuration it prints. Please mention your node and npm version and operating system.
Node v6.3.1
macOS Sierra
Jest 15.1.1

that should be fixed by https://github.com/facebook/jest/pull/1721#discussion_r79238454


etcd2 cluster doesnt start

Hi
Im not sure whether i have something configured incorrectly or whether this is a bug so apologies if this is posted as an issue and its not. I have looked for docs around this config and cant see anything obviously wrong but happy to read more if someone can point me in the right direction.
Problem is that using default config the etcd2 cluster wont start.
Im using v0.9.1-rc.2
below is the etc2d config in userdata/cloud-config-etcd file which is unchanged from what was generated using the kube-aws render command
_units:
- name: etcd2.service
drop-ins:
- name: 20-etcd2-aws-cluster.conf
content: |
[Unit]
Requires=decrypt-tls-assets.service
After=decrypt-tls-assets.service
        [Service]
        Environment=ETCD_NAME=%H

        Environment=ETCD_PEER_TRUSTED_CA_FILE=/etc/etcd2/ssl/ca.pem
        Environment=ETCD_PEER_CERT_FILE=/etc/etcd2/ssl/etcd.pem
        Environment=ETCD_PEER_KEY_FILE=/etc/etcd2/ssl/etcd-key.pem

        Environment=ETCD_CLIENT_CERT_AUTH=true
        Environment=ETCD_TRUSTED_CA_FILE=/etc/etcd2/ssl/ca.pem
        Environment=ETCD_CERT_FILE=/etc/etcd2/ssl/etcd.pem
        Environment=ETCD_KEY_FILE=/etc/etcd2/ssl/etcd-key.pem

        Environment=ETCD_INITIAL_CLUSTER_STATE=new
        Environment=ETCD_INITIAL_CLUSTER={{.EtcdInitialCluster}}
        Environment=ETCD_DATA_DIR=/var/lib/etcd2
        Environment=ETCD_LISTEN_CLIENT_URLS=https://%H:2379
        Environment=ETCD_ADVERTISE_CLIENT_URLS=https://%H:2379
        Environment=ETCD_LISTEN_PEER_URLS=https://%H:2380
        Environment=ETCD_INITIAL_ADVERTISE_PEER_URLS=https://%H:2380
        PermissionsStartOnly=true
        ExecStartPre=/usr/bin/chown -R etcd:etcd /var/lib/etcd2
  enable: true
  command: start_

my cluster.yaml contains this:
hostedZoneId: "sandbox.testwaikato.kiwi"
and
etcdCount: 3
all other DNS and etcd config in it is default.
The problem is that when the etcd tries to start with this config there is an error:
Nov 15 20:10:52 ip-172-19-76-198.sandbox.testwaikato.kiwi systemd[1]: Starting etcd2...
Nov 15 20:10:54 ip-172-19-76-198.sandbox.testwaikato.kiwi etcd2[1265]: recognized and used environment variable ETCD_ADVERTISE_CLIENT_URLS=https://ip-172-19-76-198.sandbox.testwaikato.kiwi:2379
Nov 15 20:10:54 ip-172-19-76-198.sandbox.testwaikato.kiwi etcd2[1265]: recognized and used environment variable ETCD_CERT_FILE=/etc/etcd2/ssl/etcd.pem
Nov 15 20:10:54 ip-172-19-76-198.sandbox.testwaikato.kiwi etcd2[1265]: recognized and used environment variable ETCD_CLIENT_CERT_AUTH=true
Nov 15 20:10:54 ip-172-19-76-198.sandbox.testwaikato.kiwi etcd2[1265]: recognized and used environment variable ETCD_DATA_DIR=/var/lib/etcd2
Nov 15 20:10:54 ip-172-19-76-198.sandbox.testwaikato.kiwi etcd2[1265]: recognized and used environment variable ETCD_ELECTION_TIMEOUT=1200
Nov 15 20:10:54 ip-172-19-76-198.sandbox.testwaikato.kiwi etcd2[1265]: recognized and used environment variable ETCD_INITIAL_ADVERTISE_PEER_URLS=https://ip-172-19-76-198.sandbox.testwaikato.kiwi:2380
Nov 15 20:10:54 ip-172-19-76-198.sandbox.testwaikato.kiwi etcd2[1265]: recognized and used environment variable ETCD_INITIAL_CLUSTER=ip-172-19-76-198.ap-southeast-2.compute.internal=https://ip-172-19-76-198.ap-southeast-2.compute.intern
Nov 15 20:10:54 ip-172-19-76-198.sandbox.testwaikato.kiwi etcd2[1265]: recognized and used environment variable ETCD_INITIAL_CLUSTER_STATE=new
Nov 15 20:10:54 ip-172-19-76-198.sandbox.testwaikato.kiwi etcd2[1265]: recognized and used environment variable ETCD_KEY_FILE=/etc/etcd2/ssl/etcd-key.pem
Nov 15 20:10:54 ip-172-19-76-198.sandbox.testwaikato.kiwi etcd2[1265]: recognized and used environment variable ETCD_LISTEN_CLIENT_URLS=https://ip-172-19-76-198.sandbox.testwaikato.kiwi:2379
Nov 15 20:10:54 ip-172-19-76-198.sandbox.testwaikato.kiwi etcd2[1265]: recognized and used environment variable ETCD_LISTEN_PEER_URLS=https://ip-172-19-76-198.sandbox.testwaikato.kiwi:2380
Nov 15 20:10:54 ip-172-19-76-198.sandbox.testwaikato.kiwi etcd2[1265]: recognized and used environment variable ETCD_NAME=ip-172-19-76-198.sandbox.testwaikato.kiwi
Nov 15 20:10:54 ip-172-19-76-198.sandbox.testwaikato.kiwi etcd2[1265]: recognized and used environment variable ETCD_PEER_CERT_FILE=/etc/etcd2/ssl/etcd.pem
Nov 15 20:10:54 ip-172-19-76-198.sandbox.testwaikato.kiwi etcd2[1265]: recognized and used environment variable ETCD_PEER_KEY_FILE=/etc/etcd2/ssl/etcd-key.pem
Nov 15 20:10:54 ip-172-19-76-198.sandbox.testwaikato.kiwi etcd2[1265]: recognized and used environment variable ETCD_PEER_TRUSTED_CA_FILE=/etc/etcd2/ssl/ca.pem
Nov 15 20:10:54 ip-172-19-76-198.sandbox.testwaikato.kiwi etcd2[1265]: recognized and used environment variable ETCD_TRUSTED_CA_FILE=/etc/etcd2/ssl/ca.pem
Nov 15 20:10:54 ip-172-19-76-198.sandbox.testwaikato.kiwi etcd2[1265]: etcd Version: 2.3.7
Nov 15 20:10:54 ip-172-19-76-198.sandbox.testwaikato.kiwi etcd2[1265]: Git SHA: fd17c91
Nov 15 20:10:54 ip-172-19-76-198.sandbox.testwaikato.kiwi etcd2[1265]: Go Version: go1.7.1
Nov 15 20:10:54 ip-172-19-76-198.sandbox.testwaikato.kiwi etcd2[1265]: Go OS/Arch: linux/amd64
Nov 15 20:10:54 ip-172-19-76-198.sandbox.testwaikato.kiwi etcd2[1265]: setting maximum number of CPUs to 1, total number of available CPUs is 1
Nov 15 20:10:54 ip-172-19-76-198.sandbox.testwaikato.kiwi etcd2[1265]: found invalid file/dir lost+found under data dir /var/lib/etcd2 (Ignore this if you are upgrading etcd)
Nov 15 20:10:54 ip-172-19-76-198.sandbox.testwaikato.kiwi etcd2[1265]: peerTLS: cert = /etc/etcd2/ssl/etcd.pem, key = /etc/etcd2/ssl/etcd-key.pem, ca = , trusted-ca = /etc/etcd2/ssl/ca.pem, client-cert-auth = false
Nov 15 20:10:54 ip-172-19-76-198.sandbox.testwaikato.kiwi etcd2[1265]: listening for peers on https://ip-172-19-76-198.sandbox.testwaikato.kiwi:2380
Nov 15 20:10:54 ip-172-19-76-198.sandbox.testwaikato.kiwi etcd2[1265]: clientTLS: cert = /etc/etcd2/ssl/etcd.pem, key = /etc/etcd2/ssl/etcd-key.pem, ca = , trusted-ca = /etc/etcd2/ssl/ca.pem, client-cert-auth = true
Nov 15 20:10:54 ip-172-19-76-198.sandbox.testwaikato.kiwi etcd2[1265]: listening for client requests on https://ip-172-19-76-198.sandbox.testwaikato.kiwi:2379
Nov 15 20:10:54 ip-172-19-76-198.sandbox.testwaikato.kiwi etcd2[1265]: stopping listening for client requests on https://ip-172-19-76-198.sandbox.testwaikato.kiwi:2379
Nov 15 20:10:54 ip-172-19-76-198.sandbox.testwaikato.kiwi etcd2[1265]: stopping listening for peers on https://ip-172-19-76-198.sandbox.testwaikato.kiwi:2380
Nov 15 20:10:54 ip-172-19-76-198.sandbox.testwaikato.kiwi etcd2[1265]: couldn't find local name "ip-172-19-76-198.sandbox.testwaikato.kiwi" in the initial cluster configuration
Nov 15 20:10:54 ip-172-19-76-198.sandbox.testwaikato.kiwi systemd[1]: etcd2.service: Main process exited, code=exited, status=1/FAILURE
Nov 15 20:10:54 ip-172-19-76-198.sandbox.testwaikato.kiwi systemd[1]: Failed to start etcd2.
Nov 15 20:10:54 ip-172-19-76-198.sandbox.testwaikato.kiwi systemd[1]: etcd2.service: Unit entered failed state.
Nov 15 20:10:54 ip-172-19-76-198.sandbox.testwaikato.kiwi systemd[1]: etcd2.service: Failed with result 'exit-code'.
running hostname on each etcd server returns the non aws hostname
e.g
ip-172-19-76-198.sandbox.testwaikato.kiwi
if i then go onto my etcd2 servers and change the /etc/systemd/system/etc2.service.d/20-etcd2-aws-cluster.conf file by replacing the %H references with the aws DNS values for the host
e.g
Environment=ETCD_LISTEN_CLIENT_URLS=https://ip-172-19-76-198.ap-southeast-2.compute.internal:2379
Environment=ETCD_ADVERTISE_CLIENT_URLS=https://ip-172-19-76-198.ap-southeast-2.compute.internal:2379
Environment=ETCD_LISTEN_PEER_URLS=https://ip-172-19-76-198.ap-southeast-2.compute.internal:2380
Environment=ETCD_INITIAL_ADVERTISE_PEER_URLS=https://ip-172-19-76-198.ap-southeast-2.compute.internal:2380
and start the service it works.
It looks to me like the Environment=ETCD_INITIAL_CLUSTER=ip-172-19-76-198.ap-southeast-2.compute.internal=https://ip-172-19-76-198.ap-southeast-2.compute.internal:2380,ip-172-19-77-197.ap-southeast-2.compute.internal=https://ip-172-19-77-197.ap-southeast-2.compute.internal:2380,ip-172-19-76-199.ap-southeast-2.compute.internal=https://ip-172-19-76-199.ap-southeast-2.compute.internal:2380 line is using the aws DNS entries but by having %H in the user data i get ip-172-19-76-199.sandbox.testwaikato.kiwi in my config and even though they both resolve etcd wont start because of this?
So is this a bug or is there someway to set the config to either my local dns names OR aws hostnames in userdata/cloud-config-etcd ?

@baldeynz Hi, thanks for trying kube-aws!
Unfortunately, kube-aws doesn't support hostnames coming from Route53 private DNS(!= not the one provided by default in AWS) for etcd nodes.
To provide some context, would you mind looking into https://github.com/coreos/kube-aws/blob/master/config/config.go#L254-L321, especially
https://github.com/coreos/kube-aws/blob/master/config/config.go#L298-L319 to see how we're computing hostnames to be provided to {{.EtcdInitialCluster}} hence ETCD_INITIAL_CLUSTER.
Anyways, I believe that this is something we'd like to support in the future.

Thanks for the quick response :)

Thanks for the quick response :)

Was directed here via feedback from another issue: https://github.com/coreos/coreos-kubernetes/issues/675#issuecomment-261139183
Quoting from the feedback to me in the other issue noted above:

As you can see in that issue, you can workaround it by modifying cloud-config-etcd to use hostnames from the AWS default private DNS.

Disclaimer I'm using the latest kube-aws version v0.9.1-rc.3 and the above solution was for the previous RC2 version. . .
I tried to follow the steps noted above by @baldeynz
First I manually edited the /etc/systemd/system/etcd2.service.d/20-etcd2-aws-cluster.conf file on my existing etcd node (I currently only deploy/have one) and then after seeing the errors about the empty PEM file, I went ahead and destroyed my stack with kube-aws destroy and then modified the cloud-config-etcd file with the same modifications using the resolvable AWS DNS name and redeployed the stack.  Unfortunately, this did not work for me and below is what I see after completing the steps and trying to restart etcd2
journalctl -xe out shows what appears to be a cert error now preventing the service from running--the critical error here seems to be  tls: failed to find any PEM data in certificate input see below the .pem files are zero bytes on my etcd node.
Full output included below:
  Nov 18 00:08:36 ip-10-1-10-5.terradatum.com etcd2[4138]: recognized and used environment variable ETCD_ADVERTISE_CLIENT_URLS=https://ip-10-1-10-5.us-west-1.compute.internal:2379
Nov 18 00:08:36 ip-10-1-10-5.terradatum.com etcd2[4138]: recognized and used environment variable ETCD_CERT_FILE=/etc/etcd2/ssl/etcd.pem
Nov 18 00:08:36 ip-10-1-10-5.terradatum.com etcd2[4138]: recognized and used environment variable ETCD_CLIENT_CERT_AUTH=true
Nov 18 00:08:36 ip-10-1-10-5.terradatum.com etcd2[4138]: recognized and used environment variable ETCD_DATA_DIR=/var/lib/etcd2
Nov 18 00:08:36 ip-10-1-10-5.terradatum.com etcd2[4138]: recognized and used environment variable ETCD_ELECTION_TIMEOUT=1200
Nov 18 00:08:36 ip-10-1-10-5.terradatum.com etcd2[4138]: recognized and used environment variable ETCD_INITIAL_ADVERTISE_PEER_URLS=https://ip-10-1-10-5.us-west-1.compute.internal:2380
Nov 18 00:08:36 ip-10-1-10-5.terradatum.com etcd2[4138]: recognized and used environment variable ETCD_INITIAL_CLUSTER=ip-10-1-10-5.us-west-1.compute.internal=https://ip-10-1-10-5.us-west-1.compute.internal:2380
Nov 18 00:08:36 ip-10-1-10-5.terradatum.com etcd2[4138]: recognized and used environment variable ETCD_INITIAL_CLUSTER_STATE=new
Nov 18 00:08:36 ip-10-1-10-5.terradatum.com etcd2[4138]: recognized and used environment variable ETCD_KEY_FILE=/etc/etcd2/ssl/etcd-key.pem
Nov 18 00:08:36 ip-10-1-10-5.terradatum.com etcd2[4138]: recognized and used environment variable ETCD_LISTEN_CLIENT_URLS=https://ip-10-1-10-5.us-west-1.compute.internal:2379
Nov 18 00:08:36 ip-10-1-10-5.terradatum.com etcd2[4138]: recognized and used environment variable ETCD_LISTEN_PEER_URLS=https://ip-10-1-10-5.us-west-1.compute.internal:2380
Nov 18 00:08:36 ip-10-1-10-5.terradatum.com etcd2[4138]: recognized and used environment variable ETCD_NAME=ip-10-1-10-5.us-west-1.compute.internal
Nov 18 00:08:36 ip-10-1-10-5.terradatum.com etcd2[4138]: recognized and used environment variable ETCD_PEER_CERT_FILE=/etc/etcd2/ssl/etcd.pem
Nov 18 00:08:36 ip-10-1-10-5.terradatum.com etcd2[4138]: recognized and used environment variable ETCD_PEER_KEY_FILE=/etc/etcd2/ssl/etcd-key.pem
Nov 18 00:08:36 ip-10-1-10-5.terradatum.com etcd2[4138]: recognized and used environment variable ETCD_PEER_TRUSTED_CA_FILE=/etc/etcd2/ssl/ca.pem
Nov 18 00:08:36 ip-10-1-10-5.terradatum.com etcd2[4138]: recognized and used environment variable ETCD_TRUSTED_CA_FILE=/etc/etcd2/ssl/ca.pem
Nov 18 00:08:36 ip-10-1-10-5.terradatum.com etcd2[4138]: etcd Version: 2.3.7
Nov 18 00:08:36 ip-10-1-10-5.terradatum.com etcd2[4138]: Git SHA: fd17c91
Nov 18 00:08:36 ip-10-1-10-5.terradatum.com etcd2[4138]: Go Version: go1.7.1
Nov 18 00:08:36 ip-10-1-10-5.terradatum.com etcd2[4138]: Go OS/Arch: linux/amd64
Nov 18 00:08:36 ip-10-1-10-5.terradatum.com etcd2[4138]: setting maximum number of CPUs to 1, total number of available CPUs is 1
Nov 18 00:08:36 ip-10-1-10-5.terradatum.com etcd2[4138]: found invalid file/dir lost+found under data dir /var/lib/etcd2 (Ignore this if you are upgrading etcd)
Nov 18 00:08:36 ip-10-1-10-5.terradatum.com etcd2[4138]: peerTLS: cert = /etc/etcd2/ssl/etcd.pem, key = /etc/etcd2/ssl/etcd-key.pem, ca = , trusted-ca = /etc/etcd2/ssl/ca.pem, client-cert-auth = false
Nov 18 00:08:36 ip-10-1-10-5.terradatum.com etcd2[4138]: tls: failed to find any PEM data in certificate input
Nov 18 00:11:51 ip-10-1-10-5.terradatum.com systemd[1]: etcd2.service: Main process exited, code=exited, status=1/FAILURE
Nov 18 00:11:51 ip-10-1-10-5.terradatum.com systemd[1]: Failed to start etcd2.
-- Subject: Unit etcd2.service has failed
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
--
-- Unit etcd2.service has failed.
--
-- The result is failed.
Nov 18 00:11:51 ip-10-1-10-5.terradatum.com systemd[1]: etcd2.service: Unit entered failed state.
Nov 18 00:11:51 ip-10-1-10-5.terradatum.com systemd[1]: etcd2.service: Failed with result 'exit-code'.

This appears to be the problem that the etcd2 service is complaining about validating that the .pem files are 0 bytes/empty:
ls -lat /etc/etcd2/ssl/
total 76
drwxr-xr-x. 2 root root 4096 Nov 18 00:40 .
-rw-r--r--. 1 root root    0 Nov 18 00:40 etcd.pem
-rw-r--r--. 1 root root    0 Nov 18 00:39 etcd-key.pem
-rw-r--r--. 1 root root    0 Nov 18 00:38 etcd-client.pem
-rw-r--r--. 1 root root    0 Nov 18 00:37 etcd-client-key.pem
-rw-r--r--. 1 root root    0 Nov 18 00:36 ca.pem
drwxr-xr-x. 3 root root 4096 Nov 18 00:36 ..
-rw-r--r--. 1 root root 1215 Nov 18 00:36 ca.pem.enc
-rw-r--r--. 1 root root 1820 Nov 18 00:36 etcd-client-key.pem.enc
-rw-r--r--. 1 root root 1239 Nov 18 00:36 etcd-client.pem.enc
-rw-r--r--. 1 root root 1824 Nov 18 00:36 etcd-key.pem.enc
-rw-r--r--. 1 root root 1309 Nov 18 00:36 etcd.pem.enc

Unfortunately this process did not work for me with the latest RC3 version, perhaps I should try reverting back to the previous RC version used above which was RC2 and see if we have better luck with it?
If this manual workaround process ends up working for us, it could allow us to move forward on a temp basis, provided we always know and can specify/configure the IP addresses (for the etcd node, etc.) in each clusters' cluster.yaml (separate git repos).  However, this seem problematic for having multiple clusters/stacks (automated and deployed via kube-aws) in our shared VPC, which is the ideal scenario for us.  Suppose we could write scripts to increment the ports and CIDR ranges for new kube clusters similar to what we used to do for many tomcat instances on the same host if/as needed tho.
Thanks @baldeynz and @mumoshu for your information and assistance.

Hi @cmcconnell1, thanks as always!
At first, there's no significant change between rc.2 and rc.3 regarding how etcd nodes are provisioned, therefore the issue might have no relation to the difference in versions.
Two things:

Would you mind looking into the credentials directory by e.g. running ls -lah credentials/?

Are the original credentials/etcd*pem and ca.pem files in your local disk with non-zero sizes?

What it looks like in my env is:
$ ls -lh e2e/assets/kubeawstest1/credentials/
total 96
-rw-------  1 cw_kuoka  staff   1.6K 11 18 10:13 admin-key.pem
-rw-------  1 cw_kuoka  staff   1.1K 11 18 10:13 admin.pem
-rw-------  1 cw_kuoka  staff   1.6K 11 18 10:13 apiserver-key.pem
-rw-------  1 cw_kuoka  staff   1.3K 11 18 10:13 apiserver.pem
-rw-------  1 cw_kuoka  staff   1.6K 11 18 10:13 ca-key.pem
-rw-------  1 cw_kuoka  staff   1.0K 11 18 10:13 ca.pem
-rw-------  1 cw_kuoka  staff   1.6K 11 18 10:13 etcd-client-key.pem
-rw-------  1 cw_kuoka  staff   1.1K 11 18 10:13 etcd-client.pem
-rw-------  1 cw_kuoka  staff   1.6K 11 18 10:13 etcd-key.pem
-rw-------  1 cw_kuoka  staff   1.1K 11 18 10:13 etcd.pem
-rw-------  1 cw_kuoka  staff   1.6K 11 18 10:13 worker-key.pem
-rw-------  1 cw_kuoka  staff   1.1K 11 18 10:13 worker.pem

Would you mind regenerating all the assets including cluster.yaml, user-data/*, credentials/* via first removing those and then running kube-aws init, kube-aws render?

@cmcconnell1 Also, could you check decrypt-tls-assets.service is working? I suggest running systemctl status decrypt-tls-assets.service and journalctl -u decrypt-tls-assets.service. That's the service responsible in decryptiong those tls assets(*.pem files).
Putting full log files to gist.github.com would help as we're still unsure which part of the whole system is failing(=close to the root cause).

Hello @mumoshu
For the initial creds/certs, below is the source credentials dir and contents (post kube-aws init/render) on my EC2 workstation using the latest RC4 revision:
ls -lh ./credentials/
total 48K
-rw-------. 1 cmcconnell cmcconnell 1.7K Nov 18 00:25 admin-key.pem
-rw-------. 1 cmcconnell cmcconnell 1.1K Nov 18 00:25 admin.pem
-rw-------. 1 cmcconnell cmcconnell 1.7K Nov 18 00:25 apiserver-key.pem
-rw-------. 1 cmcconnell cmcconnell 1.3K Nov 18 00:25 apiserver.pem
-rw-------. 1 cmcconnell cmcconnell 1.7K Nov 17 18:15 ca-key.pem
-rw-------. 1 cmcconnell cmcconnell 1.1K Nov 18 00:25 ca.pem
-rw-------. 1 cmcconnell cmcconnell 1.7K Nov 18 00:25 etcd-client-key.pem
-rw-------. 1 cmcconnell cmcconnell 1.1K Nov 18 00:25 etcd-client.pem
-rw-------. 1 cmcconnell cmcconnell 1.7K Nov 18 00:25 etcd-key.pem
-rw-------. 1 cmcconnell cmcconnell 1.2K Nov 18 00:25 etcd.pem
-rw-------. 1 cmcconnell cmcconnell 1.7K Nov 18 00:25 worker-key.pem
-rw-------. 1 cmcconnell cmcconnell 1.2K Nov 18 00:25 worker.pem

I also repeated the specified manual hack to modify the cloud-init-etcd file, hardcoding the expected etcd nodes AWS DNS name which resolves on the etcd node.
host ip-10-1-10-5.us-west-1.compute.internal
ip-10-1-10-5.us-west-1.compute.internal has address <IP_ADDRESS>

Full output from requested systemctl and journalctl commands on gists below, as for the "full log files" can you specify locations and names for all logs you would like to see?:
systemctl status decrypt-tls-assets.service
https://gist.github.com/cmcconnell1/db5e23b9a619641a848dcb1f0fe7fd41
journalctl -u decrypt-tls-assets.service
https://gist.github.com/cmcconnell1/9cf03cfb91dd7511f47f15eb9590e6e5
journalctl -xe
https://gist.github.com/cmcconnell1/62d0f20456531e8f18cf4f7588cb1b92
on the etcd node
ip-10-1-10-5 ~ # date
Fri Nov 18 20:33:17 UTC 2016

ls -alt  /etc/etcd2/ssl/
total 76
drwxr-xr-x. 2 root root 4096 Nov 18 19:14 .
-rw-r--r--. 1 root root    0 Nov 18 19:13 etcd.pem
-rw-r--r--. 1 root root    0 Nov 18 19:12 etcd-key.pem
-rw-r--r--. 1 root root    0 Nov 18 19:12 etcd-client.pem
-rw-r--r--. 1 root root    0 Nov 18 19:11 etcd-client-key.pem
-rw-r--r--. 1 root root 1215 Nov 18 19:10 ca.pem.enc
-rw-r--r--. 1 root root 1824 Nov 18 19:10 etcd-client-key.pem.enc
-rw-r--r--. 1 root root 1239 Nov 18 19:10 etcd-client.pem.enc
-rw-r--r--. 1 root root 1820 Nov 18 19:10 etcd-key.pem.enc
-rw-r--r--. 1 root root 1309 Nov 18 19:10 etcd.pem.enc
-rw-r--r--. 1 root root    0 Nov 18 19:10 ca.pem
drwxr-xr-x. 3 root root 4096 Nov 18 18:30 ..

Thanks again

It seems your nodes are not able to connect to the internet in order to download the awscli image.
Nov 18 19:13:37 ip-10-1-10-5.terradatum.com decrypt-tls-assets[681]: docker: Error response from daemon: Get https://quay.io/v1/_ping: dial tcp <IP_ADDRESS>:443: i/o timeout.

Hi @cmcconnell1, thanks as always!
I agree to @pieterlange for a possible source of your issue.
More concretely, I suspect that:

your network ACL is forbidding uses of the whole/or the part of ephemeral ports(from 32768 to 61000) for outbound connections(like 443=https in your case)
or your security group is forbidding uses of ephemeral ports in the outbound rules?

Excuse me if I'm repeating what you might know again but AFIAK ephemeral ports is used to "receive" packets from the other end of a tcp session. Forbidding uses of those in the ACL/SG outbound rule would end up dropping all the data like HTTP responses hence i/o timeout as you've seen in log.
I also have an experience trouble-shooting a slightly similar issue caused by blocking ephemeral ports in https://github.com/coreos/coreos-kubernetes/issues/744#issuecomment-257203618.


Integrate nanoc-external gem

It doesn’t make sense to have the nanoc-external functionality in a separate gem.

Migrated to nanoc/features/issues/10.


Update scheduler content with Slim CI jobs

What are you changing in this pull request and why?
With the upcoming improvements to Slim Continuous Integration (CI) jobs, updating these docs pages:

https://docs.getdbt.com/docs/deploy/dbt-cloud-job
https://docs.getdbt.com/docs/deploy/job-scheduler

Checklist

[ ] Review the Content style guide and About versioning so my content adheres to these guidelines.
[ ] Needs review from PM

Renaming existing pages (delete if not applicable):

[ ] Update website/sidebars.js if applicable
[ ] Add an entry website/static/_redirects
[ ] Ran link testing to update the links that point to the deleted page

I think this page might be broken now at least on the democratize access to logs link

can we move the entire fresh-rebuilds section
https://deploy-preview-3380--docs-getdbt-com.netlify.app/docs/deploy/cloud-ci-job#fresh-rebuilds
into the state page?
https://deploy-preview-3380--docs-getdbt-com.netlify.app/docs/deploy/project-state
fresh rebuilds doesn't belong with CI


feat(bridge UI): improve the input field on firefox

Describe the feature request
Firefox displays an input stepper that doesn't match te page in my opinion
Firefox:
Chrome:
So maybe getting rid of the stepper is the best apprach, since it's not really useful
Describe alternatives you've considered
Description of the alternatives you've considered here.
Additional context
Additional context here.

cc @shadab-taiko

Shadab, please check out these links

https://stackoverflow.com/questions/23372903/hide-up-down-arrow-buttons-spinner-in-input-number-firefox-29
https://stackoverflow.com/questions/33749896/hide-html5-input-type-number-arrow-with-a-css-class

Shadab, please check out these links

https://stackoverflow.com/questions/23372903/hide-up-down-arrow-buttons-spinner-in-input-number-firefox-29
https://stackoverflow.com/questions/33749896/hide-html5-input-type-number-arrow-with-a-css-class

@dantaik its already fixed in #6248 . Will close this issue once that PR is merged.


Update ACP and EIA 860m 2024 Q3

This PR

updates the ACP and EIA 860m pipelines to use data from 2024 Q3
adds a couple of notebooks for comparing old and new eia860m and acp data
Adds a pudl_eia860m_status_codes table that has descriptions of the operational status codes in the eia860m table
Uses s3://pudl.catalyst.coop instead of gs://parquet.catalyst.coop

Because we're doing a bunch of data updates right now, I'm going to create a separate PR that sets up a proper documentation framework and write update instructions.

I think the large capacity changes in the ISO are due to large projects moving along the ISO queue process. I calculated the pct change in number of projects and all the status codes are within 30% which makes more sense.


Allow magic redirection filter to javascript

Please, implement in the magics specifications "filter redirection" from Raku to JavaScript -- %% raku > javascript and/or %% perl6 > javascript.
(This type of specification is already available for LaTeX <-> HTML.)
For example, with this kind of specification:
%%  raku > javasript
<raku-code-that-produces-javascript-d3-code>

I can produce the plot shown here:

Currently, I am using this very "targeted" hack to be able to make the JavaScript D3 diagrams as the one above:
sub mime-type($str) is export {
    return do given $str {
        when /:i ^ '<svg' / {
            'image/svg+xml';
        }
        when /:i ^ '<img' / {
            'text/html';
        }
        when / ^ \s* '(function(element)' \s* '{' \s* 'require' \s* '(' \s* '[\'d3\']' \s* ',' \s* 'function(d3)'  \s* '{' / {
            'application/javascript';
        }
        default { 'text/plain' }
    }
}

(This request related is to related to my previous one, but as far as I can tell requires different implementation approach.)

There is a #% javascript magic -- is that sufficient?

No, it is not -- I am proposing Raku code (in Raku cells) that generates JavaScript code to have the results of the JavaScript code in the corresponding output cell.

Thank you!
Just tried it:

(Using the package "JavaScript::D3".)

cool!


Players in 1.11 being able to place blocks on their own locations

Hello,
Firstly I would like to say that I'm not sure if this issue is related or not to ViaVersion, so apologies if it's not.
What is the output link of /viaversion dump?
https://gist.github.com/anonymous/50510fc458efa5006d194e5e5fdf1c78
Are you using any additional software like BungeeCord? If so, what software and version? (Please list your plugins as well)
I'm using Waterfall (a BungeeCord fork) with my own plugins.
How does this error happen? login? Using an item?
Basically, players using 1.11 are being able to place blocks on their own locations. I also have a video showing the problem.
I've tested the problem in 1.8, 1.9, 1.10 and 1.12 and I couldn't reproduce it.
Is there an error in the console? Use pastebin.com. Is there a kick message?
No.

Damn

Insanu

brbrbrbr hue

When you boot the server does it state that the Paper patch has been applied?
It's because of a bug in paper but we have a workaround that should apply itself otherwise not much we can do.

I think it doesn't show any messages saying that the paper patch has been applied. Here is the complete boot log of my server: https://pastebin.com/LFFJ9jCZ

The dump you provided indicated you were running ViaVersion on the PaperSpigot server, the console logs don't contain anything to do with ViaVersion? (This patch will only work if ViaVersion is on the Paper server)

I'm sorry, I've pasted the wrong boot log. I got the correct one and yes, it shows a debug on the end of the boot:
[15:18:07] [Server thread/INFO]: [ViaVersion] Enabling PaperSpigot/TacoSpigot patch: Fixes block placement.
Shouldn't that be fixing the block placement problem?

What specific issues do you get because the patch isn't that good? It's meant as a makeshift workaround and isn't the best due to client lag.
If you can it might be worth switching from Paper / patching the issue (if you want to patch the issue for your version I can probably find the code that would need fixing as someone mentioned it a while back)

See above